-- Logs begin at Wed 2021-02-17 03:41:52 UTC, end at Wed 2021-02-17 04:57:24 UTC. -- Feb 17 04:18:53.244216 dv-cinder-759987-4-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Feb 17 04:18:53.252080 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Feb 17 04:18:53.254112 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: *** Starting uWSGI 2.0.15-debian (64bit) on [Wed Feb 17 04:18:53 2021] *** Feb 17 04:18:53.254112 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: compiled with version: 7.3.0 on 28 September 2018 15:41:15 Feb 17 04:18:53.254112 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: os: Linux-4.15.0-55-generic #60-Ubuntu SMP Tue Jul 2 18:22:20 UTC 2019 Feb 17 04:18:53.254112 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: nodename: dv-cinder-759987-4-iscsi Feb 17 04:18:53.254112 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: machine: x86_64 Feb 17 04:18:53.254112 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: clock source: unix Feb 17 04:18:53.254112 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: pcre jit disabled Feb 17 04:18:53.254112 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: detected number of CPU cores: 4 Feb 17 04:18:53.254112 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: current working directory: / Feb 17 04:18:53.254112 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: detected binary path: /usr/bin/uwsgi-core Feb 17 04:18:53.254112 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: dropping root privileges as early as possible Feb 17 04:18:53.255651 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: your processes number limit is 47843 Feb 17 04:18:53.255651 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: your memory page size is 4096 bytes Feb 17 04:18:53.255651 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: detected max file descriptor number: 2048 Feb 17 04:18:53.255651 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: lock engine: pthread robust mutexes Feb 17 04:18:53.255651 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: thunder lock: enabled Feb 17 04:18:53.255651 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Feb 17 04:18:53.255651 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: dropping root privileges after socket binding Feb 17 04:18:53.255651 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: Python version: 3.6.9 (default, Oct 8 2020, 12:12:24) [GCC 8.4.0] Feb 17 04:18:53.299989 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: Python main interpreter initialized at 0x55b2453fa9c0 Feb 17 04:18:53.299989 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: dropping root privileges after plugin initialization Feb 17 04:18:53.299989 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: python threads support enabled Feb 17 04:18:53.299989 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: your server socket listen backlog is limited to 100 connections Feb 17 04:18:53.299989 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: your mercy for graceful operations on workers is 90 seconds Feb 17 04:18:53.300447 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: mapped 402621 bytes (393 KB) for 2 cores Feb 17 04:18:53.300447 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: *** Operational MODE: preforking *** Feb 17 04:18:53.300620 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: dropping root privileges after application loading Feb 17 04:18:53.300620 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: *** uWSGI is running in multiple interpreter mode *** Feb 17 04:18:53.300620 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: spawned uWSGI master process (pid: 83313) Feb 17 04:18:53.300784 dv-cinder-759987-4-iscsi systemd[1]: Started Devstack devstack@n-api.service. Feb 17 04:18:53.301060 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: spawned uWSGI worker 1 (pid: 83314, cores: 1) Feb 17 04:18:53.301446 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: spawned uWSGI worker 2 (pid: 83315, cores: 1) Feb 17 04:18:53.301562 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Feb 17 04:18:57.780545 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2567}} Feb 17 04:18:57.781119 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2568}} Feb 17 04:18:57.782377 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2569}} Feb 17 04:18:57.782808 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2571}} Feb 17 04:18:57.783118 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2572}} Feb 17 04:18:57.783569 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:18:57.783932 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:18:57.784287 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:18:57.784637 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:18:57.785008 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:18:57.785352 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:18:57.786641 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:18:57.787002 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:18:57.787398 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:18:57.787692 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:18:57.788047 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:18:57.788414 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-759987-4-iscsi {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:18:57.788782 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:18:57.789123 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:18:57.789463 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2567}} Feb 17 04:18:57.789564 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:18:57.789770 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2568}} Feb 17 04:18:57.789868 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:18:57.790130 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:18:57.790493 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:18:57.790833 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:18:57.791386 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2569}} Feb 17 04:18:57.791489 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:18:57.791822 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2571}} Feb 17 04:18:57.791988 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:18:57.792136 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2572}} Feb 17 04:18:57.792281 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:18:57.792472 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:18:57.792615 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:18:57.792857 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:18:57.793010 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:18:57.793207 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:18:57.793349 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:18:57.793551 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:18:57.793698 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:18:57.794260 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:18:57.794411 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:18:57.794616 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:18:57.794757 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:18:57.794984 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:18:57.795167 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:18:57.795351 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:18:57.795492 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:18:57.795716 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-759987-4-iscsi {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:18:57.795857 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:18:57.796001 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:18:57.796158 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:18:57.796340 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:18:57.796487 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:18:57.796711 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-759987-4-iscsi {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:18:57.796852 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:18:57.797079 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:18:57.797220 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:18:57.797424 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:18:57.797573 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:18:57.797774 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:18:57.797921 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:18:57.798134 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:18:57.798275 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:18:57.798477 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:18:57.798617 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:18:57.798811 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:18:57.798959 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:18:57.799187 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:18:57.799331 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:18:57.799543 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:18:57.799802 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:18:57.799959 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:18:57.800150 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:18:57.800297 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:18:57.800494 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:18:57.800636 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:18:57.800843 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:18:57.800989 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:18:57.801857 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:18:57.802006 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:18:57.802247 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:18:57.802589 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:18:57.802693 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:18:57.802935 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:18:57.803094 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:18:57.803217 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:18:57.803379 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:18:57.803542 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:18:57.803733 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:18:57.803894 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:18:57.804104 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:18:57.804261 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:18:57.804457 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:18:57.804606 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:18:57.804825 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-759987-4-iscsi {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:18:57.804980 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:18:57.805130 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:18:57.805278 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:18:57.805418 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:18:57.805567 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:18:57.805773 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:18:57.805934 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:18:57.806127 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:18:57.806283 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:18:57.806468 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:18:57.806623 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:18:57.806809 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:18:57.806959 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:18:57.807141 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:18:57.807291 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:18:57.807488 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:18:57.807637 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:18:57.807827 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:18:57.807984 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:18:57.808134 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:18:57.808274 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:18:57.808479 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:18:57.808634 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:18:57.808838 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:18:57.808989 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:18:57.809193 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:18:57.809349 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:18:57.809555 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:18:57.809703 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:18:57.809896 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:18:57.810055 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:18:57.810246 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:18:57.810400 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:18:57.810613 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:18:57.810762 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.78 {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:18:57.810943 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.78 {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:18:57.811113 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:18:57.811306 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:18:57.811462 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:18:57.811674 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:18:57.811816 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:18:57.811975 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:18:57.812123 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:18:57.812263 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:18:57.812412 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:18:57.812564 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:18:57.812713 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:18:57.812927 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:18:57.813084 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:18:57.813224 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:18:57.813373 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:18:57.813513 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:18:57.813655 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:18:57.813794 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:18:57.813933 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:18:57.814151 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:18:57.814317 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:18:57.814504 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:18:57.814652 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:18:57.814851 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:18:57.815000 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:18:57.815179 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:18:57.815323 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:18:57.815479 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:18:57.815620 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:18:57.815768 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:18:57.815909 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:18:57.816120 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:18:57.816287 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:18:57.816429 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:18:57.816569 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:18:57.816850 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:18:57.816999 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:18:57.817288 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:18:57.817614 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:18:57.817769 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:18:57.817977 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:18:57.818132 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:18:57.818311 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:18:57.818477 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:18:57.818624 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:18:57.818783 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:18:57.818967 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:18:57.819152 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:18:57.819336 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:18:57.819500 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.78 {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:18:57.819642 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:18:57.819788 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.78 {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:18:57.819987 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:18:57.820142 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:18:57.820328 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:18:57.820478 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:18:57.820665 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:18:57.820823 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:18:57.821026 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:18:57.821175 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:18:57.821384 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:18:57.821534 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:18:57.821719 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:18:57.821868 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:18:57.822059 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:18:57.822208 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:18:57.822363 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:18:57.822505 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:18:57.822712 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:18:57.822860 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:18:57.823079 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:18:57.823241 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:18:57.823394 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:18:57.823535 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:18:57.823735 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:18:57.823884 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:18:57.824024 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:18:57.824172 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:18:57.824313 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:18:57.824453 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:18:57.824638 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:18:57.824788 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:18:57.825003 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:18:57.825163 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:18:57.825314 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:18:57.825455 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:18:57.825661 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:18:57.825810 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:18:57.826005 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:18:57.826161 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:18:57.826302 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:18:57.826442 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:18:57.826639 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:18:57.826788 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:18:57.826978 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:18:57.827161 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:18:57.827348 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:18:57.827514 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:18:57.827656 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:18:57.827797 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:18:57.827986 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:18:57.828146 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:18:57.828288 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:18:57.828428 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:18:57.828628 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:18:57.828782 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:18:57.828939 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:18:57.829081 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:18:57.829270 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:18:57.829428 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:18:57.829578 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:18:57.829725 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:18:57.829875 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:18:57.830022 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:18:57.830232 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:18:57.830380 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:18:57.830585 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:18:57.830732 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:18:57.830919 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:18:57.831119 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:18:57.831276 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:18:57.831426 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:18:57.831611 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:18:57.831769 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:18:57.831918 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:18:57.832060 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:18:57.832259 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:18:57.832428 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.832903 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.833126 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:18:57.833283 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.833426 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:18:57.833609 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.833759 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:18:57.833986 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.834154 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:18:57.834359 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.834514 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:18:57.834697 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:18:57.834845 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.835066 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.835235 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:18:57.835383 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:18:57.835536 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.835716 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:18:57.835872 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.836068 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.836237 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:18:57.836387 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:18:57.836528 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.836723 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:18:57.836878 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.837066 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:18:57.837269 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.837414 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:18:57.837554 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.837694 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:18:57.837840 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.838029 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:18:57.838178 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.838370 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:18:57.838534 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.838676 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:18:57.838822 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.839015 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:18:57.839225 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.839368 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.839508 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:18:57.839729 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.839878 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:18:57.840035 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:18:57.840176 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.840382 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:18:57.840540 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.840690 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:18:57.840836 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.841057 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:18:57.841213 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.841433 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.841583 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.841791 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.841955 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.842139 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.842288 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.842501 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.842656 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.842850 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.843192 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.843355 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.843499 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.843639 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.843786 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.843927 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.844067 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.844213 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.844359 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.844505 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.844657 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.844857 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.845026 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.845208 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.845362 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.845549 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.845707 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.845885 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.846033 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.846228 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.846376 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.846568 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.846726 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.846912 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.847084 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.847278 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.847428 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.847629 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.847779 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.848464 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.848645 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.849055 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.849297 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.849667 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.849834 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.849978 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.850119 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.850326 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.850486 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.850673 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.850830 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.851018 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.851206 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.851392 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.851542 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.851739 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.851890 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.852079 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.852236 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.852439 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.852604 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.852745 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.852885 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.853094 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.853250 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.853455 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.853604 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.853788 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.853937 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.854128 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.854285 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.854473 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.854628 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.854777 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.854918 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.855150 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.855308 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.855450 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.855595 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.855812 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.855968 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.856160 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.856310 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.856496 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.856652 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.856851 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.857015 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.857165 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.857306 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.857523 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.857671 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.857886 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.858035 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.858235 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.858384 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.858583 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.858739 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.858923 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.859119 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.859293 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.859435 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.859588 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.859739 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.859919 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.860076 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.860262 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.860411 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.860595 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.860744 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.860932 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.861092 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.861240 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.861390 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.861572 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.861721 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.861911 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.862068 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.862248 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.862406 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.862554 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.862695 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.862897 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.863091 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.863240 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.863389 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.863583 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.863783 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.864110 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.864493 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.864650 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.864798 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.864950 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.865177 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.865343 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.865530 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.865685 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.865874 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.866045 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.866192 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.866403 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.866553 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.866699 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.866844 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = None {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.866989 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.867183 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = None {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.867343 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.867490 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.867683 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.867838 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.868044 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.868207 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.868363 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.868510 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.868711 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.868866 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.869056 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.869211 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.869369 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.869517 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_vgpu_types = [] {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.869720 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.870126 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.870321 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.870486 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.870642 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.870790 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.870982 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.871226 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.871377 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.871530 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.871677 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.871825 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.871971 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.872116 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.872308 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.872471 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.872624 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.872780 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.872965 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.873120 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.873311 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.873477 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.873630 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.873776 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.873973 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.874134 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.874289 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.874443 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.874638 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.874793 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.874985 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.875188 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.875346 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.875492 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.875637 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.875784 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.875983 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.876146 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.876301 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = None {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.876447 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.876649 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = None {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.876804 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.877003 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.877167 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.877365 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.877522 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.877669 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.877822 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.878020 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.878177 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.878335 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.878483 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.878678 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.878834 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.879017 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.879730 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_vgpu_types = [] {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.880088 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.880465 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.880620 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.880837 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.880992 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.881200 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.881411 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.881572 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.881721 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.881905 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.882072 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.882230 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.882396 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.882581 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.882743 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.882890 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.883120 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.883286 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.883435 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.883581 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.883727 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.883927 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.884083 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.884237 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.884386 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.884551 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.884699 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.884903 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.885065 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.885250 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.885405 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.885595 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.885749 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.885936 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.886102 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.886250 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.886404 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.886597 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.886761 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.886908 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.887091 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.887282 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.887437 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.887591 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.887737 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.887942 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.888105 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.888294 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.888449 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.888641 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.888979 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.889158 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.889314 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.889468 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.889654 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.889815 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.890001 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.890164 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.890348 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.890502 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.890697 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.890853 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.891081 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.891260 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.891409 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.891564 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.891763 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.891918 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.892064 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.892219 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.892419 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.892574 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.892763 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.892918 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.893105 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.893269 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.893428 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.893573 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.893769 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.893925 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.894079 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.894226 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.894425 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.894580 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.894768 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.894988 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.895323 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.895481 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.895672 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.895837 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.895985 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.896137 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.896330 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.896491 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.896680 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.896848 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.896997 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.897142 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.897343 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.897505 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.897652 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.897798 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.898006 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.898173 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.898321 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.898473 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.898657 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.898999 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.899232 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.899450 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.899598 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.899751 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.899897 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.900043 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.900188 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.900390 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.900546 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.900745 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.900900 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.901125 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.901281 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.901472 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.901626 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.901813 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.901969 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.902153 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.902322 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.902479 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.902625 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.902771 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.902924 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.903150 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.903319 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.903474 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.903627 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.903812 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.903966 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.904118 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.904272 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.904474 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.904638 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.904784 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.904929 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.905119 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.905282 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.905430 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.905576 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.905769 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.905930 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.906084 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.906238 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.906424 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.906579 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.906734 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.906879 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.907106 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.907264 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.907456 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.907610 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.907802 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.907957 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.908111 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.908264 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.908456 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.908611 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.908796 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.908959 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.909113 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.909261 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.909451 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.909606 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.909792 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.909946 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.910101 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.910248 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.910445 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.911189 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.912003 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.912361 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.912713 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.913089 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.913244 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.913440 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.913594 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.913756 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.913906 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.914113 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.914463 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.914618 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.914809 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.914971 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.915190 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.915452 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.915608 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.915844 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.916190 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.916540 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.916759 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.916922 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.917141 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.917295 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.917508 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.917671 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.917856 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.918012 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.918169 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.918316 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.918522 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.918677 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.918871 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.919028 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.919278 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.919433 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.919637 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.919792 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.919982 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.920138 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.920328 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.920498 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.920652 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.920798 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.920993 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.921149 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.921336 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.921490 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.921686 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.921841 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.922053 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.922217 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.922403 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.922573 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.922727 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.922875 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.923138 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.923298 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.923456 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.923714 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.923870 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.924065 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.924227 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.924381 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.924535 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.924735 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.924899 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.925052 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.925201 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.925402 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.925556 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.925747 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.925907 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.926092 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.926812 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.927360 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.927631 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.927802 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.928019 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.928184 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.928380 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.928535 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.928724 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.928886 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.929070 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.929224 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.929382 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.929530 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.929736 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.929897 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.930073 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.930220 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.930375 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.930522 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.930732 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.930886 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.931079 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.931245 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.931430 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.931587 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.931782 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.931936 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.932128 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.932307 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.932456 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.932612 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.932766 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.932912 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.933111 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.933265 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.933459 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.933614 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.933772 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.933918 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.934110 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.934264 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.934430 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.934641 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.934808 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.934954 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.935143 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.935291 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.935437 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.935597 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.935845 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.936007 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.936192 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.936353 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.936537 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.936707 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.936855 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.937010 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.937232 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.937393 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.937539 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.937693 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.937844 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.937991 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.938185 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.938340 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.938493 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.938640 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.938862 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.939027 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.939232 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.939379 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.939535 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.939681 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.939885 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.940046 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.940234 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.940389 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.940583 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.940737 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.940923 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.941084 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.941285 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.941440 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.941595 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.941782 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.942124 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.942436 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.942598 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.942798 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.942952 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.943176 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.943333 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.943480 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.943626 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.943827 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.943988 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.944264 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.944425 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.944610 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.944764 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.944972 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.945128 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.945319 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.945474 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.945673 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.945827 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.946025 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.946188 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.946384 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.946545 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.946739 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.946904 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.947123 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.947247 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.947430 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.947574 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.947777 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.947896 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.948147 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.948249 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.948515 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.948623 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.948866 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.948976 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.949208 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.949309 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.949544 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.949644 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.949907 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.950019 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.950253 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.950352 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.950598 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.950710 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.950943 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.951090 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.951337 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.951438 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.951682 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.951781 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.952051 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.952151 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.952433 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.952532 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.952804 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.952977 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.953133 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.953281 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.953465 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.953621 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.953810 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.953965 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.954120 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.954271 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.954465 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.954621 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.954832 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.954993 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.955222 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.955371 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.955517 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.955668 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.955815 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.955967 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.956121 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.956267 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.956463 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.956624 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.956811 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.956977 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.957176 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.957338 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.957585 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.957878 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.958179 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.958342 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.958532 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.958693 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.958905 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.959087 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.959277 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.959443 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.959597 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.959743 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.959963 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.960118 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.960305 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.960471 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.960625 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.960868 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.961029 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.961182 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.961336 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.961483 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.961634 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.961781 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.961941 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.962089 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.962310 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.962471 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.962683 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.962838 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.963060 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.963219 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.963377 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.963523 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.963741 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.963903 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.964088 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.964251 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.964412 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.964559 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.964755 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.964909 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.965104 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.965266 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.965413 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.965558 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.965757 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.965912 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.966101 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.966264 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.966420 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.966571 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.966764 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.966919 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.967133 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.967360 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.967516 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.967664 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.967809 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.968008 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.968157 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.968313 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.968465 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.968622 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.968768 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.968912 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.969057 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.969210 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.969402 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.969556 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.969746 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.969900 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.970095 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.970271 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.970430 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.970576 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.970798 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.971072 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.971228 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.971395 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.971554 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.971701 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.971854 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.972001 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.972190 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.972346 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.972555 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.972710 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.972867 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.973532 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.973926 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.974285 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.974447 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.974642 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.974797 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.974985 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.975185 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.975371 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.975521 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.975706 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.975861 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.976018 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.976165 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.976362 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.976517 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.976703 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.976858 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.977016 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.977170 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.977360 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.977515 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.977710 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.977865 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.978055 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.978312 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.978468 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.978678 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.978840 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.979066 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.driver = filter_scheduler {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.979225 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.979426 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.979582 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.979730 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.979876 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.980081 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.980244 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.980427 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.980592 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.980739 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.980886 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.981121 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.periodic_task_interval = 60 {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.981290 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.981439 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.981671 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.981822 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = False {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.981976 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.982127 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.982291 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.982439 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.982595 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.982741 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.982888 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.983067 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.983222 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.983445 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.983601 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.983799 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.983954 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.984154 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.984316 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.984507 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.984662 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.984857 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.985012 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.985215 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.985370 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.985570 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.985725 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.985909 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.986071 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.986227 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.986374 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.986580 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.986735 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.986935 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.987142 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.987335 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.987572 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.987727 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.987945 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.988100 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.988326 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.driver = filter_scheduler {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.988482 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.988746 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.988962 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.989165 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.989390 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.989589 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.989752 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.989947 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.990102 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.990311 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.990475 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.990668 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.990823 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.991024 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.periodic_task_interval = 60 {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.991354 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.991518 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.991675 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.991832 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = False {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.991986 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.992134 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.992337 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.992494 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.992689 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.992852 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.993064 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.993219 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.993431 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.993599 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.993786 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.993950 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.994133 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.994288 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.994483 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.994647 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.995084 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = None {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.995241 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.995389 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.995537 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.995730 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.995897 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.996051 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.996207 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.996399 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.996555 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.996710 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.996858 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.997059 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = False {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.997214 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.997405 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.997566 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.997722 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.997874 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.998073 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.998228 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.998419 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.998574 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.998808 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.999060 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.999220 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.999455 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.999611 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.999812 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:57.999968 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.000182 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.000338 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.000551 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.000707 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.000871 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.001020 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.001227 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.001479 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.001633 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.001780 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.001936 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.002083 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.002229 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.002472 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.002629 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.002826 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.003001 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.003247 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.003402 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.003560 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.003713 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.003871 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.004020 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.004165 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.004826 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.005475 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.005631 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.005837 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = None {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.005999 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.006155 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.006302 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.006507 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.006663 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.006858 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.007019 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.007211 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.007358 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.007551 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.007709 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.007866 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.008019 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = False {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.008215 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.008383 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.008531 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.008676 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.008875 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.009030 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.009184 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.009330 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.009539 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.009802 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.009958 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.010204 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.010359 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.010546 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.010712 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.010866 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.011013 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.011242 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.011398 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.011634 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.011789 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.011957 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.012105 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.012252 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.012399 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.012544 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.012690 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.012858 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.013006 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.013199 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.013362 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.013547 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.013709 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.013909 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.014064 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.014397 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.014553 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.014703 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.014858 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.014858 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.015242 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.015393 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.015541 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.015687 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.015841 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.015989 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.016217 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.016373 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.016565 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.016720 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.016912 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.017067 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.017261 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.017437 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.017586 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.017732 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.018055 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.018210 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.018210 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.018491 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.018650 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.018806 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.018953 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.019146 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.019304 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.019469 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.019639 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.019800 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.020003 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.020154 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.020398 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.020714 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.020869 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.021064 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.021221 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.021407 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.021534 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.021743 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.021849 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.022085 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.022250 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.022458 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.022619 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.022806 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.022970 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.023160 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.023310 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.023518 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.023686 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.023837 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.023991 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.024547 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.025322 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.025322 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.026174 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.026174 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.028238 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.028525 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.029820 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.031717 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.032120 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.032344 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.032671 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.032671 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.033039 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.033323 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.033508 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.033717 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.033717 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.034019 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.034175 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.034332 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.034488 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.034646 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.034794 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.034947 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.035138 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.035296 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.035459 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.036141 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.036296 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.036446 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.036601 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.036754 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.036906 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.037064 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.037228 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.037382 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.037546 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.037700 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.037860 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.038014 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.038167 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.038318 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.038471 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.038624 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.038785 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.038939 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.039169 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.039330 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.039478 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.039648 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.039807 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.039964 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.040112 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.040258 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.040258 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.040555 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.040772 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.040930 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.041078 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.041229 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.041377 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.041534 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.041699 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.041855 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.042016 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.042263 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.042423 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.042581 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.042732 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.042879 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.043079 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.043245 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.043403 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.043559 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.043722 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.043722 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.044018 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.044171 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.044330 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.044489 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] database.use_db_reconnect = False {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.044643 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.044796 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] database.use_tpool = False {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.044944 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.045096 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.045254 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.045408 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.045561 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.045726 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.045884 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.046038 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.046196 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.046350 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.046502 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.046655 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.046810 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.046959 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.047157 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.047275 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.047385 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.047493 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.047604 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.047711 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.047820 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.047920 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.048026 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.048133 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.048236 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.048342 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.048444 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.048444 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.048444 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.048444 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.048804 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.048909 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.049008 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.049110 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.049206 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.049301 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.049409 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.049513 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.049616 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.049718 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.049821 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.049917 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.050012 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.050118 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.050220 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.050317 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.050417 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.050535 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.050642 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.050744 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.050845 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.050946 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.051072 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.051217 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] database.use_db_reconnect = False {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.051342 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.051448 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] database.use_tpool = False {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.051546 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.051647 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.052500 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.052650 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.052814 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.052919 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.053179 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.053289 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.053529 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.053631 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.053893 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.053997 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.054238 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.054342 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.054610 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.054722 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.054972 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.055094 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.055357 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.055502 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.055709 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.055827 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.056087 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.056196 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.056440 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.056550 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.056714 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=83315) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2591}} Feb 17 04:18:58.056828 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.057971 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.058338 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.058702 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.059077 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.059471 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.059852 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.060205 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.060582 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.060949 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.061313 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.061675 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.062033 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.062410 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.062767 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.063171 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.063531 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.063885 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.064247 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.064606 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.064976 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.065349 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.065724 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.066098 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.066497 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.067152 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.067882 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.068268 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:18:58.068554 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=83314) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2591}} Feb 17 04:18:58.175664 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG oslo_db.sqlalchemy.engines [None req-2a12bbab-b7ee-4a24-a49f-7e1e94528a00 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=83315) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Feb 17 04:18:58.188950 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG oslo_db.sqlalchemy.engines [None req-44b88e59-0072-4383-b73e-27283dc0e070 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=83314) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Feb 17 04:18:58.439250 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.context [None req-2a12bbab-b7ee-4a24-a49f-7e1e94528a00 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),2ad0e24a-b803-4b80-a765-57fb829d8448(cell1) {{(pid=83315) load_cells /opt/stack/nova/nova/context.py:466}} Feb 17 04:18:58.444719 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG oslo_concurrency.lockutils [None req-2a12bbab-b7ee-4a24-a49f-7e1e94528a00 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=83315) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:18:58.446565 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG oslo_concurrency.lockutils [None req-2a12bbab-b7ee-4a24-a49f-7e1e94528a00 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=83315) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:18:58.447487 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG oslo_concurrency.lockutils [None req-2a12bbab-b7ee-4a24-a49f-7e1e94528a00 None None] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=83315) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:18:58.449617 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG oslo_concurrency.lockutils [None req-2a12bbab-b7ee-4a24-a49f-7e1e94528a00 None None] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=83315) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:18:58.450779 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.context [None req-44b88e59-0072-4383-b73e-27283dc0e070 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),2ad0e24a-b803-4b80-a765-57fb829d8448(cell1) {{(pid=83314) load_cells /opt/stack/nova/nova/context.py:466}} Feb 17 04:18:58.456251 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG oslo_concurrency.lockutils [None req-44b88e59-0072-4383-b73e-27283dc0e070 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=83314) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:18:58.458661 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG oslo_concurrency.lockutils [None req-44b88e59-0072-4383-b73e-27283dc0e070 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=83314) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:18:58.459585 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG oslo_concurrency.lockutils [None req-44b88e59-0072-4383-b73e-27283dc0e070 None None] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=83314) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:18:58.461724 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG oslo_concurrency.lockutils [None req-44b88e59-0072-4383-b73e-27283dc0e070 None None] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=83314) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:18:58.474944 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG oslo_db.sqlalchemy.engines [None req-2a12bbab-b7ee-4a24-a49f-7e1e94528a00 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=83315) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Feb 17 04:18:58.475883 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG oslo_db.sqlalchemy.engines [None req-2a12bbab-b7ee-4a24-a49f-7e1e94528a00 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=83315) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Feb 17 04:18:58.490334 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG oslo_db.sqlalchemy.engines [None req-44b88e59-0072-4383-b73e-27283dc0e070 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=83314) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Feb 17 04:18:58.491263 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG oslo_db.sqlalchemy.engines [None req-44b88e59-0072-4383-b73e-27283dc0e070 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=83314) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Feb 17 04:18:58.509369 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG oslo_db.sqlalchemy.engines [None req-2a12bbab-b7ee-4a24-a49f-7e1e94528a00 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=83315) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Feb 17 04:18:58.523995 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG oslo_db.sqlalchemy.engines [None req-44b88e59-0072-4383-b73e-27283dc0e070 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=83314) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Feb 17 04:18:58.609834 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 17 04:18:58.609834 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: from cryptography.utils import int_from_bytes Feb 17 04:18:58.610161 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 17 04:18:58.610161 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: from cryptography.utils import int_from_bytes Feb 17 04:18:58.610309 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 17 04:18:58.610309 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: from cryptography.utils import int_from_bytes Feb 17 04:18:58.610441 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 17 04:18:58.610441 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: from cryptography.utils import int_from_bytes Feb 17 04:18:58.686360 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: INFO keyring.backend [None req-44b88e59-0072-4383-b73e-27283dc0e070 None None] Loading Gnome Feb 17 04:18:58.687639 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: INFO keyring.backend [None req-2a12bbab-b7ee-4a24-a49f-7e1e94528a00 None None] Loading Gnome Feb 17 04:18:58.707991 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: INFO keyring.backend [None req-44b88e59-0072-4383-b73e-27283dc0e070 None None] Loading Google Feb 17 04:18:58.708449 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: INFO keyring.backend [None req-2a12bbab-b7ee-4a24-a49f-7e1e94528a00 None None] Loading Google Feb 17 04:18:58.711330 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: INFO keyring.backend [None req-44b88e59-0072-4383-b73e-27283dc0e070 None None] Loading Windows (alt) Feb 17 04:18:58.711770 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: INFO keyring.backend [None req-2a12bbab-b7ee-4a24-a49f-7e1e94528a00 None None] Loading Windows (alt) Feb 17 04:18:58.715848 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: INFO keyring.backend [None req-44b88e59-0072-4383-b73e-27283dc0e070 None None] Loading file Feb 17 04:18:58.716459 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: INFO keyring.backend [None req-2a12bbab-b7ee-4a24-a49f-7e1e94528a00 None None] Loading file Feb 17 04:18:58.717078 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: INFO keyring.backend [None req-44b88e59-0072-4383-b73e-27283dc0e070 None None] Loading keyczar Feb 17 04:18:58.717538 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: INFO keyring.backend [None req-44b88e59-0072-4383-b73e-27283dc0e070 None None] Loading multi Feb 17 04:18:58.717650 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: INFO keyring.backend [None req-2a12bbab-b7ee-4a24-a49f-7e1e94528a00 None None] Loading keyczar Feb 17 04:18:58.717981 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: INFO keyring.backend [None req-2a12bbab-b7ee-4a24-a49f-7e1e94528a00 None None] Loading multi Feb 17 04:18:58.718405 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: INFO keyring.backend [None req-44b88e59-0072-4383-b73e-27283dc0e070 None None] Loading pyfs Feb 17 04:18:58.718870 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: INFO keyring.backend [None req-2a12bbab-b7ee-4a24-a49f-7e1e94528a00 None None] Loading pyfs Feb 17 04:18:59.003025 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: WARNING keystonemiddleware.auth_token [None req-44b88e59-0072-4383-b73e-27283dc0e070 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Feb 17 04:18:59.004379 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: WARNING keystonemiddleware.auth_token [None req-2a12bbab-b7ee-4a24-a49f-7e1e94528a00 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Feb 17 04:18:59.010758 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: WARNING keystonemiddleware.auth_token [None req-44b88e59-0072-4383-b73e-27283dc0e070 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Feb 17 04:18:59.012710 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: WARNING keystonemiddleware.auth_token [None req-2a12bbab-b7ee-4a24-a49f-7e1e94528a00 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Feb 17 04:18:59.349316 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: WARNING keystonemiddleware.auth_token [None req-44b88e59-0072-4383-b73e-27283dc0e070 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Feb 17 04:18:59.349504 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: WARNING keystonemiddleware.auth_token [None req-2a12bbab-b7ee-4a24-a49f-7e1e94528a00 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Feb 17 04:18:59.355061 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: WARNING keystonemiddleware.auth_token [None req-44b88e59-0072-4383-b73e-27283dc0e070 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Feb 17 04:18:59.355181 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: WARNING keystonemiddleware.auth_token [None req-2a12bbab-b7ee-4a24-a49f-7e1e94528a00 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Feb 17 04:18:59.360448 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55b2453fa9c0 pid: 83314 (default app) Feb 17 04:18:59.360580 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55b2453fa9c0 pid: 83315 (default app) Feb 17 04:18:59.362780 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi [None req-2a12bbab-b7ee-4a24-a49f-7e1e94528a00 None None] Calling method '>' {{(pid=83315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:18:59.364156 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: INFO nova.api.openstack.requestlog [None req-2a12bbab-b7ee-4a24-a49f-7e1e94528a00 None None] 10.222.0.78 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001865 Feb 17 04:18:59.364593 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: [pid: 83315|app: 0|req: 1/1] 10.222.0.78 () {50 vars in 779 bytes} [Wed Feb 17 04:18:59 2021] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:20:25.502722 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi [None req-3e653dc3-c3f1-4397-91fa-2c1db314afd3 admin admin] Calling method '>' {{(pid=83314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:20:25.527732 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: INFO nova.api.openstack.requestlog [None req-3e653dc3-c3f1-4397-91fa-2c1db314afd3 admin admin] 10.222.0.78 "GET /compute/v2.1/flavors/detail" status: 200 len: 15 microversion: 2.1 time: 0.505077 Feb 17 04:20:25.528340 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: [pid: 83314|app: 0|req: 1/2] 10.222.0.78 () {58 vars in 1150 bytes} [Wed Feb 17 04:20:25 2021] GET /compute/v2.1/flavors/detail => generated 15 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 17 04:20:28.446754 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi [None req-b2e97be1-ccdd-42a8-8a99-63d8d3fdf41a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "cirros256", "ram": 256, "vcpus": 1, "disk": 1, "id": "c1", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=83315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:20:28.473272 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:20:28.473272 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: warnings.warn(msg) Feb 17 04:20:28.500746 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: INFO nova.api.openstack.requestlog [None req-b2e97be1-ccdd-42a8-8a99-63d8d3fdf41a admin admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 367 microversion: 2.1 time: 0.411799 Feb 17 04:20:28.501296 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: [pid: 83315|app: 0|req: 2/3] 10.222.0.78 () {62 vars in 1183 bytes} [Wed Feb 17 04:20:28 2021] POST /compute/v2.1/flavors => generated 367 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:20:28.513599 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi [None req-dd4c8532-e334-4e22-bf77-0d800c8d96ad admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=83314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:20:28.515852 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:20:28.515852 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: warnings.warn(msg) Feb 17 04:20:28.553731 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: INFO nova.api.openstack.requestlog [None req-dd4c8532-e334-4e22-bf77-0d800c8d96ad admin admin] 10.222.0.78 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.044261 Feb 17 04:20:28.554338 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: [pid: 83314|app: 0|req: 2/4] 10.222.0.78 () {62 vars in 1236 bytes} [Wed Feb 17 04:20:28 2021] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 17 04:20:28.564883 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi [None req-4f7efbef-19dc-4617-89fe-55108e750b6a admin admin] Calling method '>' {{(pid=83315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:20:28.588072 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: INFO nova.api.openstack.requestlog [None req-4f7efbef-19dc-4617-89fe-55108e750b6a admin admin] 10.222.0.78 "GET /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.027280 Feb 17 04:20:28.588666 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: [pid: 83315|app: 0|req: 3/5] 10.222.0.78 () {58 vars in 1183 bytes} [Wed Feb 17 04:20:28 2021] GET /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 17 04:20:31.186777 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi [None req-9d4979a4-e32f-459a-9255-fc8261e638b8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds512M", "ram": 512, "vcpus": 1, "disk": 5, "id": "d1", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=83314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:20:31.210491 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:20:31.210491 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: warnings.warn(msg) Feb 17 04:20:31.232436 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: INFO nova.api.openstack.requestlog [None req-9d4979a4-e32f-459a-9255-fc8261e638b8 admin admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 364 microversion: 2.1 time: 0.101217 Feb 17 04:20:31.233023 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: [pid: 83314|app: 0|req: 3/6] 10.222.0.78 () {62 vars in 1183 bytes} [Wed Feb 17 04:20:31 2021] POST /compute/v2.1/flavors => generated 364 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:20:31.244751 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi [None req-c12651b0-0cb1-4d44-b35b-3dada64d003f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=83315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:20:31.246335 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:20:31.246335 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: warnings.warn(msg) Feb 17 04:20:31.282142 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: INFO nova.api.openstack.requestlog [None req-c12651b0-0cb1-4d44-b35b-3dada64d003f admin admin] 10.222.0.78 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.041483 Feb 17 04:20:31.282687 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: [pid: 83315|app: 0|req: 4/7] 10.222.0.78 () {62 vars in 1236 bytes} [Wed Feb 17 04:20:31 2021] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 17 04:20:31.292676 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi [None req-e6375a9d-1a07-4d84-9c1d-973b229f787c admin admin] Calling method '>' {{(pid=83314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:20:31.308845 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: INFO nova.api.openstack.requestlog [None req-e6375a9d-1a07-4d84-9c1d-973b229f787c admin admin] 10.222.0.78 "GET /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.019855 Feb 17 04:20:31.309423 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: [pid: 83314|app: 0|req: 4/8] 10.222.0.78 () {58 vars in 1183 bytes} [Wed Feb 17 04:20:31 2021] GET /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 17 04:20:33.901705 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi [None req-0b82a69b-b495-45e2-aaea-0076f13192d4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds1G", "ram": 1024, "vcpus": 1, "disk": 10, "id": "d2", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=83315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:20:33.924040 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: INFO nova.api.openstack.requestlog [None req-0b82a69b-b495-45e2-aaea-0076f13192d4 admin admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 364 microversion: 2.1 time: 0.077515 Feb 17 04:20:33.924586 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: [pid: 83315|app: 0|req: 5/9] 10.222.0.78 () {62 vars in 1183 bytes} [Wed Feb 17 04:20:33 2021] POST /compute/v2.1/flavors => generated 364 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:20:33.935492 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi [None req-9251d9ce-f61b-42af-a117-24d9336973c8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=83314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:20:33.971369 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: INFO nova.api.openstack.requestlog [None req-9251d9ce-f61b-42af-a117-24d9336973c8 admin admin] 10.222.0.78 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.039765 Feb 17 04:20:33.972003 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: [pid: 83314|app: 0|req: 5/10] 10.222.0.78 () {62 vars in 1236 bytes} [Wed Feb 17 04:20:33 2021] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 17 04:20:33.982026 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi [None req-409c0990-0491-4b12-9766-abfd6f4066af admin admin] Calling method '>' {{(pid=83315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:20:33.997475 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: INFO nova.api.openstack.requestlog [None req-409c0990-0491-4b12-9766-abfd6f4066af admin admin] 10.222.0.78 "GET /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.019264 Feb 17 04:20:33.998050 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: [pid: 83315|app: 0|req: 6/11] 10.222.0.78 () {58 vars in 1183 bytes} [Wed Feb 17 04:20:33 2021] GET /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 17 04:20:36.674859 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi [None req-70b04c27-1c18-449b-8881-4bed5b4acf3f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds2G", "ram": 2048, "vcpus": 2, "disk": 10, "id": "d3", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=83314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:20:36.696653 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: INFO nova.api.openstack.requestlog [None req-70b04c27-1c18-449b-8881-4bed5b4acf3f admin admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 364 microversion: 2.1 time: 0.075095 Feb 17 04:20:36.697235 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: [pid: 83314|app: 0|req: 6/12] 10.222.0.78 () {62 vars in 1183 bytes} [Wed Feb 17 04:20:36 2021] POST /compute/v2.1/flavors => generated 364 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:20:36.708021 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi [None req-a7d39dca-b323-4c66-ab51-3f0d60bb7739 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=83315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:20:36.743709 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: INFO nova.api.openstack.requestlog [None req-a7d39dca-b323-4c66-ab51-3f0d60bb7739 admin admin] 10.222.0.78 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.039542 Feb 17 04:20:36.744503 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: [pid: 83315|app: 0|req: 7/13] 10.222.0.78 () {62 vars in 1236 bytes} [Wed Feb 17 04:20:36 2021] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Feb 17 04:20:36.754516 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi [None req-22529211-44cd-4dc6-93d0-3d19fbaf4ae9 admin admin] Calling method '>' {{(pid=83314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:20:36.771414 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: INFO nova.api.openstack.requestlog [None req-22529211-44cd-4dc6-93d0-3d19fbaf4ae9 admin admin] 10.222.0.78 "GET /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.020925 Feb 17 04:20:36.771983 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: [pid: 83314|app: 0|req: 7/14] 10.222.0.78 () {58 vars in 1183 bytes} [Wed Feb 17 04:20:36 2021] GET /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 17 04:20:39.418770 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi [None req-63eceb41-5842-4f87-92b5-5715e29f2d58 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds4G", "ram": 4096, "vcpus": 4, "disk": 20, "id": "d4", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=83315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:20:39.442160 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: INFO nova.api.openstack.requestlog [None req-63eceb41-5842-4f87-92b5-5715e29f2d58 admin admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 364 microversion: 2.1 time: 0.078158 Feb 17 04:20:39.442701 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: [pid: 83315|app: 0|req: 8/15] 10.222.0.78 () {62 vars in 1183 bytes} [Wed Feb 17 04:20:39 2021] POST /compute/v2.1/flavors => generated 364 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:20:39.453477 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi [None req-02580c6c-7c31-4668-8438-144d66d06032 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=83314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:20:39.489580 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: INFO nova.api.openstack.requestlog [None req-02580c6c-7c31-4668-8438-144d66d06032 admin admin] 10.222.0.78 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.039913 Feb 17 04:20:39.490188 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: [pid: 83314|app: 0|req: 8/16] 10.222.0.78 () {62 vars in 1236 bytes} [Wed Feb 17 04:20:39 2021] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 17 04:20:39.500477 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi [None req-810e2060-04ce-4d4d-ac5a-b828ade7fddd admin admin] Calling method '>' {{(pid=83315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:20:39.516104 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: INFO nova.api.openstack.requestlog [None req-810e2060-04ce-4d4d-ac5a-b828ade7fddd admin admin] 10.222.0.78 "GET /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.019469 Feb 17 04:20:39.516671 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: [pid: 83315|app: 0|req: 9/17] 10.222.0.78 () {58 vars in 1183 bytes} [Wed Feb 17 04:20:39 2021] GET /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 17 04:20:42.094122 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi [None req-2ac52657-378e-42b7-a08d-35a2014e68f5 admin admin] Calling method '>' {{(pid=83314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:20:42.115258 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: INFO nova.api.openstack.requestlog [None req-2ac52657-378e-42b7-a08d-35a2014e68f5 admin admin] 10.222.0.78 "GET /compute/v2.1/flavors/detail" status: 200 len: 1786 microversion: 2.1 time: 0.074639 Feb 17 04:20:42.115827 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: [pid: 83314|app: 0|req: 9/18] 10.222.0.78 () {58 vars in 1150 bytes} [Wed Feb 17 04:20:42 2021] GET /compute/v2.1/flavors/detail => generated 1786 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:20:44.709489 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi [None req-3fc2b788-5094-4707-b25a-c0555df6b2b6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.tiny", "ram": 512, "vcpus": 1, "disk": 1, "id": "1", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=83315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:20:44.731498 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: INFO nova.api.openstack.requestlog [None req-3fc2b788-5094-4707-b25a-c0555df6b2b6 admin admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 362 microversion: 2.1 time: 0.077171 Feb 17 04:20:44.732090 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: [pid: 83315|app: 0|req: 10/19] 10.222.0.78 () {62 vars in 1183 bytes} [Wed Feb 17 04:20:44 2021] POST /compute/v2.1/flavors => generated 362 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:20:44.743505 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi [None req-f4acbf92-8e57-4496-a078-1ba7764ffebc admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=83314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:20:44.778266 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: INFO nova.api.openstack.requestlog [None req-f4acbf92-8e57-4496-a078-1ba7764ffebc admin admin] 10.222.0.78 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.038563 Feb 17 04:20:44.778800 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: [pid: 83314|app: 0|req: 10/20] 10.222.0.78 () {62 vars in 1233 bytes} [Wed Feb 17 04:20:44 2021] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Feb 17 04:20:44.789322 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi [None req-ea231f37-2a4b-4069-a538-7eb6d1e8b0e2 admin admin] Calling method '>' {{(pid=83315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:20:44.805219 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: INFO nova.api.openstack.requestlog [None req-ea231f37-2a4b-4069-a538-7eb6d1e8b0e2 admin admin] 10.222.0.78 "GET /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.019744 Feb 17 04:20:44.805789 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: [pid: 83315|app: 0|req: 11/21] 10.222.0.78 () {58 vars in 1180 bytes} [Wed Feb 17 04:20:44 2021] GET /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 17 04:20:47.435491 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi [None req-e274ded0-cc91-42fb-9fb6-cb9224356ed3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.small", "ram": 2048, "vcpus": 1, "disk": 20, "id": "2", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=83314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:20:47.458051 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: INFO nova.api.openstack.requestlog [None req-e274ded0-cc91-42fb-9fb6-cb9224356ed3 admin admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 365 microversion: 2.1 time: 0.076056 Feb 17 04:20:47.458653 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: [pid: 83314|app: 0|req: 11/22] 10.222.0.78 () {62 vars in 1183 bytes} [Wed Feb 17 04:20:47 2021] POST /compute/v2.1/flavors => generated 365 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:20:47.469450 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi [None req-2799e37e-4710-4bf9-bf33-b067a974dbd5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=83315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:20:47.504802 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: INFO nova.api.openstack.requestlog [None req-2799e37e-4710-4bf9-bf33-b067a974dbd5 admin admin] 10.222.0.78 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.039230 Feb 17 04:20:47.505391 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: [pid: 83315|app: 0|req: 12/23] 10.222.0.78 () {62 vars in 1233 bytes} [Wed Feb 17 04:20:47 2021] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 17 04:20:47.515252 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi [None req-42797983-1cf0-4380-83ba-d446d203a0d4 admin admin] Calling method '>' {{(pid=83314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:20:47.530921 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: INFO nova.api.openstack.requestlog [None req-42797983-1cf0-4380-83ba-d446d203a0d4 admin admin] 10.222.0.78 "GET /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.019577 Feb 17 04:20:47.531518 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: [pid: 83314|app: 0|req: 12/24] 10.222.0.78 () {58 vars in 1180 bytes} [Wed Feb 17 04:20:47 2021] GET /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 17 04:20:50.114661 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi [None req-228ea066-38ed-43b1-92c5-b0ac7306f635 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.medium", "ram": 4096, "vcpus": 2, "disk": 40, "id": "3", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=83315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:20:50.137480 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: INFO nova.api.openstack.requestlog [None req-228ea066-38ed-43b1-92c5-b0ac7306f635 admin admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 366 microversion: 2.1 time: 0.077456 Feb 17 04:20:50.138095 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: [pid: 83315|app: 0|req: 13/25] 10.222.0.78 () {62 vars in 1183 bytes} [Wed Feb 17 04:20:50 2021] POST /compute/v2.1/flavors => generated 366 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:20:50.149759 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi [None req-8f0393a2-03b4-4551-a7d7-dce24f2a4526 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=83314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:20:50.186569 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: INFO nova.api.openstack.requestlog [None req-8f0393a2-03b4-4551-a7d7-dce24f2a4526 admin admin] 10.222.0.78 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.040713 Feb 17 04:20:50.187167 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: [pid: 83314|app: 0|req: 13/26] 10.222.0.78 () {62 vars in 1233 bytes} [Wed Feb 17 04:20:50 2021] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 17 04:20:50.198341 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi [None req-4f60a4d5-f462-4d6b-9fb0-d694be227550 admin admin] Calling method '>' {{(pid=83315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:20:50.214429 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: INFO nova.api.openstack.requestlog [None req-4f60a4d5-f462-4d6b-9fb0-d694be227550 admin admin] 10.222.0.78 "GET /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.020078 Feb 17 04:20:50.214996 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: [pid: 83315|app: 0|req: 14/27] 10.222.0.78 () {58 vars in 1180 bytes} [Wed Feb 17 04:20:50 2021] GET /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 17 04:20:52.793315 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi [None req-9376a2cd-3a28-4654-9976-d33b6ffb8d91 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.large", "ram": 8192, "vcpus": 4, "disk": 80, "id": "4", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=83314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:20:52.816661 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: INFO nova.api.openstack.requestlog [None req-9376a2cd-3a28-4654-9976-d33b6ffb8d91 admin admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 365 microversion: 2.1 time: 0.076491 Feb 17 04:20:52.817257 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: [pid: 83314|app: 0|req: 14/28] 10.222.0.78 () {62 vars in 1183 bytes} [Wed Feb 17 04:20:52 2021] POST /compute/v2.1/flavors => generated 365 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:20:52.827972 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi [None req-0107ce9b-8f19-4802-b2b4-6d5ad168cda1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=83315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:20:52.863569 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: INFO nova.api.openstack.requestlog [None req-0107ce9b-8f19-4802-b2b4-6d5ad168cda1 admin admin] 10.222.0.78 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.039404 Feb 17 04:20:52.864124 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: [pid: 83315|app: 0|req: 15/29] 10.222.0.78 () {62 vars in 1233 bytes} [Wed Feb 17 04:20:52 2021] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 17 04:20:52.874284 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi [None req-8aa42f9c-631f-4957-a185-fda10ac5d437 admin admin] Calling method '>' {{(pid=83314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:20:52.890119 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: INFO nova.api.openstack.requestlog [None req-8aa42f9c-631f-4957-a185-fda10ac5d437 admin admin] 10.222.0.78 "GET /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.019704 Feb 17 04:20:52.890686 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: [pid: 83314|app: 0|req: 15/30] 10.222.0.78 () {58 vars in 1180 bytes} [Wed Feb 17 04:20:52 2021] GET /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 17 04:20:55.478881 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi [None req-d51a477e-f9bf-4a79-9d0f-f8e8f7a13932 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.xlarge", "ram": 16384, "vcpus": 8, "disk": 160, "id": "5", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=83315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:20:55.501619 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: INFO nova.api.openstack.requestlog [None req-d51a477e-f9bf-4a79-9d0f-f8e8f7a13932 admin admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 368 microversion: 2.1 time: 0.075746 Feb 17 04:20:55.502224 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: [pid: 83315|app: 0|req: 16/31] 10.222.0.78 () {62 vars in 1183 bytes} [Wed Feb 17 04:20:55 2021] POST /compute/v2.1/flavors => generated 368 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:20:55.513031 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi [None req-50fb1ef3-d7d8-4b69-8f94-e935eabe6390 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=83314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:20:55.548136 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: INFO nova.api.openstack.requestlog [None req-50fb1ef3-d7d8-4b69-8f94-e935eabe6390 admin admin] 10.222.0.78 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.038974 Feb 17 04:20:55.549317 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: [pid: 83314|app: 0|req: 16/32] 10.222.0.78 () {62 vars in 1233 bytes} [Wed Feb 17 04:20:55 2021] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 17 04:20:55.559367 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi [None req-79677a43-db3e-41e9-afbf-ca34a13153a3 admin admin] Calling method '>' {{(pid=83315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:20:55.574701 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: INFO nova.api.openstack.requestlog [None req-79677a43-db3e-41e9-afbf-ca34a13153a3 admin admin] 10.222.0.78 "GET /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.019397 Feb 17 04:20:55.575305 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: [pid: 83315|app: 0|req: 17/33] 10.222.0.78 () {58 vars in 1180 bytes} [Wed Feb 17 04:20:55 2021] GET /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 17 04:22:07.113985 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi [None req-6a8d07b3-dda7-4a11-a8a4-5b6c5146bdde admin admin] Calling method '>' {{(pid=83314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:22:07.138773 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: INFO nova.api.openstack.requestlog [None req-6a8d07b3-dda7-4a11-a8a4-5b6c5146bdde admin admin] 10.222.0.78 "GET /compute/v2.1/flavors/detail" status: 200 len: 3562 microversion: 2.1 time: 0.079006 Feb 17 04:22:07.139395 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: [pid: 83314|app: 0|req: 17/34] 10.222.0.78 () {58 vars in 1150 bytes} [Wed Feb 17 04:22:07 2021] GET /compute/v2.1/flavors/detail => generated 3562 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:22:08.794743 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi [None req-79677a43-db3e-41e9-afbf-ca34a13153a3 admin admin] Calling method '>' {{(pid=83315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:22:08.795887 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: INFO nova.api.openstack.requestlog [None req-79677a43-db3e-41e9-afbf-ca34a13153a3 admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002079 Feb 17 04:22:08.796325 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: [pid: 83315|app: 0|req: 18/35] 10.222.0.78 () {56 vars in 1065 bytes} [Wed Feb 17 04:22:08 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:22:08.982285 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi [None req-3ead533f-9c09-4da5-9c27-d57351574803 admin admin] Calling method '>' {{(pid=83314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:22:08.997491 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: INFO nova.api.openstack.wsgi [None req-3ead533f-9c09-4da5-9c27-d57351574803 admin admin] HTTP exception thrown: Flavor 42 could not be found. Feb 17 04:22:08.998031 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi [None req-3ead533f-9c09-4da5-9c27-d57351574803 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=83314) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 17 04:22:08.998889 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: INFO nova.api.openstack.requestlog [None req-3ead533f-9c09-4da5-9c27-d57351574803 admin admin] 10.222.0.78 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.87 time: 0.070261 Feb 17 04:22:08.999527 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: [pid: 83314|app: 0|req: 18/36] 10.222.0.78 () {60 vars in 1181 bytes} [Wed Feb 17 04:22:08 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Feb 17 04:22:09.010574 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi [None req-3eed3b3b-0e94-437d-8abe-4bd6a7808e1d admin admin] Calling method '>' {{(pid=83315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:22:09.033584 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: INFO nova.api.openstack.requestlog [None req-3eed3b3b-0e94-437d-8abe-4bd6a7808e1d admin admin] 10.222.0.78 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.87 time: 0.026985 Feb 17 04:22:09.034160 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: [pid: 83315|app: 0|req: 19/37] 10.222.0.78 () {60 vars in 1201 bytes} [Wed Feb 17 04:22:09 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:22:09.045763 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi [None req-d0f12f2c-8b45-439f-bc4f-60e2a8abc54a admin admin] Calling method '>' {{(pid=83314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:22:09.070805 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: INFO nova.api.openstack.requestlog [None req-d0f12f2c-8b45-439f-bc4f-60e2a8abc54a admin admin] 10.222.0.78 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.87 time: 0.028961 Feb 17 04:22:09.071407 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: [pid: 83314|app: 0|req: 19/38] 10.222.0.78 () {60 vars in 1201 bytes} [Wed Feb 17 04:22:09 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:22:09.081786 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi [None req-59992257-421d-4e8a-a838-f1354f728c69 admin admin] Calling method '>' {{(pid=83315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:22:09.095816 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: INFO nova.api.openstack.wsgi [None req-59992257-421d-4e8a-a838-f1354f728c69 admin admin] HTTP exception thrown: Flavor 42 could not be found. Feb 17 04:22:09.096454 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi [None req-59992257-421d-4e8a-a838-f1354f728c69 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=83315) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 17 04:22:09.097663 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: INFO nova.api.openstack.requestlog [None req-59992257-421d-4e8a-a838-f1354f728c69 admin admin] 10.222.0.78 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.87 time: 0.019705 Feb 17 04:22:09.098262 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: [pid: 83315|app: 0|req: 20/39] 10.222.0.78 () {60 vars in 1181 bytes} [Wed Feb 17 04:22:09 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 21 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Feb 17 04:22:10.704353 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi [None req-d0f12f2c-8b45-439f-bc4f-60e2a8abc54a admin admin] Calling method '>' {{(pid=83314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:22:10.705410 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: INFO nova.api.openstack.requestlog [None req-d0f12f2c-8b45-439f-bc4f-60e2a8abc54a admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001506 Feb 17 04:22:10.705837 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: [pid: 83314|app: 0|req: 20/40] 10.222.0.78 () {56 vars in 1065 bytes} [Wed Feb 17 04:22:10 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:22:10.892631 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi [None req-53f0c4d1-297d-4941-ba09-4671e212ea19 admin admin] Calling method '>' {{(pid=83315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:22:10.907975 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: INFO nova.api.openstack.wsgi [None req-53f0c4d1-297d-4941-ba09-4671e212ea19 admin admin] HTTP exception thrown: Flavor 84 could not be found. Feb 17 04:22:10.908541 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi [None req-53f0c4d1-297d-4941-ba09-4671e212ea19 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=83315) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 17 04:22:10.909963 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: INFO nova.api.openstack.requestlog [None req-53f0c4d1-297d-4941-ba09-4671e212ea19 admin admin] 10.222.0.78 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.87 time: 0.071300 Feb 17 04:22:10.910516 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: [pid: 83315|app: 0|req: 21/41] 10.222.0.78 () {60 vars in 1181 bytes} [Wed Feb 17 04:22:10 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Feb 17 04:22:10.920696 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi [None req-01162f7f-fd41-470c-b562-627d77736e5d admin admin] Calling method '>' {{(pid=83314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:22:10.943575 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: INFO nova.api.openstack.requestlog [None req-01162f7f-fd41-470c-b562-627d77736e5d admin admin] 10.222.0.78 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.87 time: 0.026564 Feb 17 04:22:10.944164 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: [pid: 83314|app: 0|req: 21/42] 10.222.0.78 () {60 vars in 1201 bytes} [Wed Feb 17 04:22:10 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:22:10.954516 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi [None req-833e95fb-05da-4920-af41-0c77fa9b3958 admin admin] Calling method '>' {{(pid=83315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:22:10.976689 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: INFO nova.api.openstack.requestlog [None req-833e95fb-05da-4920-af41-0c77fa9b3958 admin admin] 10.222.0.78 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.87 time: 0.025827 Feb 17 04:22:10.977254 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: [pid: 83315|app: 0|req: 22/43] 10.222.0.78 () {60 vars in 1201 bytes} [Wed Feb 17 04:22:10 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:22:10.987155 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi [None req-f495893d-2d82-4181-bff8-384a9c9089cb admin admin] Calling method '>' {{(pid=83314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:22:11.000877 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: INFO nova.api.openstack.wsgi [None req-f495893d-2d82-4181-bff8-384a9c9089cb admin admin] HTTP exception thrown: Flavor 84 could not be found. Feb 17 04:22:11.001498 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi [None req-f495893d-2d82-4181-bff8-384a9c9089cb admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=83314) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 17 04:22:11.002335 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: INFO nova.api.openstack.requestlog [None req-f495893d-2d82-4181-bff8-384a9c9089cb admin admin] 10.222.0.78 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.87 time: 0.019009 Feb 17 04:22:11.002877 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: [pid: 83314|app: 0|req: 22/44] 10.222.0.78 () {60 vars in 1181 bytes} [Wed Feb 17 04:22:10 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 20 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Feb 17 04:22:12.577399 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi [None req-833e95fb-05da-4920-af41-0c77fa9b3958 admin admin] Calling method '>' {{(pid=83315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:22:12.578461 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: INFO nova.api.openstack.requestlog [None req-833e95fb-05da-4920-af41-0c77fa9b3958 admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001552 Feb 17 04:22:12.578896 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: [pid: 83315|app: 0|req: 23/45] 10.222.0.78 () {56 vars in 1065 bytes} [Wed Feb 17 04:22:12 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:22:12.764230 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi [None req-b4372d51-5a70-40a3-a6c3-15e01d0afcf0 admin admin] Calling method '>' {{(pid=83314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:22:12.777728 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: INFO nova.api.openstack.wsgi [None req-b4372d51-5a70-40a3-a6c3-15e01d0afcf0 admin admin] HTTP exception thrown: Flavor 451 could not be found. Feb 17 04:22:12.778295 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi [None req-b4372d51-5a70-40a3-a6c3-15e01d0afcf0 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=83314) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 17 04:22:12.779242 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: INFO nova.api.openstack.requestlog [None req-b4372d51-5a70-40a3-a6c3-15e01d0afcf0 admin admin] 10.222.0.78 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.87 time: 0.069169 Feb 17 04:22:12.779792 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: [pid: 83314|app: 0|req: 23/46] 10.222.0.78 () {60 vars in 1184 bytes} [Wed Feb 17 04:22:12 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Feb 17 04:22:12.791267 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi [None req-ed4691a7-d6d9-48d7-955c-da84799ded6a admin admin] Calling method '>' {{(pid=83315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:22:12.814354 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: INFO nova.api.openstack.requestlog [None req-ed4691a7-d6d9-48d7-955c-da84799ded6a admin admin] 10.222.0.78 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.87 time: 0.027044 Feb 17 04:22:12.814944 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: [pid: 83315|app: 0|req: 24/47] 10.222.0.78 () {60 vars in 1201 bytes} [Wed Feb 17 04:22:12 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:22:12.826751 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi [None req-0b76a22a-44f0-45ac-b7a8-9b9471094348 admin admin] Calling method '>' {{(pid=83314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:22:12.850415 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: INFO nova.api.openstack.requestlog [None req-0b76a22a-44f0-45ac-b7a8-9b9471094348 admin admin] 10.222.0.78 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.87 time: 0.027553 Feb 17 04:22:12.851005 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: [pid: 83314|app: 0|req: 24/48] 10.222.0.78 () {60 vars in 1201 bytes} [Wed Feb 17 04:22:12 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:22:12.861013 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi [None req-8590a0e2-3dfc-43e5-8ae5-26500621bccc admin admin] Calling method '>' {{(pid=83315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:22:12.874647 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: INFO nova.api.openstack.wsgi [None req-8590a0e2-3dfc-43e5-8ae5-26500621bccc admin admin] HTTP exception thrown: Flavor 451 could not be found. Feb 17 04:22:12.875315 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi [None req-8590a0e2-3dfc-43e5-8ae5-26500621bccc admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=83315) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 17 04:22:12.876155 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: INFO nova.api.openstack.requestlog [None req-8590a0e2-3dfc-43e5-8ae5-26500621bccc admin admin] 10.222.0.78 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.87 time: 0.019003 Feb 17 04:22:12.876699 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: [pid: 83315|app: 0|req: 25/49] 10.222.0.78 () {60 vars in 1184 bytes} [Wed Feb 17 04:22:12 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 20 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Feb 17 04:22:14.453098 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi [None req-0b76a22a-44f0-45ac-b7a8-9b9471094348 admin admin] Calling method '>' {{(pid=83314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:22:14.454171 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: INFO nova.api.openstack.requestlog [None req-0b76a22a-44f0-45ac-b7a8-9b9471094348 admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001521 Feb 17 04:22:14.454610 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: [pid: 83314|app: 0|req: 25/50] 10.222.0.78 () {56 vars in 1065 bytes} [Wed Feb 17 04:22:14 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:22:14.641759 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi [None req-29c8dd72-d4e2-43e3-882a-c3eec07d20f0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=83315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:22:14.665939 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: INFO nova.api.openstack.requestlog [None req-29c8dd72-d4e2-43e3-882a-c3eec07d20f0 admin admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.87 time: 0.079102 Feb 17 04:22:14.666522 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: [pid: 83315|app: 0|req: 26/51] 10.222.0.78 () {64 vars in 1226 bytes} [Wed Feb 17 04:22:14 2021] POST /compute/v2.1/flavors => generated 404 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 04:22:16.239315 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi [None req-0b76a22a-44f0-45ac-b7a8-9b9471094348 admin admin] Calling method '>' {{(pid=83314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:22:16.240390 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: INFO nova.api.openstack.requestlog [None req-0b76a22a-44f0-45ac-b7a8-9b9471094348 admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001553 Feb 17 04:22:16.240890 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: [pid: 83314|app: 0|req: 26/52] 10.222.0.78 () {56 vars in 1065 bytes} [Wed Feb 17 04:22:16 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:22:16.428903 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi [None req-cb447bbd-276f-4795-9e1d-a80bee14f083 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=83315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:22:16.453018 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: INFO nova.api.openstack.requestlog [None req-cb447bbd-276f-4795-9e1d-a80bee14f083 admin admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.87 time: 0.078629 Feb 17 04:22:16.453539 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: [pid: 83315|app: 0|req: 27/53] 10.222.0.78 () {64 vars in 1226 bytes} [Wed Feb 17 04:22:16 2021] POST /compute/v2.1/flavors => generated 405 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 04:22:18.049866 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi [None req-0b76a22a-44f0-45ac-b7a8-9b9471094348 admin admin] Calling method '>' {{(pid=83314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:22:18.050939 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: INFO nova.api.openstack.requestlog [None req-0b76a22a-44f0-45ac-b7a8-9b9471094348 admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001587 Feb 17 04:22:18.051438 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: [pid: 83314|app: 0|req: 27/54] 10.222.0.78 () {56 vars in 1065 bytes} [Wed Feb 17 04:22:18 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:22:18.235975 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi [None req-fa81c544-b74a-4aa0-a963-7d4805c4e8c0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=83315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:22:18.260645 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: INFO nova.api.openstack.requestlog [None req-fa81c544-b74a-4aa0-a963-7d4805c4e8c0 admin admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.87 time: 0.078245 Feb 17 04:22:18.261231 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: [pid: 83315|app: 0|req: 28/55] 10.222.0.78 () {64 vars in 1226 bytes} [Wed Feb 17 04:22:18 2021] POST /compute/v2.1/flavors => generated 407 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 04:22:19.837827 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi [None req-0b76a22a-44f0-45ac-b7a8-9b9471094348 admin admin] Calling method '>' {{(pid=83314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:22:19.838891 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: INFO nova.api.openstack.requestlog [None req-0b76a22a-44f0-45ac-b7a8-9b9471094348 admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001513 Feb 17 04:22:19.839382 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: [pid: 83314|app: 0|req: 28/56] 10.222.0.78 () {56 vars in 1065 bytes} [Wed Feb 17 04:22:19 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:22:20.023141 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi [None req-8036b9ec-932d-4ca6-b648-64f5e48bc0ec admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=83315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:22:20.047778 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: INFO nova.api.openstack.requestlog [None req-8036b9ec-932d-4ca6-b648-64f5e48bc0ec admin admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.87 time: 0.078766 Feb 17 04:22:20.048311 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: [pid: 83315|app: 0|req: 29/57] 10.222.0.78 () {64 vars in 1226 bytes} [Wed Feb 17 04:22:19 2021] POST /compute/v2.1/flavors => generated 409 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 04:22:21.629251 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi [None req-0b76a22a-44f0-45ac-b7a8-9b9471094348 admin admin] Calling method '>' {{(pid=83314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:22:21.630307 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: INFO nova.api.openstack.requestlog [None req-0b76a22a-44f0-45ac-b7a8-9b9471094348 admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001578 Feb 17 04:22:21.630735 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: [pid: 83314|app: 0|req: 29/58] 10.222.0.78 () {56 vars in 1065 bytes} [Wed Feb 17 04:22:21 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:22:21.813665 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi [None req-703e50aa-3583-4e35-918a-22816c577db6 admin admin] Calling method '>' {{(pid=83315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:22:21.845097 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: INFO nova.api.openstack.requestlog [None req-703e50aa-3583-4e35-918a-22816c577db6 admin admin] 10.222.0.78 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.87 time: 0.085772 Feb 17 04:22:21.845605 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: [pid: 83315|app: 0|req: 30/59] 10.222.0.78 () {60 vars in 1193 bytes} [Wed Feb 17 04:22:21 2021] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:23:12.570544 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi [None req-0b76a22a-44f0-45ac-b7a8-9b9471094348 admin admin] Calling method '>' {{(pid=83314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:23:12.571638 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: INFO nova.api.openstack.requestlog [None req-0b76a22a-44f0-45ac-b7a8-9b9471094348 admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001543 Feb 17 04:23:12.572070 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: [pid: 83314|app: 0|req: 30/60] 10.222.0.78 () {56 vars in 1065 bytes} [Wed Feb 17 04:23:12 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 17 04:23:12.757206 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi [None req-f33b3174-4dd1-4b1b-9626-8674cc49acd7 admin admin] Calling method '>' {{(pid=83315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:23:12.786016 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: INFO nova.api.openstack.requestlog [None req-f33b3174-4dd1-4b1b-9626-8674cc49acd7 admin admin] 10.222.0.78 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.87 time: 0.083918 Feb 17 04:23:12.786526 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: [pid: 83315|app: 0|req: 31/61] 10.222.0.78 () {60 vars in 1193 bytes} [Wed Feb 17 04:23:12 2021] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:24:41.599418 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi [None req-a441c88c-a087-46ad-93f6-fa3534c5a799 tempest-verify_tempest_config-1854896214 tempest-verify_tempest_config-1854896214-project] Calling method '>' {{(pid=83314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:24:41.601417 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: INFO nova.api.openstack.requestlog [None req-a441c88c-a087-46ad-93f6-fa3534c5a799 tempest-verify_tempest_config-1854896214 tempest-verify_tempest_config-1854896214-project] 10.222.0.78 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.120874 Feb 17 04:24:41.601992 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: [pid: 83314|app: 0|req: 31/62] 10.222.0.78 () {58 vars in 1124 bytes} [Wed Feb 17 04:24:41 2021] GET /compute/v2.1/extensions => generated 22700 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 04:26:15.352152 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi [None req-f33b3174-4dd1-4b1b-9626-8674cc49acd7 admin admin] Calling method '>' {{(pid=83315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:26:15.353221 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: INFO nova.api.openstack.requestlog [None req-f33b3174-4dd1-4b1b-9626-8674cc49acd7 admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001583 Feb 17 04:26:15.353654 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: [pid: 83315|app: 0|req: 32/63] 10.222.0.78 () {56 vars in 1065 bytes} [Wed Feb 17 04:26:15 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:26:15.617004 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi [None req-e4c67d30-7731-4f58-813b-8ff844239a50 admin admin] Calling method '>' {{(pid=83314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:26:15.618261 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:26:15.618261 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: warnings.warn(msg) Feb 17 04:26:15.619845 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG oslo_concurrency.lockutils [None req-e4c67d30-7731-4f58-813b-8ff844239a50 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=83314) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:26:15.620327 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG oslo_concurrency.lockutils [None req-e4c67d30-7731-4f58-813b-8ff844239a50 admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=83314) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:26:15.621167 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG oslo_concurrency.lockutils [None req-e4c67d30-7731-4f58-813b-8ff844239a50 admin admin] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=83314) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:26:15.621691 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG oslo_concurrency.lockutils [None req-e4c67d30-7731-4f58-813b-8ff844239a50 admin admin] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=83314) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:26:15.655095 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: INFO nova.api.openstack.requestlog [None req-e4c67d30-7731-4f58-813b-8ff844239a50 admin admin] 10.222.0.78 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.87 time: 0.167186 Feb 17 04:26:15.655689 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: [pid: 83314|app: 0|req: 32/64] 10.222.0.78 () {60 vars in 1184 bytes} [Wed Feb 17 04:26:15 2021] GET /compute/v2.1/os-services => generated 791 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 04:26:17.260457 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi [None req-f33b3174-4dd1-4b1b-9626-8674cc49acd7 admin admin] Calling method '>' {{(pid=83315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:26:17.261527 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: INFO nova.api.openstack.requestlog [None req-f33b3174-4dd1-4b1b-9626-8674cc49acd7 admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001509 Feb 17 04:26:17.261963 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: [pid: 83315|app: 0|req: 33/65] 10.222.0.78 () {56 vars in 1065 bytes} [Wed Feb 17 04:26:17 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:26:17.454164 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi [None req-d16f3209-9105-4920-a6fc-8aeb8ebec7ce admin admin] Calling method '>' {{(pid=83314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:26:17.455470 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:26:17.455470 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: warnings.warn(msg) Feb 17 04:26:17.457106 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG oslo_concurrency.lockutils [None req-d16f3209-9105-4920-a6fc-8aeb8ebec7ce admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=83314) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:26:17.457645 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG oslo_concurrency.lockutils [None req-d16f3209-9105-4920-a6fc-8aeb8ebec7ce admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=83314) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:26:17.459266 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG oslo_concurrency.lockutils [None req-d16f3209-9105-4920-a6fc-8aeb8ebec7ce admin admin] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=83314) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:26:17.459942 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG oslo_concurrency.lockutils [None req-d16f3209-9105-4920-a6fc-8aeb8ebec7ce admin admin] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=83314) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:26:17.487240 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: INFO nova.api.openstack.requestlog [None req-d16f3209-9105-4920-a6fc-8aeb8ebec7ce admin admin] 10.222.0.78 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.87 time: 0.092685 Feb 17 04:26:17.487887 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: [pid: 83314|app: 0|req: 33/66] 10.222.0.78 () {60 vars in 1184 bytes} [Wed Feb 17 04:26:17 2021] GET /compute/v2.1/os-services => generated 791 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 04:26:29.502197 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi [None req-f33b3174-4dd1-4b1b-9626-8674cc49acd7 admin admin] Calling method '>' {{(pid=83315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:26:29.503295 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: INFO nova.api.openstack.requestlog [None req-f33b3174-4dd1-4b1b-9626-8674cc49acd7 admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001508 Feb 17 04:26:29.503729 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: [pid: 83315|app: 0|req: 34/67] 10.222.0.78 () {56 vars in 1065 bytes} [Wed Feb 17 04:26:29 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:26:29.688050 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi [None req-83266c4b-f1ee-4a01-a565-2c82de4a1b16 admin admin] Calling method '>' {{(pid=83314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:26:29.689306 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:26:29.689306 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: warnings.warn(msg) Feb 17 04:26:29.690905 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG oslo_concurrency.lockutils [None req-83266c4b-f1ee-4a01-a565-2c82de4a1b16 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=83314) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:26:29.691428 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG oslo_concurrency.lockutils [None req-83266c4b-f1ee-4a01-a565-2c82de4a1b16 admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=83314) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:26:29.692259 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG oslo_concurrency.lockutils [None req-83266c4b-f1ee-4a01-a565-2c82de4a1b16 admin admin] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=83314) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:26:29.692726 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG oslo_concurrency.lockutils [None req-83266c4b-f1ee-4a01-a565-2c82de4a1b16 admin admin] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=83314) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:26:29.724726 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: INFO nova.api.openstack.requestlog [None req-83266c4b-f1ee-4a01-a565-2c82de4a1b16 admin admin] 10.222.0.78 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.87 time: 0.091240 Feb 17 04:26:29.725314 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: [pid: 83314|app: 0|req: 34/68] 10.222.0.78 () {60 vars in 1184 bytes} [Wed Feb 17 04:26:29 2021] GET /compute/v2.1/os-services => generated 1011 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:26:31.351836 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi [None req-f33b3174-4dd1-4b1b-9626-8674cc49acd7 admin admin] Calling method '>' {{(pid=83315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:26:31.353001 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: INFO nova.api.openstack.requestlog [None req-f33b3174-4dd1-4b1b-9626-8674cc49acd7 admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001717 Feb 17 04:26:31.353483 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: [pid: 83315|app: 0|req: 35/69] 10.222.0.78 () {56 vars in 1065 bytes} [Wed Feb 17 04:26:31 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:26:31.543483 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG nova.api.openstack.wsgi [None req-c30d9e8e-ba52-4be2-bb78-078281ffd329 admin admin] Calling method '>' {{(pid=83314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:26:31.544746 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:26:31.544746 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: warnings.warn(msg) Feb 17 04:26:31.546297 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG oslo_concurrency.lockutils [None req-c30d9e8e-ba52-4be2-bb78-078281ffd329 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=83314) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:26:31.546786 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG oslo_concurrency.lockutils [None req-c30d9e8e-ba52-4be2-bb78-078281ffd329 admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=83314) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:26:31.547686 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG oslo_concurrency.lockutils [None req-c30d9e8e-ba52-4be2-bb78-078281ffd329 admin admin] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=83314) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:26:31.548155 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: DEBUG oslo_concurrency.lockutils [None req-c30d9e8e-ba52-4be2-bb78-078281ffd329 admin admin] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=83314) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:26:31.576017 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: INFO nova.api.openstack.requestlog [None req-c30d9e8e-ba52-4be2-bb78-078281ffd329 admin admin] 10.222.0.78 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.87 time: 0.091952 Feb 17 04:26:31.576609 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: [pid: 83314|app: 0|req: 35/70] 10.222.0.78 () {60 vars in 1184 bytes} [Wed Feb 17 04:26:31 2021] GET /compute/v2.1/os-services => generated 1011 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:27:32.438351 dv-cinder-759987-4-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Feb 17 04:27:32.439484 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: Wed Feb 17 04:27:32 2021 - graceful shutdown triggered... Feb 17 04:27:32.439913 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: Gracefully killing worker 1 (pid: 83314)... Feb 17 04:27:32.440001 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: Gracefully killing worker 2 (pid: 83315)... Feb 17 04:27:33.439619 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: worker 1 buried after 1 seconds Feb 17 04:27:33.439619 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: worker 2 buried after 1 seconds Feb 17 04:27:33.439619 dv-cinder-759987-4-iscsi devstack@n-api.service[83313]: goodbye to uWSGI. Feb 17 04:27:33.441289 dv-cinder-759987-4-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Feb 17 04:27:33.443017 dv-cinder-759987-4-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Feb 17 04:27:33.451792 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Feb 17 04:27:33.453771 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: *** Starting uWSGI 2.0.15-debian (64bit) on [Wed Feb 17 04:27:33 2021] *** Feb 17 04:27:33.453771 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: compiled with version: 7.3.0 on 28 September 2018 15:41:15 Feb 17 04:27:33.453771 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: os: Linux-4.15.0-55-generic #60-Ubuntu SMP Tue Jul 2 18:22:20 UTC 2019 Feb 17 04:27:33.453771 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: nodename: dv-cinder-759987-4-iscsi Feb 17 04:27:33.453771 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: machine: x86_64 Feb 17 04:27:33.453771 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: clock source: unix Feb 17 04:27:33.453771 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: pcre jit disabled Feb 17 04:27:33.453771 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: detected number of CPU cores: 4 Feb 17 04:27:33.453771 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: current working directory: / Feb 17 04:27:33.453771 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: detected binary path: /usr/bin/uwsgi-core Feb 17 04:27:33.453771 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: dropping root privileges as early as possible Feb 17 04:27:33.453771 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: your processes number limit is 47843 Feb 17 04:27:33.453771 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: your memory page size is 4096 bytes Feb 17 04:27:33.454616 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: detected max file descriptor number: 2048 Feb 17 04:27:33.454616 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: lock engine: pthread robust mutexes Feb 17 04:27:33.454616 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: thunder lock: enabled Feb 17 04:27:33.454616 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Feb 17 04:27:33.454616 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: dropping root privileges after socket binding Feb 17 04:27:33.454616 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: Python version: 3.6.9 (default, Oct 8 2020, 12:12:24) [GCC 8.4.0] Feb 17 04:27:33.501257 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: Python main interpreter initialized at 0x55c3be5ea9c0 Feb 17 04:27:33.501257 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: dropping root privileges after plugin initialization Feb 17 04:27:33.501257 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: python threads support enabled Feb 17 04:27:33.501257 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: your server socket listen backlog is limited to 100 connections Feb 17 04:27:33.501257 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: your mercy for graceful operations on workers is 90 seconds Feb 17 04:27:33.501803 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: mapped 402621 bytes (393 KB) for 2 cores Feb 17 04:27:33.501803 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: *** Operational MODE: preforking *** Feb 17 04:27:33.502027 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: dropping root privileges after application loading Feb 17 04:27:33.502027 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: *** uWSGI is running in multiple interpreter mode *** Feb 17 04:27:33.502027 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: spawned uWSGI master process (pid: 98176) Feb 17 04:27:33.502092 dv-cinder-759987-4-iscsi systemd[1]: Started Devstack devstack@n-api.service. Feb 17 04:27:33.502353 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: spawned uWSGI worker 1 (pid: 98178, cores: 1) Feb 17 04:27:33.502810 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: spawned uWSGI worker 2 (pid: 98179, cores: 1) Feb 17 04:27:33.502914 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Feb 17 04:27:38.107317 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2567}} Feb 17 04:27:38.107886 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2568}} Feb 17 04:27:38.109172 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2569}} Feb 17 04:27:38.109609 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2571}} Feb 17 04:27:38.109907 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2572}} Feb 17 04:27:38.110352 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:38.110730 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:38.111119 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:38.111495 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:38.111881 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:38.112239 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:38.112608 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:38.112976 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:38.113360 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:38.113666 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:38.114030 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:38.114677 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-759987-4-iscsi {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:38.115174 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:38.115448 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:38.115800 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:38.116172 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:38.116524 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:38.116898 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:38.117245 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:38.117864 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:38.118221 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:38.118578 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:38.118934 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:38.119349 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:38.119714 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:38.120073 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:38.120446 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:38.121345 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:38.121720 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:38.122084 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:38.122461 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-759987-4-iscsi {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:38.122832 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:38.123219 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:38.123583 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:38.124079 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:38.124437 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:38.124795 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:38.125167 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:38.125551 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:38.125897 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:38.126288 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:38.126662 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:38.127056 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:38.127432 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:38.127783 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:38.128142 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:38.128501 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:38.128875 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:38.129227 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:38.129577 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:38.129869 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:38.130225 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:38.130599 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:38.130973 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:38.131381 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:38.131675 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:38.131970 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:38.132352 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:38.132730 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:38.133097 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:38.133454 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:38.133827 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:38.134167 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:38.134927 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:38.134927 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:38.135234 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:38.135561 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:38.136897 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:38.136897 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:38.137194 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:38.137556 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:38.137930 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:38.138395 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.78 {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:38.138688 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.78 {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:38.139061 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:38.139457 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:38.139829 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:38.140184 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:38.140552 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:38.140925 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:38.141279 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:38.141631 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:38.141988 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:38.142359 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:38.142733 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:38.143084 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:38.143376 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:38.143722 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:38.144074 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:38.144444 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:38.144795 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:38.145146 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:38.145496 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:38.145840 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:38.146193 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:38.146544 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:38.146899 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:38.147272 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:38.147628 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:38.147977 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:38.148326 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:38.148675 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:38.149023 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:38.149393 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:38.149764 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:38.150115 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:38.150465 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:38.150816 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:38.151192 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:38.151564 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:38.152013 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:38.152365 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:38.152737 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:38.153087 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:38.153437 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:38.153803 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:38.154154 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:38.154506 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:38.154874 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:38.155243 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:38.155596 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:38.155965 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:38.156316 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:38.156664 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:38.157016 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:38.157361 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:38.157708 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:38.158035 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:38.158382 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:38.158726 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:38.159102 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:38.159446 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:38.159813 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:38.160167 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:38.160517 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:38.160864 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:38.161232 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:38.161616 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.161984 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.162373 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.162731 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.163144 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.163533 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.163895 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.164252 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.164612 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.164991 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.165350 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.165705 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.166063 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.166437 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.166801 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.167238 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.167670 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.167968 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.168329 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.168683 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.169047 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.169427 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.169798 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.170156 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.170551 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.170948 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.171333 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.171727 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.172127 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.172428 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.172793 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.173154 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.173525 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.173874 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.174233 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.174589 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.174979 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.175476 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.175733 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.176082 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.176452 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.176767 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.177121 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.177473 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.177841 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.178222 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.178874 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.179088 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.179375 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.179661 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.179943 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.180296 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.180652 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.181009 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.181362 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.181740 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.182095 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.182497 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.182796 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.183693 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.184050 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.184412 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.184770 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.185129 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.185488 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.185866 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.186227 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.186598 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.186975 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.187398 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.187752 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.188132 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.188506 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.188877 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.189231 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.189588 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.189941 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.190296 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.190647 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.191004 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.191377 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.191729 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.192080 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.192431 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.192782 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.193159 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.193514 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.193865 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.194217 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.194566 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.194965 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.195346 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.195738 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.196098 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.196473 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.196835 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.197198 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.197552 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = None {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.197903 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = None {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.198261 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.198656 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.199056 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.199419 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.199772 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.200128 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.200498 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_vgpu_types = [] {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.200884 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.201240 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.201599 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.201973 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.202333 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.202691 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.203079 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.203422 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.203774 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.204130 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.204495 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.204852 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.205209 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.205561 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.205923 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.206279 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.206633 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.206987 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.207370 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.207745 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.208104 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.208477 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.208850 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.209202 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.209556 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.209932 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.210290 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.210641 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.210992 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.211374 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.211775 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.212132 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.212484 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.212850 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.213219 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.213575 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.213937 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.214848 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.215252 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.215632 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.215989 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.216344 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.216703 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.217058 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.217422 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.217786 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.218161 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.218517 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.218874 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.219261 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.219614 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.219972 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.220339 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.221061 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.221448 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.221815 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.222186 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.222558 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.222928 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.223362 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.223746 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.224110 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.224469 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.224829 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.225184 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.225539 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.225901 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.226258 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.226617 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.226975 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.227393 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.227746 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.228102 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.228452 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.228806 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.229171 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.229524 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.229904 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.230788 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.231193 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.231553 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.231907 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.232262 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.232518 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2567}} Feb 17 04:27:38.232620 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.232832 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2568}} Feb 17 04:27:38.232988 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.233315 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.233714 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.234103 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.234395 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2569}} Feb 17 04:27:38.234512 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.234834 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2571}} Feb 17 04:27:38.234959 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.235158 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2572}} Feb 17 04:27:38.235309 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.235573 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.235690 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:38.235929 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.236039 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:38.236279 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.236386 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:38.236639 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.236751 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:38.236998 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.237154 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:38.237420 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:38.237605 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.237715 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.237822 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:38.238037 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.238188 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:38.238395 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.238504 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:38.238687 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:38.238840 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.239056 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:38.239425 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.239679 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.239782 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-759987-4-iscsi {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:38.240050 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.240151 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:38.240395 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:38.240498 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.240739 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.240839 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:38.241092 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.241200 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:38.241431 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:38.241532 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.241778 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.241885 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:38.242124 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:38.242232 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.242495 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.242738 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:38.242856 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.243116 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:38.243235 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.243469 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:38.243570 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.243823 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:38.243931 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.244177 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.244279 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:38.244535 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.244642 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:38.244880 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:38.244982 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.245251 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:38.245353 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.245630 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.245784 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:38.245980 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.246282 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:38.246455 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.246660 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.246762 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:38.247021 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.247157 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-759987-4-iscsi {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:38.247419 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.247539 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:38.247773 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:38.247893 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.248117 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.248236 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:38.248468 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.248570 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:38.248820 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.248976 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:38.249173 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.249281 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:38.249551 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.249660 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:38.249908 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.250015 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:38.250261 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.250362 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:38.250616 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.250725 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:38.250967 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.251125 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:38.251372 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:38.251485 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.251721 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.251822 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:38.252061 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:38.252191 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.252554 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:38.252684 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.252819 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:38.252926 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.253090 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:38.253218 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.253439 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:38.253553 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.253790 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:38.253892 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.254081 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:38.254181 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.254434 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:38.254549 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.254807 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:38.254909 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.255177 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.255284 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:38.255532 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.255645 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:38.255815 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:38.255923 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.256104 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:38.256241 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.256473 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:38.256575 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.256850 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:38.256957 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.257210 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:38.257329 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.257559 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:38.257667 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.257909 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:38.258010 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.258262 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:38.258373 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.258613 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:38.258715 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.258958 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.259075 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:38.259331 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:38.259448 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.259680 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.259788 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:38.260037 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:38.260146 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.260389 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.260498 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:38.260750 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.260858 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:38.261091 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:38.261221 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.261591 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.261707 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:38.261954 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.262289 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.78 {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:38.262390 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.262582 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.78 {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:38.262694 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.262938 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:38.263106 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.263357 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.263459 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:38.263719 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.263848 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:38.264062 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:38.264163 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.264410 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.264511 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:38.264765 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.264876 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:38.265109 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:38.265215 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.265453 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.265560 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:38.265794 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:38.265956 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.266167 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:38.266318 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.266539 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:38.266679 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.266887 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:38.267080 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.267208 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:38.267396 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.267514 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:38.267759 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.267879 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:38.268123 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.268216 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:38.268484 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.268586 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:38.268826 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:38.268936 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.269177 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:38.269277 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.269525 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:38.269627 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.269878 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:38.269987 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.270229 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:38.270336 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.270578 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:38.270680 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.270927 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:38.271057 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.271303 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.271405 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:38.271643 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:38.271752 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.271993 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:38.272105 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.272333 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.272435 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:38.272672 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:38.272780 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.273041 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.273142 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:38.273392 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.273530 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:38.273740 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:38.273848 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.274089 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:38.274196 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.274439 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:38.274540 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.274789 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:38.274896 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.275183 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:38.275361 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.275534 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:38.275722 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.275884 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:38.276080 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.276237 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:38.276459 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.276567 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:38.277366 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.277495 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:38.277752 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.277868 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:38.278104 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.278236 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:38.278467 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.278634 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:38.278827 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.279198 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:38.279306 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.279552 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:38.279655 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.279904 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.280077 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:38.280268 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:38.280371 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.280612 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.280713 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:38.280953 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:38.281066 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.281298 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:38.281399 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.281645 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:38.281752 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.281989 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:38.282090 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.282335 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:38.282477 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.282680 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:38.282857 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.283025 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:38.283219 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.283391 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:38.283589 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.283757 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:38.283970 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.284130 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:38.284325 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.284482 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:38.284681 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.284848 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:38.285041 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.285152 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:38.285396 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.285504 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:38.285752 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.285860 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.286130 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.286246 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.286484 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.286585 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.286851 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.286952 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.287250 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.287359 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.287607 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.287721 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.287960 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.288079 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.288307 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.288409 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.288668 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.288770 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.289012 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.289120 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.289382 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.289510 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.289735 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.289848 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.290089 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.290192 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.290457 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.290560 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.290814 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.290929 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.291211 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.291330 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.291562 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.291671 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.291915 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.292022 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.292257 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.292366 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.292666 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.292821 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.293062 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.293372 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.293534 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.293769 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.293882 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.294145 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.294252 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.294508 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.294615 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.294950 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.295079 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.295336 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.295438 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.295701 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.295812 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.296082 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.296189 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.296442 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.296550 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.296819 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.296928 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.297176 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.297278 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.297524 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.297624 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.297877 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.298007 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.298232 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.298345 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.298578 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.298687 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.298927 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.299098 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.299302 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.299416 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.299655 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.299764 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.300007 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.300110 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.300349 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.300449 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.300701 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.300801 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.301045 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.301154 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.301391 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.301491 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.301742 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.301843 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.302086 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.302193 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.302438 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.302548 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.302785 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.302954 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.303200 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.303304 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.303547 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.303661 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.303907 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.304025 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.304263 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.304368 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.304618 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.304721 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.304975 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.305085 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.305323 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.305431 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.305664 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.305764 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.306040 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.306152 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.306393 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.306514 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.306737 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.306833 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.307118 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.307238 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.307444 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.307610 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.307796 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.307916 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.308691 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.308903 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.309128 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.309498 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.309655 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.309863 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.309965 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.310219 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.310321 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.310600 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.310936 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.311061 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.311321 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.311430 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.311709 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.driver = filter_scheduler {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.311810 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.312074 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.312174 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.312423 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.312531 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.312774 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.312875 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.313140 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.313247 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.313498 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.313606 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.313849 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.periodic_task_interval = 60 {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.314003 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.314198 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.314300 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.314549 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = False {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.314652 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.314893 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.315000 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.315273 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.315394 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.315629 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.315804 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.315980 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.316089 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.316331 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.316439 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.316726 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.316868 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.317062 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.317180 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.317358 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.317468 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.317727 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.317839 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.318072 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.318174 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.318423 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.318530 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.318775 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.318894 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.319164 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.319286 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.319523 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.319630 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.319886 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.319997 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.320238 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.320347 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.320603 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.320710 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.320966 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.321068 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.321322 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.321434 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.321668 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.321769 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.322017 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.322119 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = None {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.322357 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = None {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.322469 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.322709 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.322810 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.323094 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.323197 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.323453 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.323566 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.323893 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.324090 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.324247 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.324549 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.324659 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.324921 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.325025 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.325293 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_vgpu_types = [] {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.325523 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.325680 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.325890 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.326038 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.326340 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.326450 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.326725 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.326832 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.327093 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.327200 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.327455 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.327556 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.327812 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.327913 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.328166 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = None {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.328268 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.328509 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.328616 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.328861 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.328988 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.329213 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.329314 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.329560 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.329695 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.329906 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.330016 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.330255 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = False {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.330363 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.330614 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.330721 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.330958 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.331090 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.331336 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.331444 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.331687 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.331795 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.332034 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.332313 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.332421 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.332731 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.332832 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.333094 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.333196 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.333467 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.333569 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.333818 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.333926 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.334170 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.334271 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.334521 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.334623 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.334872 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.334973 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.335253 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.335368 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.335602 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.335710 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.335944 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.336045 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.336298 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.336411 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.336652 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.336760 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.336992 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.337099 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.337329 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.337450 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.337684 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.337792 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.338030 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.338131 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.338378 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.338468 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.338723 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.338825 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.339097 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.339222 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.340055 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.340167 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.340413 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.340725 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.340836 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.341095 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.341203 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.341437 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.341538 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.341787 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.341887 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.342134 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.342246 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.342483 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.342590 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.342836 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.342943 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.343214 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.343328 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.343564 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.343672 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.343908 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.344015 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.344250 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.344404 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.344595 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.344703 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.344950 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.345057 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.345294 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.345659 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.345759 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.346002 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.346109 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.346355 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.346464 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.346711 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.346812 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.347087 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.347203 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.347442 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.347597 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.347815 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.347916 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.348175 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.348283 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.348524 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.348695 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.348874 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.348975 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.349233 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.349508 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.349625 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.349899 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.349985 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.350247 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.350349 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.350598 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.350706 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.350955 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.351077 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.351336 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.351437 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.351684 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.351797 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.352023 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.352130 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.352372 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.352480 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.352720 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.352832 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.353060 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.353160 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.353409 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.353510 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.353751 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.353862 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.354098 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.354205 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.354438 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.354520 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.354786 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.354979 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.355237 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.355374 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.355549 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.355901 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.356011 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.356263 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.356371 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.356619 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.356732 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.357020 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.357129 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.357373 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.357481 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.357749 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.357855 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.358113 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.358222 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.358474 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.358604 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.358831 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.358933 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.359211 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.359330 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.359579 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.359696 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.359924 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.360040 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.360274 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.360369 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.360626 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.360760 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.360980 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.361082 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.361330 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.361438 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.361690 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.361804 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.362056 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.362200 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.362412 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.362514 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.362760 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.362874 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.363169 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.363275 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.363521 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.363623 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.363885 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.363996 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.364499 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.364665 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.364820 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.364922 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.365184 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.365295 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.365508 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.365615 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.365861 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.365969 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.366209 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.366319 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.366584 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.366685 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.366939 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.367070 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.367330 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.367439 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.367688 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.367825 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.368029 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.368140 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.368379 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.368487 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.368728 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.368836 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.369090 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.369198 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.369478 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.369584 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.369767 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.369876 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.370125 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.370227 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.370474 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.371143 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.371503 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.371782 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.372054 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.372164 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.372434 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.372542 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.372793 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.372900 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.373155 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.373271 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.373508 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.373609 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] database.use_db_reconnect = False {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.373861 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.373967 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] database.use_tpool = False {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.374214 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.374327 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.374581 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.374717 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.374929 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.375059 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.375317 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.375427 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.375663 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.375766 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.376015 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.376116 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.376382 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.376492 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.376735 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.376843 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.377094 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.377196 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.377452 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.377564 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.377815 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.377950 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.378171 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.378272 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.378522 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.378624 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.378873 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.379151 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.379358 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.379493 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.379652 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.379841 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.379945 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.380199 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.380300 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.380580 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.380700 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.380953 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.381055 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.381299 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.381404 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.381654 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.381756 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.382016 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.382117 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.382384 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.382485 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.382737 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.382845 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.383106 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.383226 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.383462 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.383566 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.383822 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.383925 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.384178 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.384281 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.384529 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.384636 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.384876 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.384984 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.385234 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.385336 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.385582 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.385692 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.385941 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.386043 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.386537 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.386725 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.387125 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.387331 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.387496 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.387661 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.387827 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.387983 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.388150 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.388262 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.388483 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.388923 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.389111 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.389233 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.389233 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=98178) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2591}} Feb 17 04:27:38.389439 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.390027 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.390027 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.390299 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.390616 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.390971 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.392308 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.392308 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.392308 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.392609 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.392850 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.393209 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.393573 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.393935 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.394287 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.394774 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.395158 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.395518 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.395876 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.396227 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.396579 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.396935 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.397311 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.397662 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.398014 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.398364 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.398741 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.399222 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.399488 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.399972 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.400331 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.400683 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.401166 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.401528 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.402670 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.403315 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.403704 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.404088 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.404445 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.404810 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.405172 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.405554 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.405936 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.406296 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.406659 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.407011 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.407427 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.407808 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.408172 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.408548 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.409033 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.409414 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.409774 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.410152 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.410530 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.410881 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.411263 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.411624 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.411977 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.412340 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.412720 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.413071 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.413431 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.413789 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.414144 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.414479 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.414828 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.415229 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.415580 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.415957 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.416316 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.416695 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.417070 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.417444 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.419145 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.419145 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.419485 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.419839 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.420192 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.420595 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.420951 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.421317 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.421725 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.422093 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.422463 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.422848 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.423250 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.423615 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.423984 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.424363 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.424715 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.425066 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.425423 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.425774 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.425962 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_db.sqlalchemy.engines [None req-ad49a577-b994-411d-aa8d-e0a0580f60fb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=98178) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Feb 17 04:27:38.426125 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.426473 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.426828 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.427237 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.427591 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.427937 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.428312 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.428660 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.429047 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.429396 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.429748 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.430100 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.430448 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.430841 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.431220 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.431606 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.431978 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.432357 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.432737 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.433130 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.433804 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.434211 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.434580 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.434947 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.435359 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.435820 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.436189 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.436557 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.436913 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.437278 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.437642 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.438004 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.438649 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.439066 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.439453 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.driver = filter_scheduler {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.439816 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.440177 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.440538 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.440907 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.441268 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.441628 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.periodic_task_interval = 60 {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.441989 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.442353 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = False {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.442708 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.443112 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.443495 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.443881 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.444277 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.444643 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.445193 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.445560 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.445930 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.446353 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.446722 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.447113 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.447487 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.447856 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.448224 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.448589 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.449731 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.450093 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.450462 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.450831 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.451239 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.451605 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.452230 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.452362 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.452994 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.452994 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.453380 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.453742 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.454109 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.454719 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.455107 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.455629 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.455859 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.456238 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.456600 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.456965 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.457327 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = None {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.457680 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.458031 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.458389 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.458745 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.459118 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.459478 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = False {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.459832 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.460183 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.460553 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.460886 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.461508 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.461918 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.462281 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.462661 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.463073 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.463439 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.463791 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.464170 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.464993 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.465428 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.465798 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.466157 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.466511 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.466999 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.467385 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.467743 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.468097 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.468455 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.468803 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.469185 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.469542 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.469871 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.470224 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.470600 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.470934 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.471314 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.471668 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.472021 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.472380 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.472730 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.473091 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.473442 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.473799 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.474151 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.474507 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.474857 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.475262 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.475614 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.475963 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.476327 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.476682 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.477056 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.477414 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.477772 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.478173 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.478537 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.479194 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.479660 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.480499 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.481124 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.481645 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.482007 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.482491 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.482850 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.483286 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.483661 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.484025 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.484385 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.484745 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.485102 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.485462 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.485819 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.486178 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.486536 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.486893 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.487318 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.487688 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.488054 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.488417 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.488783 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.489141 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.489758 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.490117 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.490475 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.490842 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.491258 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.491623 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.491977 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.492474 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.492833 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.493197 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.493571 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.493929 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.494310 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.494703 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.495121 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.495530 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.496156 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.496553 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.496907 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.497267 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.497668 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.498187 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.498559 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.498935 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.499349 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.499715 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.500078 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.500435 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.500800 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.501160 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.501528 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.501894 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.502262 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.502618 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.502995 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.503385 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.503762 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.504115 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.504480 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.504840 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] database.use_db_reconnect = False {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.505203 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] database.use_tpool = False {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.505591 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.505955 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.506329 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.506686 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.507079 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.507442 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.507817 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.508193 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.508559 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.508912 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.509297 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.509654 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.510050 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.510608 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.510969 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.512056 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.512579 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.512962 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.513371 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.513851 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.514213 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.514584 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.514955 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.515371 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.515733 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.516118 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.516477 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.516839 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.517198 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.517554 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.517921 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.518306 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.518658 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.519056 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.519438 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.519816 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.520220 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.520579 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.520976 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.521359 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:38.521644 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=98179) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2591}} Feb 17 04:27:38.559454 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_db.sqlalchemy.engines [None req-ee33f68a-ddad-41fb-bf1a-1c37b18ee2c9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=98179) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Feb 17 04:27:38.693302 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.context [None req-ad49a577-b994-411d-aa8d-e0a0580f60fb None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),2ad0e24a-b803-4b80-a765-57fb829d8448(cell1) {{(pid=98178) load_cells /opt/stack/nova/nova/context.py:466}} Feb 17 04:27:38.699399 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-ad49a577-b994-411d-aa8d-e0a0580f60fb None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:27:38.701384 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-ad49a577-b994-411d-aa8d-e0a0580f60fb None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:27:38.702287 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-ad49a577-b994-411d-aa8d-e0a0580f60fb None None] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:27:38.704476 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-ad49a577-b994-411d-aa8d-e0a0580f60fb None None] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:27:38.732571 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_db.sqlalchemy.engines [None req-ad49a577-b994-411d-aa8d-e0a0580f60fb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=98178) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Feb 17 04:27:38.735537 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_db.sqlalchemy.engines [None req-ad49a577-b994-411d-aa8d-e0a0580f60fb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=98178) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Feb 17 04:27:38.767089 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_db.sqlalchemy.engines [None req-ad49a577-b994-411d-aa8d-e0a0580f60fb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=98178) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Feb 17 04:27:38.838466 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.context [None req-ee33f68a-ddad-41fb-bf1a-1c37b18ee2c9 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),2ad0e24a-b803-4b80-a765-57fb829d8448(cell1) {{(pid=98179) load_cells /opt/stack/nova/nova/context.py:466}} Feb 17 04:27:38.844534 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-ee33f68a-ddad-41fb-bf1a-1c37b18ee2c9 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:27:38.846378 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-ee33f68a-ddad-41fb-bf1a-1c37b18ee2c9 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:27:38.847296 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-ee33f68a-ddad-41fb-bf1a-1c37b18ee2c9 None None] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:27:38.849454 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-ee33f68a-ddad-41fb-bf1a-1c37b18ee2c9 None None] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:27:38.851205 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 17 04:27:38.851205 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: from cryptography.utils import int_from_bytes Feb 17 04:27:38.851605 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 17 04:27:38.851605 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: from cryptography.utils import int_from_bytes Feb 17 04:27:38.879759 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_db.sqlalchemy.engines [None req-ee33f68a-ddad-41fb-bf1a-1c37b18ee2c9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=98179) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Feb 17 04:27:38.880811 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_db.sqlalchemy.engines [None req-ee33f68a-ddad-41fb-bf1a-1c37b18ee2c9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=98179) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Feb 17 04:27:38.913273 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_db.sqlalchemy.engines [None req-ee33f68a-ddad-41fb-bf1a-1c37b18ee2c9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=98179) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Feb 17 04:27:38.930776 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO keyring.backend [None req-ad49a577-b994-411d-aa8d-e0a0580f60fb None None] Loading Gnome Feb 17 04:27:38.952342 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO keyring.backend [None req-ad49a577-b994-411d-aa8d-e0a0580f60fb None None] Loading Google Feb 17 04:27:38.955809 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO keyring.backend [None req-ad49a577-b994-411d-aa8d-e0a0580f60fb None None] Loading Windows (alt) Feb 17 04:27:38.960499 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO keyring.backend [None req-ad49a577-b994-411d-aa8d-e0a0580f60fb None None] Loading file Feb 17 04:27:38.961628 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO keyring.backend [None req-ad49a577-b994-411d-aa8d-e0a0580f60fb None None] Loading keyczar Feb 17 04:27:38.962087 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO keyring.backend [None req-ad49a577-b994-411d-aa8d-e0a0580f60fb None None] Loading multi Feb 17 04:27:38.963256 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO keyring.backend [None req-ad49a577-b994-411d-aa8d-e0a0580f60fb None None] Loading pyfs Feb 17 04:27:39.000804 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 17 04:27:39.000804 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: from cryptography.utils import int_from_bytes Feb 17 04:27:39.001207 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 17 04:27:39.001207 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: from cryptography.utils import int_from_bytes Feb 17 04:27:39.082922 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO keyring.backend [None req-ee33f68a-ddad-41fb-bf1a-1c37b18ee2c9 None None] Loading Gnome Feb 17 04:27:39.104871 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO keyring.backend [None req-ee33f68a-ddad-41fb-bf1a-1c37b18ee2c9 None None] Loading Google Feb 17 04:27:39.108746 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO keyring.backend [None req-ee33f68a-ddad-41fb-bf1a-1c37b18ee2c9 None None] Loading Windows (alt) Feb 17 04:27:39.113414 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO keyring.backend [None req-ee33f68a-ddad-41fb-bf1a-1c37b18ee2c9 None None] Loading file Feb 17 04:27:39.115002 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO keyring.backend [None req-ee33f68a-ddad-41fb-bf1a-1c37b18ee2c9 None None] Loading keyczar Feb 17 04:27:39.115657 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO keyring.backend [None req-ee33f68a-ddad-41fb-bf1a-1c37b18ee2c9 None None] Loading multi Feb 17 04:27:39.116834 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO keyring.backend [None req-ee33f68a-ddad-41fb-bf1a-1c37b18ee2c9 None None] Loading pyfs Feb 17 04:27:39.347098 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: WARNING keystonemiddleware.auth_token [None req-ad49a577-b994-411d-aa8d-e0a0580f60fb None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Feb 17 04:27:39.354357 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: WARNING keystonemiddleware.auth_token [None req-ad49a577-b994-411d-aa8d-e0a0580f60fb None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Feb 17 04:27:39.515549 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: WARNING keystonemiddleware.auth_token [None req-ee33f68a-ddad-41fb-bf1a-1c37b18ee2c9 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Feb 17 04:27:39.522800 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: WARNING keystonemiddleware.auth_token [None req-ee33f68a-ddad-41fb-bf1a-1c37b18ee2c9 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Feb 17 04:27:39.587444 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: WARNING keystonemiddleware.auth_token [None req-ad49a577-b994-411d-aa8d-e0a0580f60fb None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Feb 17 04:27:39.593848 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: WARNING keystonemiddleware.auth_token [None req-ad49a577-b994-411d-aa8d-e0a0580f60fb None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Feb 17 04:27:39.599510 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55c3be5ea9c0 pid: 98178 (default app) Feb 17 04:27:39.760564 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: WARNING keystonemiddleware.auth_token [None req-ee33f68a-ddad-41fb-bf1a-1c37b18ee2c9 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Feb 17 04:27:39.766742 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: WARNING keystonemiddleware.auth_token [None req-ee33f68a-ddad-41fb-bf1a-1c37b18ee2c9 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Feb 17 04:27:39.772322 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55c3be5ea9c0 pid: 98179 (default app) Feb 17 04:28:18.527147 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-624ce247-209e-4c09-8160-78589d015b41 tempest-VolumesSnapshotsTestJSON-642626068 tempest-VolumesSnapshotsTestJSON-642626068-project] Action: 'create', calling method: .version_select at 0x7f57c9eb92f0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1957595076"}} {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:28:20.366386 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-624ce247-209e-4c09-8160-78589d015b41 tempest-VolumesSnapshotsTestJSON-642626068 tempest-VolumesSnapshotsTestJSON-642626068-project] 10.222.0.78 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 3.199260 Feb 17 04:28:20.367078 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 1/1] 10.222.0.78 () {60 vars in 1145 bytes} [Wed Feb 17 04:28:17 2021] POST /compute/v2.1/os-volumes => generated 345 bytes in 3202 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Feb 17 04:28:20.774864 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-04356638-ab66-44a8-865b-eebcc0424277 tempest-VolumesSnapshotsTestJSON-642626068 tempest-VolumesSnapshotsTestJSON-642626068-project] Calling method '.version_select at 0x7f57c9f75e18>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:28:21.939465 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-04356638-ab66-44a8-865b-eebcc0424277 tempest-VolumesSnapshotsTestJSON-642626068 tempest-VolumesSnapshotsTestJSON-642626068-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/6be7fb79-8d72-430d-b434-ba011bbacfdb" status: 200 len: 345 microversion: 2.1 time: 1.560725 Feb 17 04:28:21.940332 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 1/2] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Feb 17 04:28:20 2021] GET /compute/v2.1/os-volumes/6be7fb79-8d72-430d-b434-ba011bbacfdb => generated 345 bytes in 1563 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:28:22.954412 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-6e868c49-d9e2-4c63-a4b4-470026854e1c tempest-VolumesSnapshotsTestJSON-642626068 tempest-VolumesSnapshotsTestJSON-642626068-project] Calling method '.version_select at 0x7f57c9eb9ae8>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:28:23.122233 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-6e868c49-d9e2-4c63-a4b4-470026854e1c tempest-VolumesSnapshotsTestJSON-642626068 tempest-VolumesSnapshotsTestJSON-642626068-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/6be7fb79-8d72-430d-b434-ba011bbacfdb" status: 200 len: 346 microversion: 2.1 time: 0.171866 Feb 17 04:28:23.122687 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 2/3] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Feb 17 04:28:22 2021] GET /compute/v2.1/os-volumes/6be7fb79-8d72-430d-b434-ba011bbacfdb => generated 346 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:28:23.134696 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-38cc83e2-8b6d-4e8f-abfe-a7dbf3d646fd tempest-VolumesSnapshotsTestJSON-642626068 tempest-VolumesSnapshotsTestJSON-642626068-project] Action: 'create', calling method: .version_select at 0x7f57c9d3f378>, body: {"snapshot": {"volume_id": "6be7fb79-8d72-430d-b434-ba011bbacfdb", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-811067991"}} {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:28:23.543810 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-15e72117-6731-4da8-8903-ae10c7d5ab59 tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-923401020", "imageRef": "b005ed36-a85a-4c46-ba22-9fa8c5ec62e5", "flavorRef": "452", "networks": [{"uuid": "22dca046-b01b-45d7-a1d3-fefa6eafc13b"}]}} {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:28:23.724566 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-38cc83e2-8b6d-4e8f-abfe-a7dbf3d646fd tempest-VolumesSnapshotsTestJSON-642626068 tempest-VolumesSnapshotsTestJSON-642626068-project] 10.222.0.78 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.593414 Feb 17 04:28:23.725590 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 2/4] 10.222.0.78 () {60 vars in 1152 bytes} [Wed Feb 17 04:28:23 2021] POST /compute/v2.1/os-snapshots => generated 286 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 17 04:28:23.747104 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.network.neutron [None req-15e72117-6731-4da8-8903-ae10c7d5ab59 tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] validate_networks() for [('22dca046-b01b-45d7-a1d3-fefa6eafc13b', None, None, None)] {{(pid=98178) validate_networks /opt/stack/nova/nova/network/neutron.py:2345}} Feb 17 04:28:23.748381 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-5903ea57-6d36-49e9-b569-310b8562e1bd tempest-VolumesTestJSON-920007498 tempest-VolumesTestJSON-920007498-project] Calling method '.version_select at 0x7f57c9d8cf28>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:28:23.870934 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-5903ea57-6d36-49e9-b569-310b8562e1bd tempest-VolumesTestJSON-920007498 tempest-VolumesTestJSON-920007498-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/c11bfce8-a39d-4b01-a150-ba0618584cc3" status: 200 len: 350 microversion: 2.1 time: 0.136719 Feb 17 04:28:23.871785 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 3/5] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Feb 17 04:28:23 2021] GET /compute/v2.1/os-volumes/c11bfce8-a39d-4b01-a150-ba0618584cc3 => generated 350 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:28:23.877078 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-84a69e3f-acea-47b7-be5f-8ca745dde250 tempest-VolumesSnapshotsTestJSON-642626068 tempest-VolumesSnapshotsTestJSON-642626068-project] Calling method '.version_select at 0x7f57c9e152f0>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:28:23.970788 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-84a69e3f-acea-47b7-be5f-8ca745dde250 tempest-VolumesSnapshotsTestJSON-642626068 tempest-VolumesSnapshotsTestJSON-642626068-project] 10.222.0.78 "GET /compute/v2.1/os-snapshots/47242baa-36ff-46d5-ab50-33dc746c2b63" status: 200 len: 286 microversion: 2.1 time: 0.097737 Feb 17 04:28:23.971692 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 4/6] 10.222.0.78 () {58 vars in 1241 bytes} [Wed Feb 17 04:28:23 2021] GET /compute/v2.1/os-snapshots/47242baa-36ff-46d5-ab50-33dc746c2b63 => generated 286 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:28:23.983743 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-898d4ce1-df08-42d7-9f82-0b0afd4e524e tempest-VolumesSnapshotsTestJSON-642626068 tempest-VolumesSnapshotsTestJSON-642626068-project] Calling method '.version_select at 0x7f57c9e15620>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:28:24.078300 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-898d4ce1-df08-42d7-9f82-0b0afd4e524e tempest-VolumesSnapshotsTestJSON-642626068 tempest-VolumesSnapshotsTestJSON-642626068-project] 10.222.0.78 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.099921 Feb 17 04:28:24.086621 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 5/7] 10.222.0.78 () {58 vars in 1130 bytes} [Wed Feb 17 04:28:23 2021] GET /compute/v2.1/os-snapshots => generated 289 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:28:24.093076 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-13c89f01-1789-4e12-aadf-0b68bb2c4c67 tempest-VolumesSnapshotsTestJSON-642626068 tempest-VolumesSnapshotsTestJSON-642626068-project] Calling method '.version_select at 0x7f57c9d8cf28>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:28:24.154642 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-13c89f01-1789-4e12-aadf-0b68bb2c4c67 tempest-VolumesSnapshotsTestJSON-642626068 tempest-VolumesSnapshotsTestJSON-642626068-project] 10.222.0.78 "GET /compute/v2.1/os-snapshots/47242baa-36ff-46d5-ab50-33dc746c2b63" status: 200 len: 286 microversion: 2.1 time: 0.066624 Feb 17 04:28:24.155319 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 6/8] 10.222.0.78 () {58 vars in 1241 bytes} [Wed Feb 17 04:28:24 2021] GET /compute/v2.1/os-snapshots/47242baa-36ff-46d5-ab50-33dc746c2b63 => generated 286 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:28:25.166109 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-df03046f-d31b-4875-8f39-61029c1676f4 tempest-VolumesSnapshotsTestJSON-642626068 tempest-VolumesSnapshotsTestJSON-642626068-project] Calling method '.version_select at 0x7f57c9e15c80>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:28:25.257593 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-df03046f-d31b-4875-8f39-61029c1676f4 tempest-VolumesSnapshotsTestJSON-642626068 tempest-VolumesSnapshotsTestJSON-642626068-project] 10.222.0.78 "GET /compute/v2.1/os-snapshots/47242baa-36ff-46d5-ab50-33dc746c2b63" status: 200 len: 286 microversion: 2.1 time: 0.095046 Feb 17 04:28:25.258382 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 7/9] 10.222.0.78 () {58 vars in 1241 bytes} [Wed Feb 17 04:28:25 2021] GET /compute/v2.1/os-snapshots/47242baa-36ff-46d5-ab50-33dc746c2b63 => generated 286 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:28:26.501144 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.virt.hardware [None req-15e72117-6731-4da8-8903-ae10c7d5ab59 tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] Flavor limits 0:0:0 {{(pid=98178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 17 04:28:26.502532 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.virt.hardware [None req-15e72117-6731-4da8-8903-ae10c7d5ab59 tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] Image limits 0:0:0 {{(pid=98178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Feb 17 04:28:26.503307 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.virt.hardware [None req-15e72117-6731-4da8-8903-ae10c7d5ab59 tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] Flavor pref 0:0:0 {{(pid=98178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 17 04:28:26.503992 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.virt.hardware [None req-15e72117-6731-4da8-8903-ae10c7d5ab59 tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] Image pref 0:0:0 {{(pid=98178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Feb 17 04:28:26.504678 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.virt.hardware [None req-15e72117-6731-4da8-8903-ae10c7d5ab59 tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Feb 17 04:28:26.553945 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-15e72117-6731-4da8-8903-ae10c7d5ab59 tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:28:26.556192 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-15e72117-6731-4da8-8903-ae10c7d5ab59 tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:28:26.560203 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-15e72117-6731-4da8-8903-ae10c7d5ab59 tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:28:26.560934 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-15e72117-6731-4da8-8903-ae10c7d5ab59 tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:28:26.584239 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-a33d2e78-83f5-4581-84a2-fba52d3d21a2 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1099542939", "imageRef": "b005ed36-a85a-4c46-ba22-9fa8c5ec62e5", "flavorRef": "452", "networks": [{"uuid": "96c670ae-41b0-4a7d-b9a0-1a1a0b99417f"}]}} {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:28:26.599328 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.quota [None req-15e72117-6731-4da8-8903-ae10c7d5ab59 tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] Getting quotas for project d156b69e0ec24a8782b15c83a8c4cf02. Resources: {'ram', 'cores', 'instances'} {{(pid=98178) _get_quotas /opt/stack/nova/nova/quota.py:388}} Feb 17 04:28:26.605954 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.quota [None req-15e72117-6731-4da8-8903-ae10c7d5ab59 tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] Getting quotas for user b59e91a6423843459340bbd8d875007e and project d156b69e0ec24a8782b15c83a8c4cf02. Resources: {'ram', 'cores', 'instances'} {{(pid=98178) _get_quotas /opt/stack/nova/nova/quota.py:380}} Feb 17 04:28:26.619331 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-15e72117-6731-4da8-8903-ae10c7d5ab59 tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] Going to run 1 instances... {{(pid=98178) _provision_instances /opt/stack/nova/nova/compute/api.py:1264}} Feb 17 04:28:26.623262 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-15e72117-6731-4da8-8903-ae10c7d5ab59 tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] [instance: fc3441c6-9dd2-4b3e-8aea-c1ea786a445e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b005ed36-a85a-4c46-ba22-9fa8c5ec62e5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98178) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1666}} Feb 17 04:28:26.756493 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-15e72117-6731-4da8-8903-ae10c7d5ab59 tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.429806 Feb 17 04:28:26.757197 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 3/10] 10.222.0.78 () {60 vars in 1137 bytes} [Wed Feb 17 04:28:23 2021] POST /compute/v2.1/servers => generated 380 bytes in 3431 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 17 04:28:26.782109 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-a92b9260-978c-4099-85e2-fbd1d6ce35cd tempest-VolumesSnapshotsTestJSON-642626068 tempest-VolumesSnapshotsTestJSON-642626068-project] Calling method '.version_select at 0x7f57c9c97268>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:28:26.790312 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.network.neutron [None req-a33d2e78-83f5-4581-84a2-fba52d3d21a2 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] validate_networks() for [('96c670ae-41b0-4a7d-b9a0-1a1a0b99417f', None, None, None)] {{(pid=98179) validate_networks /opt/stack/nova/nova/network/neutron.py:2345}} Feb 17 04:28:26.936185 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-a92b9260-978c-4099-85e2-fbd1d6ce35cd tempest-VolumesSnapshotsTestJSON-642626068 tempest-VolumesSnapshotsTestJSON-642626068-project] 10.222.0.78 "GET /compute/v2.1/os-snapshots/47242baa-36ff-46d5-ab50-33dc746c2b63" status: 200 len: 286 microversion: 2.1 time: 0.177699 Feb 17 04:28:26.936780 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 4/11] 10.222.0.78 () {58 vars in 1241 bytes} [Wed Feb 17 04:28:26 2021] GET /compute/v2.1/os-snapshots/47242baa-36ff-46d5-ab50-33dc746c2b63 => generated 286 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:28:26.942221 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-b5039430-edde-405d-887e-b152adae76a5 tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:28:26.943747 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-b5039430-edde-405d-887e-b152adae76a5 tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] [instance: fc3441c6-9dd2-4b3e-8aea-c1ea786a445e] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:28:27.193526 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-b5039430-edde-405d-887e-b152adae76a5 tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b59e91a6423843459340bbd8d875007e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd156b69e0ec24a8782b15c83a8c4cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:28:27.246315 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-b5039430-edde-405d-887e-b152adae76a5 tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] 10.222.0.78 "GET /compute/v2.1/servers/fc3441c6-9dd2-4b3e-8aea-c1ea786a445e" status: 200 len: 1214 microversion: 2.1 time: 0.307900 Feb 17 04:28:27.247642 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 5/12] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:28:26 2021] GET /compute/v2.1/servers/fc3441c6-9dd2-4b3e-8aea-c1ea786a445e => generated 1214 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:28:27.951422 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-adfa9bdf-0b2c-45fd-9752-2a5a8fece674 tempest-VolumesSnapshotsTestJSON-642626068 tempest-VolumesSnapshotsTestJSON-642626068-project] Calling method '.version_select at 0x7f57c9c97840>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:28:28.029924 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-adfa9bdf-0b2c-45fd-9752-2a5a8fece674 tempest-VolumesSnapshotsTestJSON-642626068 tempest-VolumesSnapshotsTestJSON-642626068-project] 10.222.0.78 "GET /compute/v2.1/os-snapshots/47242baa-36ff-46d5-ab50-33dc746c2b63" status: 200 len: 286 microversion: 2.1 time: 0.084302 Feb 17 04:28:28.031075 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 6/13] 10.222.0.78 () {58 vars in 1241 bytes} [Wed Feb 17 04:28:27 2021] GET /compute/v2.1/os-snapshots/47242baa-36ff-46d5-ab50-33dc746c2b63 => generated 286 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:28:28.266827 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-1ebbbf7d-5d42-4589-91d0-8337eabbe275 tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:28:28.268014 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-1ebbbf7d-5d42-4589-91d0-8337eabbe275 tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] [instance: fc3441c6-9dd2-4b3e-8aea-c1ea786a445e] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:28:28.699915 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-1ebbbf7d-5d42-4589-91d0-8337eabbe275 tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b59e91a6423843459340bbd8d875007e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd156b69e0ec24a8782b15c83a8c4cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:28:28.720480 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.virt.hardware [None req-a33d2e78-83f5-4581-84a2-fba52d3d21a2 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Flavor limits 0:0:0 {{(pid=98179) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 17 04:28:28.720961 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.virt.hardware [None req-a33d2e78-83f5-4581-84a2-fba52d3d21a2 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Image limits 0:0:0 {{(pid=98179) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Feb 17 04:28:28.721500 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.virt.hardware [None req-a33d2e78-83f5-4581-84a2-fba52d3d21a2 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Flavor pref 0:0:0 {{(pid=98179) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 17 04:28:28.721962 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.virt.hardware [None req-a33d2e78-83f5-4581-84a2-fba52d3d21a2 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Image pref 0:0:0 {{(pid=98179) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Feb 17 04:28:28.722842 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.virt.hardware [None req-a33d2e78-83f5-4581-84a2-fba52d3d21a2 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98179) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Feb 17 04:28:28.746429 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-1ebbbf7d-5d42-4589-91d0-8337eabbe275 tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] 10.222.0.78 "GET /compute/v2.1/servers/fc3441c6-9dd2-4b3e-8aea-c1ea786a445e" status: 200 len: 1214 microversion: 2.1 time: 0.484693 Feb 17 04:28:28.748282 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 7/14] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:28:28 2021] GET /compute/v2.1/servers/fc3441c6-9dd2-4b3e-8aea-c1ea786a445e => generated 1214 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:28:28.761197 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-a33d2e78-83f5-4581-84a2-fba52d3d21a2 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:28:28.763879 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-a33d2e78-83f5-4581-84a2-fba52d3d21a2 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:28:28.767846 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-a33d2e78-83f5-4581-84a2-fba52d3d21a2 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:28:28.768940 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-a33d2e78-83f5-4581-84a2-fba52d3d21a2 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:28:28.858049 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.quota [None req-a33d2e78-83f5-4581-84a2-fba52d3d21a2 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Getting quotas for project 2f2a1ca6347d4278899a1cc009d87d33. Resources: {'ram', 'cores', 'instances'} {{(pid=98179) _get_quotas /opt/stack/nova/nova/quota.py:388}} Feb 17 04:28:28.871611 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.quota [None req-a33d2e78-83f5-4581-84a2-fba52d3d21a2 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Getting quotas for user 6d68d4a6c12e4331b8df8191cdd7a669 and project 2f2a1ca6347d4278899a1cc009d87d33. Resources: {'ram', 'cores', 'instances'} {{(pid=98179) _get_quotas /opt/stack/nova/nova/quota.py:380}} Feb 17 04:28:28.905954 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-a33d2e78-83f5-4581-84a2-fba52d3d21a2 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Going to run 1 instances... {{(pid=98179) _provision_instances /opt/stack/nova/nova/compute/api.py:1264}} Feb 17 04:28:28.911634 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-a33d2e78-83f5-4581-84a2-fba52d3d21a2 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] [instance: 21edfff0-5c5c-43a5-a4e5-22ddd5f452eb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b005ed36-a85a-4c46-ba22-9fa8c5ec62e5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98179) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1666}} Feb 17 04:28:29.045195 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-04755bec-c211-47dd-bdef-b791fdc06d0a tempest-VolumesSnapshotsTestJSON-642626068 tempest-VolumesSnapshotsTestJSON-642626068-project] Calling method '.version_select at 0x7f57c9cb7e18>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:28:29.144325 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-a33d2e78-83f5-4581-84a2-fba52d3d21a2 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.074156 Feb 17 04:28:29.148480 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 8/15] 10.222.0.78 () {60 vars in 1137 bytes} [Wed Feb 17 04:28:26 2021] POST /compute/v2.1/servers => generated 380 bytes in 3078 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 17 04:28:29.158150 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-144c58d2-b678-40d2-b5ff-04cec2a5426d tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:28:29.158818 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-144c58d2-b678-40d2-b5ff-04cec2a5426d tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] [instance: 21edfff0-5c5c-43a5-a4e5-22ddd5f452eb] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:28:29.221354 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-04755bec-c211-47dd-bdef-b791fdc06d0a tempest-VolumesSnapshotsTestJSON-642626068 tempest-VolumesSnapshotsTestJSON-642626068-project] 10.222.0.78 "GET /compute/v2.1/os-snapshots/47242baa-36ff-46d5-ab50-33dc746c2b63" status: 200 len: 286 microversion: 2.1 time: 0.182714 Feb 17 04:28:29.222604 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 8/16] 10.222.0.78 () {58 vars in 1241 bytes} [Wed Feb 17 04:28:29 2021] GET /compute/v2.1/os-snapshots/47242baa-36ff-46d5-ab50-33dc746c2b63 => generated 286 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 17 04:28:29.606560 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-144c58d2-b678-40d2-b5ff-04cec2a5426d tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d68d4a6c12e4331b8df8191cdd7a669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2a1ca6347d4278899a1cc009d87d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:28:29.657478 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-144c58d2-b678-40d2-b5ff-04cec2a5426d tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] 10.222.0.78 "GET /compute/v2.1/servers/21edfff0-5c5c-43a5-a4e5-22ddd5f452eb" status: 200 len: 1218 microversion: 2.1 time: 0.503705 Feb 17 04:28:29.666082 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 9/17] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:28:29 2021] GET /compute/v2.1/servers/21edfff0-5c5c-43a5-a4e5-22ddd5f452eb => generated 1218 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:28:29.765356 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-fc9e74c4-2346-42de-b763-a8c3eab8afe5 tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:28:29.766097 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-fc9e74c4-2346-42de-b763-a8c3eab8afe5 tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] [instance: fc3441c6-9dd2-4b3e-8aea-c1ea786a445e] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:28:29.802186 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-fc9e74c4-2346-42de-b763-a8c3eab8afe5 tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:28:29.803672 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-fc9e74c4-2346-42de-b763-a8c3eab8afe5 tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:28:29.805656 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-fc9e74c4-2346-42de-b763-a8c3eab8afe5 tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:28:29.807584 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-fc9e74c4-2346-42de-b763-a8c3eab8afe5 tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:28:30.235359 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-398294f2-1c80-4308-9d46-bf354e472c8b tempest-VolumesSnapshotsTestJSON-642626068 tempest-VolumesSnapshotsTestJSON-642626068-project] Calling method '.version_select at 0x7f57c9c891e0>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:28:30.341635 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-fc9e74c4-2346-42de-b763-a8c3eab8afe5 tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b59e91a6423843459340bbd8d875007e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd156b69e0ec24a8782b15c83a8c4cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:28:30.355850 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-398294f2-1c80-4308-9d46-bf354e472c8b tempest-VolumesSnapshotsTestJSON-642626068 tempest-VolumesSnapshotsTestJSON-642626068-project] 10.222.0.78 "GET /compute/v2.1/os-snapshots/47242baa-36ff-46d5-ab50-33dc746c2b63" status: 200 len: 287 microversion: 2.1 time: 0.124663 Feb 17 04:28:30.356708 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 10/18] 10.222.0.78 () {58 vars in 1241 bytes} [Wed Feb 17 04:28:30 2021] GET /compute/v2.1/os-snapshots/47242baa-36ff-46d5-ab50-33dc746c2b63 => generated 287 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:28:30.371658 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-fc9e74c4-2346-42de-b763-a8c3eab8afe5 tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] 10.222.0.78 "GET /compute/v2.1/servers/fc3441c6-9dd2-4b3e-8aea-c1ea786a445e" status: 200 len: 1266 microversion: 2.1 time: 0.610732 Feb 17 04:28:30.372291 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-9281551a-0e85-483a-97f3-28285b3d03b1 tempest-VolumesSnapshotsTestJSON-642626068 tempest-VolumesSnapshotsTestJSON-642626068-project] Calling method '.version_select at 0x7f57c9caf488>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:28:30.373208 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 9/19] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:28:29 2021] GET /compute/v2.1/servers/fc3441c6-9dd2-4b3e-8aea-c1ea786a445e => generated 1266 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:28:30.653617 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-9281551a-0e85-483a-97f3-28285b3d03b1 tempest-VolumesSnapshotsTestJSON-642626068 tempest-VolumesSnapshotsTestJSON-642626068-project] 10.222.0.78 "DELETE /compute/v2.1/os-snapshots/47242baa-36ff-46d5-ab50-33dc746c2b63" status: 202 len: 0 microversion: 2.1 time: 0.286216 Feb 17 04:28:30.654480 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 11/20] 10.222.0.78 () {58 vars in 1244 bytes} [Wed Feb 17 04:28:30 2021] DELETE /compute/v2.1/os-snapshots/47242baa-36ff-46d5-ab50-33dc746c2b63 => generated 0 bytes in 288 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:28:30.678729 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-6b406e01-2968-44a0-b29a-d857c1724bb4 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:28:30.679307 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-474b854f-5c8b-4f33-905b-a99f248cccf3 tempest-VolumesSnapshotsTestJSON-642626068 tempest-VolumesSnapshotsTestJSON-642626068-project] Calling method '.version_select at 0x7f57c93ea378>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:28:30.692191 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-6b406e01-2968-44a0-b29a-d857c1724bb4 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] [instance: 21edfff0-5c5c-43a5-a4e5-22ddd5f452eb] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:28:30.745767 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-6b406e01-2968-44a0-b29a-d857c1724bb4 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:28:30.754511 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-6b406e01-2968-44a0-b29a-d857c1724bb4 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:28:30.755470 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-6b406e01-2968-44a0-b29a-d857c1724bb4 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:28:30.755967 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-6b406e01-2968-44a0-b29a-d857c1724bb4 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:28:30.877473 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-474b854f-5c8b-4f33-905b-a99f248cccf3 tempest-VolumesSnapshotsTestJSON-642626068 tempest-VolumesSnapshotsTestJSON-642626068-project] 10.222.0.78 "GET /compute/v2.1/os-snapshots/47242baa-36ff-46d5-ab50-33dc746c2b63" status: 200 len: 286 microversion: 2.1 time: 0.216715 Feb 17 04:28:30.884780 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 10/21] 10.222.0.78 () {58 vars in 1241 bytes} [Wed Feb 17 04:28:30 2021] GET /compute/v2.1/os-snapshots/47242baa-36ff-46d5-ab50-33dc746c2b63 => generated 286 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:28:30.934318 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-3f8d7d6c-e6d0-4309-a9a7-2ed46a59397e tempest-VolumesTestJSON-920007498 tempest-VolumesTestJSON-920007498-project] Calling method '.version_select at 0x7f57c93d67b8>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:28:31.179536 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-3f8d7d6c-e6d0-4309-a9a7-2ed46a59397e tempest-VolumesTestJSON-920007498 tempest-VolumesTestJSON-920007498-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/c60e7e90-07cb-47f6-b5a1-eae00982e8db" status: 200 len: 351 microversion: 2.1 time: 0.245574 Feb 17 04:28:31.186568 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 11/22] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Feb 17 04:28:30 2021] GET /compute/v2.1/os-volumes/c60e7e90-07cb-47f6-b5a1-eae00982e8db => generated 351 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:28:31.392540 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-2d83ddcc-0ebe-4d13-a311-de27c45e0ce9 tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:28:31.393307 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-2d83ddcc-0ebe-4d13-a311-de27c45e0ce9 tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] [instance: fc3441c6-9dd2-4b3e-8aea-c1ea786a445e] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:28:31.405609 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-2d83ddcc-0ebe-4d13-a311-de27c45e0ce9 tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:28:31.407841 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-2d83ddcc-0ebe-4d13-a311-de27c45e0ce9 tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:28:31.414416 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-2d83ddcc-0ebe-4d13-a311-de27c45e0ce9 tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:28:31.418099 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-2d83ddcc-0ebe-4d13-a311-de27c45e0ce9 tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:28:31.623945 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-6b406e01-2968-44a0-b29a-d857c1724bb4 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d68d4a6c12e4331b8df8191cdd7a669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2a1ca6347d4278899a1cc009d87d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:28:31.636971 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-6b406e01-2968-44a0-b29a-d857c1724bb4 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] 10.222.0.78 "GET /compute/v2.1/servers/21edfff0-5c5c-43a5-a4e5-22ddd5f452eb" status: 200 len: 1222 microversion: 2.1 time: 0.965912 Feb 17 04:28:31.647345 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 12/23] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:28:30 2021] GET /compute/v2.1/servers/21edfff0-5c5c-43a5-a4e5-22ddd5f452eb => generated 1222 bytes in 977 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:28:31.890777 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-5d43ffb9-99d5-40ca-bff1-de094927b208 tempest-VolumesSnapshotsTestJSON-642626068 tempest-VolumesSnapshotsTestJSON-642626068-project] Calling method '.version_select at 0x7f57c93d1620>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:28:31.951891 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-2d83ddcc-0ebe-4d13-a311-de27c45e0ce9 tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b59e91a6423843459340bbd8d875007e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd156b69e0ec24a8782b15c83a8c4cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:28:31.964105 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-2d83ddcc-0ebe-4d13-a311-de27c45e0ce9 tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] 10.222.0.78 "GET /compute/v2.1/servers/fc3441c6-9dd2-4b3e-8aea-c1ea786a445e" status: 200 len: 1272 microversion: 2.1 time: 0.576155 Feb 17 04:28:31.967882 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 12/24] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:28:31 2021] GET /compute/v2.1/servers/fc3441c6-9dd2-4b3e-8aea-c1ea786a445e => generated 1272 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:28:32.149550 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.wsgi [None req-5d43ffb9-99d5-40ca-bff1-de094927b208 tempest-VolumesSnapshotsTestJSON-642626068 tempest-VolumesSnapshotsTestJSON-642626068-project] HTTP exception thrown: Snapshot 47242baa-36ff-46d5-ab50-33dc746c2b63 could not be found. Feb 17 04:28:32.150780 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-5d43ffb9-99d5-40ca-bff1-de094927b208 tempest-VolumesSnapshotsTestJSON-642626068 tempest-VolumesSnapshotsTestJSON-642626068-project] Returning 404 to user: Snapshot 47242baa-36ff-46d5-ab50-33dc746c2b63 could not be found. {{(pid=98179) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 17 04:28:32.152421 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-5d43ffb9-99d5-40ca-bff1-de094927b208 tempest-VolumesSnapshotsTestJSON-642626068 tempest-VolumesSnapshotsTestJSON-642626068-project] 10.222.0.78 "GET /compute/v2.1/os-snapshots/47242baa-36ff-46d5-ab50-33dc746c2b63" status: 404 len: 111 microversion: 2.1 time: 0.264961 Feb 17 04:28:32.162911 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-04b181fa-5939-45d5-8be2-3906f24b2963 tempest-VolumesSnapshotsTestJSON-642626068 tempest-VolumesSnapshotsTestJSON-642626068-project] Calling method '.version_select at 0x7f57c93f4598>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:28:32.167503 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 13/25] 10.222.0.78 () {58 vars in 1241 bytes} [Wed Feb 17 04:28:31 2021] GET /compute/v2.1/os-snapshots/47242baa-36ff-46d5-ab50-33dc746c2b63 => generated 111 bytes in 281 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Feb 17 04:28:32.665105 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-24ad298d-e327-4803-b649-9c611c63c3dc tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:28:32.667924 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-24ad298d-e327-4803-b649-9c611c63c3dc tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] [instance: 21edfff0-5c5c-43a5-a4e5-22ddd5f452eb] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:28:32.692295 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-24ad298d-e327-4803-b649-9c611c63c3dc tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:28:32.693151 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-24ad298d-e327-4803-b649-9c611c63c3dc tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:28:32.694311 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-24ad298d-e327-4803-b649-9c611c63c3dc tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:28:32.694991 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-24ad298d-e327-4803-b649-9c611c63c3dc tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:28:32.858439 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-04b181fa-5939-45d5-8be2-3906f24b2963 tempest-VolumesSnapshotsTestJSON-642626068 tempest-VolumesSnapshotsTestJSON-642626068-project] 10.222.0.78 "DELETE /compute/v2.1/os-volumes/6be7fb79-8d72-430d-b434-ba011bbacfdb" status: 202 len: 0 microversion: 2.1 time: 0.700055 Feb 17 04:28:32.864400 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 13/26] 10.222.0.78 () {58 vars in 1238 bytes} [Wed Feb 17 04:28:32 2021] DELETE /compute/v2.1/os-volumes/6be7fb79-8d72-430d-b434-ba011bbacfdb => generated 0 bytes in 707 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:28:32.872200 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-8430da2d-15bb-4d82-95ed-6b3ca35c921c tempest-VolumesSnapshotsTestJSON-642626068 tempest-VolumesSnapshotsTestJSON-642626068-project] Calling method '.version_select at 0x7f57c93f4bf8>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:28:33.082664 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-8430da2d-15bb-4d82-95ed-6b3ca35c921c tempest-VolumesSnapshotsTestJSON-642626068 tempest-VolumesSnapshotsTestJSON-642626068-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/6be7fb79-8d72-430d-b434-ba011bbacfdb" status: 200 len: 345 microversion: 2.1 time: 0.216208 Feb 17 04:28:33.089351 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 14/27] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Feb 17 04:28:32 2021] GET /compute/v2.1/os-volumes/6be7fb79-8d72-430d-b434-ba011bbacfdb => generated 345 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:28:33.094954 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-2a62bdb9-e240-4b53-8f85-708b6e9cf5ab tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:28:33.096068 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-2a62bdb9-e240-4b53-8f85-708b6e9cf5ab tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] [instance: fc3441c6-9dd2-4b3e-8aea-c1ea786a445e] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:28:33.132698 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-2a62bdb9-e240-4b53-8f85-708b6e9cf5ab tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:28:33.133520 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-2a62bdb9-e240-4b53-8f85-708b6e9cf5ab tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:28:33.135479 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-2a62bdb9-e240-4b53-8f85-708b6e9cf5ab tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:28:33.136493 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-2a62bdb9-e240-4b53-8f85-708b6e9cf5ab tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:28:33.168770 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-24ad298d-e327-4803-b649-9c611c63c3dc tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d68d4a6c12e4331b8df8191cdd7a669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2a1ca6347d4278899a1cc009d87d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:28:33.187982 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-24ad298d-e327-4803-b649-9c611c63c3dc tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] 10.222.0.78 "GET /compute/v2.1/servers/21edfff0-5c5c-43a5-a4e5-22ddd5f452eb" status: 200 len: 1276 microversion: 2.1 time: 0.525377 Feb 17 04:28:33.201313 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 14/28] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:28:32 2021] GET /compute/v2.1/servers/21edfff0-5c5c-43a5-a4e5-22ddd5f452eb => generated 1276 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:28:33.474171 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-2a62bdb9-e240-4b53-8f85-708b6e9cf5ab tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b59e91a6423843459340bbd8d875007e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd156b69e0ec24a8782b15c83a8c4cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:28:33.502126 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-2a62bdb9-e240-4b53-8f85-708b6e9cf5ab tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] 10.222.0.78 "GET /compute/v2.1/servers/fc3441c6-9dd2-4b3e-8aea-c1ea786a445e" status: 200 len: 1272 microversion: 2.1 time: 0.411294 Feb 17 04:28:33.502776 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 15/29] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:28:33 2021] GET /compute/v2.1/servers/fc3441c6-9dd2-4b3e-8aea-c1ea786a445e => generated 1272 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:28:33.782091 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-76f20e18-e1bc-46c4-9c29-6cca4dc4c138 tempest-VolumesTestJSON-920007498 tempest-VolumesTestJSON-920007498-project] Calling method '.version_select at 0x7f57c93b7158>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:28:34.097168 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-e783331b-6d4f-4ebd-acf1-af4e9419a23b tempest-VolumesSnapshotsTestJSON-642626068 tempest-VolumesSnapshotsTestJSON-642626068-project] Calling method '.version_select at 0x7f57c93ea1e0>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:28:34.160261 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-76f20e18-e1bc-46c4-9c29-6cca4dc4c138 tempest-VolumesTestJSON-920007498 tempest-VolumesTestJSON-920007498-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/be9bc8f2-2aad-4ea2-866c-f2c96e91c041" status: 200 len: 351 microversion: 2.1 time: 0.381997 Feb 17 04:28:34.161534 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 15/30] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Feb 17 04:28:33 2021] GET /compute/v2.1/os-volumes/be9bc8f2-2aad-4ea2-866c-f2c96e91c041 => generated 351 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:28:34.176175 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-28acec52-aa87-4f58-accc-a25363f7c441 tempest-VolumesTestJSON-920007498 tempest-VolumesTestJSON-920007498-project] Calling method '.version_select at 0x7f57c93b7620>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:28:34.354373 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.wsgi [None req-e783331b-6d4f-4ebd-acf1-af4e9419a23b tempest-VolumesSnapshotsTestJSON-642626068 tempest-VolumesSnapshotsTestJSON-642626068-project] HTTP exception thrown: Volume 6be7fb79-8d72-430d-b434-ba011bbacfdb could not be found. Feb 17 04:28:34.355648 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-e783331b-6d4f-4ebd-acf1-af4e9419a23b tempest-VolumesSnapshotsTestJSON-642626068 tempest-VolumesSnapshotsTestJSON-642626068-project] Returning 404 to user: Volume 6be7fb79-8d72-430d-b434-ba011bbacfdb could not be found. {{(pid=98178) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 17 04:28:34.357164 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-e783331b-6d4f-4ebd-acf1-af4e9419a23b tempest-VolumesSnapshotsTestJSON-642626068 tempest-VolumesSnapshotsTestJSON-642626068-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/6be7fb79-8d72-430d-b434-ba011bbacfdb" status: 404 len: 109 microversion: 2.1 time: 0.264744 Feb 17 04:28:34.358166 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 16/31] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Feb 17 04:28:34 2021] GET /compute/v2.1/os-volumes/6be7fb79-8d72-430d-b434-ba011bbacfdb => generated 109 bytes in 266 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 17 04:28:34.368676 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-251f72ee-095b-4f30-9618-aa9605fd930f tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:28:34.375835 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-251f72ee-095b-4f30-9618-aa9605fd930f tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] [instance: 21edfff0-5c5c-43a5-a4e5-22ddd5f452eb] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:28:34.392833 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-251f72ee-095b-4f30-9618-aa9605fd930f tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:28:34.397631 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-251f72ee-095b-4f30-9618-aa9605fd930f tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:28:34.398907 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-251f72ee-095b-4f30-9618-aa9605fd930f tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:28:34.399668 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-251f72ee-095b-4f30-9618-aa9605fd930f tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:28:34.550343 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-28acec52-aa87-4f58-accc-a25363f7c441 tempest-VolumesTestJSON-920007498 tempest-VolumesTestJSON-920007498-project] 10.222.0.78 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.378497 Feb 17 04:28:34.551186 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 16/32] 10.222.0.78 () {58 vars in 1124 bytes} [Wed Feb 17 04:28:34 2021] GET /compute/v2.1/os-volumes => generated 1035 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:28:34.559906 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-300c75b0-6eed-404c-9ab5-8ebded6d9195 tempest-VolumesSnapshotsTestJSON-642626068 tempest-VolumesSnapshotsTestJSON-642626068-project] Calling method '.version_select at 0x7f57c93bbea0>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:28:34.883538 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.wsgi [None req-300c75b0-6eed-404c-9ab5-8ebded6d9195 tempest-VolumesSnapshotsTestJSON-642626068 tempest-VolumesSnapshotsTestJSON-642626068-project] HTTP exception thrown: Volume 6be7fb79-8d72-430d-b434-ba011bbacfdb could not be found. Feb 17 04:28:34.886920 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-300c75b0-6eed-404c-9ab5-8ebded6d9195 tempest-VolumesSnapshotsTestJSON-642626068 tempest-VolumesSnapshotsTestJSON-642626068-project] Returning 404 to user: Volume 6be7fb79-8d72-430d-b434-ba011bbacfdb could not be found. {{(pid=98179) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 17 04:28:34.888199 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-300c75b0-6eed-404c-9ab5-8ebded6d9195 tempest-VolumesSnapshotsTestJSON-642626068 tempest-VolumesSnapshotsTestJSON-642626068-project] 10.222.0.78 "DELETE /compute/v2.1/os-volumes/6be7fb79-8d72-430d-b434-ba011bbacfdb" status: 404 len: 109 microversion: 2.1 time: 0.335865 Feb 17 04:28:34.892437 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 17/33] 10.222.0.78 () {58 vars in 1238 bytes} [Wed Feb 17 04:28:34 2021] DELETE /compute/v2.1/os-volumes/6be7fb79-8d72-430d-b434-ba011bbacfdb => generated 109 bytes in 341 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 17 04:28:34.903747 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-029e4f4c-bbcb-4e8c-bd44-9eea4dd446c4 tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:28:34.911845 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-029e4f4c-bbcb-4e8c-bd44-9eea4dd446c4 tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] [instance: fc3441c6-9dd2-4b3e-8aea-c1ea786a445e] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:28:34.945760 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-029e4f4c-bbcb-4e8c-bd44-9eea4dd446c4 tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:28:34.950477 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-029e4f4c-bbcb-4e8c-bd44-9eea4dd446c4 tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:28:34.951754 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-029e4f4c-bbcb-4e8c-bd44-9eea4dd446c4 tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:28:34.953317 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-029e4f4c-bbcb-4e8c-bd44-9eea4dd446c4 tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:28:35.565904 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-251f72ee-095b-4f30-9618-aa9605fd930f tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d68d4a6c12e4331b8df8191cdd7a669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2a1ca6347d4278899a1cc009d87d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:28:35.584298 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-251f72ee-095b-4f30-9618-aa9605fd930f tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] 10.222.0.78 "GET /compute/v2.1/servers/21edfff0-5c5c-43a5-a4e5-22ddd5f452eb" status: 200 len: 1276 microversion: 2.1 time: 1.224370 Feb 17 04:28:35.584749 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-029e4f4c-bbcb-4e8c-bd44-9eea4dd446c4 tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b59e91a6423843459340bbd8d875007e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd156b69e0ec24a8782b15c83a8c4cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:28:35.587988 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 17/34] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:28:34 2021] GET /compute/v2.1/servers/21edfff0-5c5c-43a5-a4e5-22ddd5f452eb => generated 1276 bytes in 1229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:28:35.595531 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-029e4f4c-bbcb-4e8c-bd44-9eea4dd446c4 tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] 10.222.0.78 "GET /compute/v2.1/servers/fc3441c6-9dd2-4b3e-8aea-c1ea786a445e" status: 200 len: 1314 microversion: 2.1 time: 0.701446 Feb 17 04:28:35.601792 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-de1b564b-805a-4e8a-a23c-fdd6ae8d19c1 tempest-VolumesTestJSON-920007498 tempest-VolumesTestJSON-920007498-project] Calling method '.version_select at 0x7f57c93ea0d0>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:28:35.602591 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 18/35] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:28:34 2021] GET /compute/v2.1/servers/fc3441c6-9dd2-4b3e-8aea-c1ea786a445e => generated 1314 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:28:35.620379 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-2850f9f4-7a99-4bb5-a8d3-3240f7e19c60 tempest-VolumesSnapshotsTestJSON-642626068 tempest-VolumesSnapshotsTestJSON-642626068-project] Calling method '.version_select at 0x7f57c93bbe18>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:28:35.798871 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-de1b564b-805a-4e8a-a23c-fdd6ae8d19c1 tempest-VolumesTestJSON-920007498 tempest-VolumesTestJSON-920007498-project] 10.222.0.78 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.208530 Feb 17 04:28:35.799909 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 18/36] 10.222.0.78 () {58 vars in 1139 bytes} [Wed Feb 17 04:28:35 2021] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:28:35.824744 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.wsgi [None req-2850f9f4-7a99-4bb5-a8d3-3240f7e19c60 tempest-VolumesSnapshotsTestJSON-642626068 tempest-VolumesSnapshotsTestJSON-642626068-project] HTTP exception thrown: Volume 6be7fb79-8d72-430d-b434-ba011bbacfdb could not be found. Feb 17 04:28:35.825933 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-2850f9f4-7a99-4bb5-a8d3-3240f7e19c60 tempest-VolumesSnapshotsTestJSON-642626068 tempest-VolumesSnapshotsTestJSON-642626068-project] Returning 404 to user: Volume 6be7fb79-8d72-430d-b434-ba011bbacfdb could not be found. {{(pid=98179) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 17 04:28:35.826956 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-2850f9f4-7a99-4bb5-a8d3-3240f7e19c60 tempest-VolumesSnapshotsTestJSON-642626068 tempest-VolumesSnapshotsTestJSON-642626068-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/6be7fb79-8d72-430d-b434-ba011bbacfdb" status: 404 len: 109 microversion: 2.1 time: 0.222588 Feb 17 04:28:35.827898 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 19/37] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Feb 17 04:28:35 2021] GET /compute/v2.1/os-volumes/6be7fb79-8d72-430d-b434-ba011bbacfdb => generated 109 bytes in 225 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 17 04:28:35.839393 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-55cdd0bb-9780-401a-b0cb-66c674bdff93 tempest-VolumesTestJSON-920007498 tempest-VolumesTestJSON-920007498-project] Calling method '.version_select at 0x7f57c93bbea0>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:28:36.180180 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-55cdd0bb-9780-401a-b0cb-66c674bdff93 tempest-VolumesTestJSON-920007498 tempest-VolumesTestJSON-920007498-project] 10.222.0.78 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.350971 Feb 17 04:28:36.180936 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 20/38] 10.222.0.78 () {58 vars in 1124 bytes} [Wed Feb 17 04:28:35 2021] GET /compute/v2.1/os-volumes => generated 1035 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:28:36.193296 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-1c9df880-5381-4e32-842e-c9870c7925ed tempest-VolumesTestJSON-920007498 tempest-VolumesTestJSON-920007498-project] Calling method '.version_select at 0x7f57c93b70d0>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:28:36.326636 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-d9d71a35-924a-4ef3-8392-0b21d3cdeccc tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Action: 'create', calling method: .version_select at 0x7f57c93f4840>, body: {"keypair": {"name": "tempest-keypair-1175688493"}} {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:28:36.525754 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.quota [None req-d9d71a35-924a-4ef3-8392-0b21d3cdeccc tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Getting quotas for project a2c8716a46f54187902492f8ce162f58. Resources: {'key_pairs'} {{(pid=98178) _get_quotas /opt/stack/nova/nova/quota.py:388}} Feb 17 04:28:36.551159 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.quota [None req-d9d71a35-924a-4ef3-8392-0b21d3cdeccc tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Getting quotas for user 2deb449189ba427a9b8fcb0e21f22566 and project a2c8716a46f54187902492f8ce162f58. Resources: {'key_pairs'} {{(pid=98178) _get_quotas /opt/stack/nova/nova/quota.py:380}} Feb 17 04:28:36.567663 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-1c9df880-5381-4e32-842e-c9870c7925ed tempest-VolumesTestJSON-920007498 tempest-VolumesTestJSON-920007498-project] 10.222.0.78 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.378159 Feb 17 04:28:36.568440 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 21/39] 10.222.0.78 () {58 vars in 1157 bytes} [Wed Feb 17 04:28:36 2021] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:28:36.581695 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-dc5967d7-a147-4c3b-accf-9e1093adc168 tempest-VolumesTestJSON-920007498 tempest-VolumesTestJSON-920007498-project] Calling method '.version_select at 0x7f57c93b7c80>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:28:36.875406 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-dc5967d7-a147-4c3b-accf-9e1093adc168 tempest-VolumesTestJSON-920007498 tempest-VolumesTestJSON-920007498-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.293472 Feb 17 04:28:36.878093 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 22/40] 10.222.0.78 () {58 vars in 1160 bytes} [Wed Feb 17 04:28:36 2021] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:28:36.892675 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-28aaea62-de55-4dce-80b4-5ecd0d365f73 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:28:36.898804 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-28aaea62-de55-4dce-80b4-5ecd0d365f73 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] [instance: 21edfff0-5c5c-43a5-a4e5-22ddd5f452eb] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:28:36.945749 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-28aaea62-de55-4dce-80b4-5ecd0d365f73 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:28:36.953804 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-28aaea62-de55-4dce-80b4-5ecd0d365f73 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:28:36.958313 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-28aaea62-de55-4dce-80b4-5ecd0d365f73 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:28:36.959564 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-28aaea62-de55-4dce-80b4-5ecd0d365f73 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:28:37.745547 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.quota [None req-d9d71a35-924a-4ef3-8392-0b21d3cdeccc tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Getting quotas for project a2c8716a46f54187902492f8ce162f58. Resources: {'key_pairs'} {{(pid=98178) _get_quotas /opt/stack/nova/nova/quota.py:388}} Feb 17 04:28:37.755288 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.quota [None req-d9d71a35-924a-4ef3-8392-0b21d3cdeccc tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Getting quotas for user 2deb449189ba427a9b8fcb0e21f22566 and project a2c8716a46f54187902492f8ce162f58. Resources: {'key_pairs'} {{(pid=98178) _get_quotas /opt/stack/nova/nova/quota.py:380}} Feb 17 04:28:37.805503 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-d9d71a35-924a-4ef3-8392-0b21d3cdeccc tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 2305 microversion: 2.1 time: 2.004059 Feb 17 04:28:37.806155 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 19/41] 10.222.0.78 () {60 vars in 1148 bytes} [Wed Feb 17 04:28:35 2021] POST /compute/v2.1/os-keypairs => generated 2305 bytes in 2005 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:28:37.811982 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-b43f7a8a-23fb-4c19-8c01-dbe7b41aa9ad tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:28:37.825168 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-b43f7a8a-23fb-4c19-8c01-dbe7b41aa9ad tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] [instance: fc3441c6-9dd2-4b3e-8aea-c1ea786a445e] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:28:37.856499 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-b43f7a8a-23fb-4c19-8c01-dbe7b41aa9ad tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:28:37.856934 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-b43f7a8a-23fb-4c19-8c01-dbe7b41aa9ad tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:28:37.858187 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-b43f7a8a-23fb-4c19-8c01-dbe7b41aa9ad tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:28:37.858833 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-b43f7a8a-23fb-4c19-8c01-dbe7b41aa9ad tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:28:37.884195 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-28aaea62-de55-4dce-80b4-5ecd0d365f73 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d68d4a6c12e4331b8df8191cdd7a669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2a1ca6347d4278899a1cc009d87d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:28:37.904924 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-28aaea62-de55-4dce-80b4-5ecd0d365f73 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] 10.222.0.78 "GET /compute/v2.1/servers/21edfff0-5c5c-43a5-a4e5-22ddd5f452eb" status: 200 len: 1276 microversion: 2.1 time: 1.016842 Feb 17 04:28:37.910256 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 23/42] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:28:36 2021] GET /compute/v2.1/servers/21edfff0-5c5c-43a5-a4e5-22ddd5f452eb => generated 1276 bytes in 1023 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:28:37.929257 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-563ca54d-4860-4407-9de9-8f59fc1b5861 tempest-VolumesTestJSON-920007498 tempest-VolumesTestJSON-920007498-project] Calling method '.version_select at 0x7f57c93bbea0>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:28:38.175013 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-563ca54d-4860-4407-9de9-8f59fc1b5861 tempest-VolumesTestJSON-920007498 tempest-VolumesTestJSON-920007498-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.250993 Feb 17 04:28:38.175763 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 24/43] 10.222.0.78 () {58 vars in 1145 bytes} [Wed Feb 17 04:28:37 2021] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:28:38.188288 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-12b88c6b-8157-4aa1-b0c5-1fed72d9ffde tempest-VolumesTestJSON-920007498 tempest-VolumesTestJSON-920007498-project] Calling method '.version_select at 0x7f57c93b7488>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:28:38.482004 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-12b88c6b-8157-4aa1-b0c5-1fed72d9ffde tempest-VolumesTestJSON-920007498 tempest-VolumesTestJSON-920007498-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.297718 Feb 17 04:28:38.482815 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 25/44] 10.222.0.78 () {58 vars in 1178 bytes} [Wed Feb 17 04:28:38 2021] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:28:38.497120 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-20b602a5-15ef-4dd5-9405-903966bb848b tempest-VolumesTestJSON-920007498 tempest-VolumesTestJSON-920007498-project] Calling method '.version_select at 0x7f57c93bbc80>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:28:38.773781 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-20b602a5-15ef-4dd5-9405-903966bb848b tempest-VolumesTestJSON-920007498 tempest-VolumesTestJSON-920007498-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.280896 Feb 17 04:28:38.774361 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 26/45] 10.222.0.78 () {58 vars in 1145 bytes} [Wed Feb 17 04:28:38 2021] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:28:38.930001 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-85750639-5e49-4016-a4c0-aa7fbcc2b3f4 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:28:38.930684 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-85750639-5e49-4016-a4c0-aa7fbcc2b3f4 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] [instance: 21edfff0-5c5c-43a5-a4e5-22ddd5f452eb] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:28:38.951420 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-85750639-5e49-4016-a4c0-aa7fbcc2b3f4 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:28:38.951935 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-85750639-5e49-4016-a4c0-aa7fbcc2b3f4 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:28:38.960214 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-85750639-5e49-4016-a4c0-aa7fbcc2b3f4 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:28:38.960824 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-85750639-5e49-4016-a4c0-aa7fbcc2b3f4 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:28:39.422565 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-85750639-5e49-4016-a4c0-aa7fbcc2b3f4 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d68d4a6c12e4331b8df8191cdd7a669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2a1ca6347d4278899a1cc009d87d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:28:39.454850 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-85750639-5e49-4016-a4c0-aa7fbcc2b3f4 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] 10.222.0.78 "GET /compute/v2.1/servers/21edfff0-5c5c-43a5-a4e5-22ddd5f452eb" status: 200 len: 1276 microversion: 2.1 time: 0.528636 Feb 17 04:28:39.455560 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 27/46] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:28:38 2021] GET /compute/v2.1/servers/21edfff0-5c5c-43a5-a4e5-22ddd5f452eb => generated 1276 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:28:40.474456 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-a2dab8df-e508-40b2-b3a4-9e655b52333b tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:28:40.475577 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-a2dab8df-e508-40b2-b3a4-9e655b52333b tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] [instance: 21edfff0-5c5c-43a5-a4e5-22ddd5f452eb] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:28:40.497248 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-a2dab8df-e508-40b2-b3a4-9e655b52333b tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:28:40.499225 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-a2dab8df-e508-40b2-b3a4-9e655b52333b tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:28:40.500077 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-a2dab8df-e508-40b2-b3a4-9e655b52333b tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:28:40.507444 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-a2dab8df-e508-40b2-b3a4-9e655b52333b tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:28:40.559462 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-b43f7a8a-23fb-4c19-8c01-dbe7b41aa9ad tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b59e91a6423843459340bbd8d875007e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd156b69e0ec24a8782b15c83a8c4cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:28:40.577181 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-b43f7a8a-23fb-4c19-8c01-dbe7b41aa9ad tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] 10.222.0.78 "GET /compute/v2.1/servers/fc3441c6-9dd2-4b3e-8aea-c1ea786a445e" status: 200 len: 1314 microversion: 2.1 time: 2.768849 Feb 17 04:28:40.581990 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 20/47] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:28:37 2021] GET /compute/v2.1/servers/fc3441c6-9dd2-4b3e-8aea-c1ea786a445e => generated 1314 bytes in 2775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:28:41.608002 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-034d900b-9477-42ea-97d1-8ae0dc00e75f tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:28:41.608002 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-034d900b-9477-42ea-97d1-8ae0dc00e75f tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] [instance: fc3441c6-9dd2-4b3e-8aea-c1ea786a445e] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:28:41.632390 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-034d900b-9477-42ea-97d1-8ae0dc00e75f tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:28:41.635194 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-034d900b-9477-42ea-97d1-8ae0dc00e75f tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:28:41.641640 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-034d900b-9477-42ea-97d1-8ae0dc00e75f tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:28:41.651972 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-034d900b-9477-42ea-97d1-8ae0dc00e75f tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:28:42.190879 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-a2dab8df-e508-40b2-b3a4-9e655b52333b tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d68d4a6c12e4331b8df8191cdd7a669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2a1ca6347d4278899a1cc009d87d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:28:42.218566 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-a2dab8df-e508-40b2-b3a4-9e655b52333b tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] 10.222.0.78 "GET /compute/v2.1/servers/21edfff0-5c5c-43a5-a4e5-22ddd5f452eb" status: 200 len: 1318 microversion: 2.1 time: 1.741808 Feb 17 04:28:42.219442 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 28/48] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:28:40 2021] GET /compute/v2.1/servers/21edfff0-5c5c-43a5-a4e5-22ddd5f452eb => generated 1318 bytes in 1751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:28:43.122847 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-034d900b-9477-42ea-97d1-8ae0dc00e75f tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b59e91a6423843459340bbd8d875007e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd156b69e0ec24a8782b15c83a8c4cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:28:43.148508 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-034d900b-9477-42ea-97d1-8ae0dc00e75f tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] 10.222.0.78 "GET /compute/v2.1/servers/fc3441c6-9dd2-4b3e-8aea-c1ea786a445e" status: 200 len: 1314 microversion: 2.1 time: 1.553174 Feb 17 04:28:43.149166 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 21/49] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:28:41 2021] GET /compute/v2.1/servers/fc3441c6-9dd2-4b3e-8aea-c1ea786a445e => generated 1314 bytes in 1555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:28:43.238661 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-c4e6fa3d-30cd-434a-bcfd-d343415a965b tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:28:43.239401 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-c4e6fa3d-30cd-434a-bcfd-d343415a965b tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] [instance: 21edfff0-5c5c-43a5-a4e5-22ddd5f452eb] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:28:43.262098 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-c4e6fa3d-30cd-434a-bcfd-d343415a965b tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:28:43.262648 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-c4e6fa3d-30cd-434a-bcfd-d343415a965b tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:28:43.263571 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-c4e6fa3d-30cd-434a-bcfd-d343415a965b tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:28:43.264079 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-c4e6fa3d-30cd-434a-bcfd-d343415a965b tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:28:43.350693 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-da75a557-e8e5-464c-b1d7-64abd513bbea tempest-VolumesNegativeTest-1863895899 tempest-VolumesNegativeTest-1863895899-project] Action: 'create', calling method: .version_select at 0x7f57c93b72f0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-522160749", "metadata": {"Type": "work"}}} {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:28:43.352371 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-da75a557-e8e5-464c-b1d7-64abd513bbea tempest-VolumesNegativeTest-1863895899 tempest-VolumesNegativeTest-1863895899-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=98179) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 17 04:28:43.353890 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-da75a557-e8e5-464c-b1d7-64abd513bbea tempest-VolumesNegativeTest-1863895899 tempest-VolumesNegativeTest-1863895899-project] 10.222.0.78 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.307073 Feb 17 04:28:43.354656 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 29/50] 10.222.0.78 () {60 vars in 1146 bytes} [Wed Feb 17 04:28:43 2021] POST /compute/v2.1/os-volumes => generated 127 bytes in 308 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Feb 17 04:28:43.370469 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-86fea526-5a1b-4e46-8e51-4b92297ac310 tempest-VolumesNegativeTest-1863895899 tempest-VolumesNegativeTest-1863895899-project] Action: 'create', calling method: .version_select at 0x7f57c93b7158>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-577381704", "metadata": {"Type": "work"}}} {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:28:43.372806 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-86fea526-5a1b-4e46-8e51-4b92297ac310 tempest-VolumesNegativeTest-1863895899 tempest-VolumesNegativeTest-1863895899-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=98179) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 17 04:28:43.377753 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-86fea526-5a1b-4e46-8e51-4b92297ac310 tempest-VolumesNegativeTest-1863895899 tempest-VolumesNegativeTest-1863895899-project] 10.222.0.78 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.016597 Feb 17 04:28:43.378603 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 30/51] 10.222.0.78 () {60 vars in 1146 bytes} [Wed Feb 17 04:28:43 2021] POST /compute/v2.1/os-volumes => generated 125 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Feb 17 04:28:43.388743 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-8dc57d76-4775-4c43-b21b-3b7b135f9e07 tempest-VolumesNegativeTest-1863895899 tempest-VolumesNegativeTest-1863895899-project] Action: 'create', calling method: .version_select at 0x7f57c93b7d90>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-751987091", "metadata": {"Type": "work"}}} {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:28:43.392784 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-8dc57d76-4775-4c43-b21b-3b7b135f9e07 tempest-VolumesNegativeTest-1863895899 tempest-VolumesNegativeTest-1863895899-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=98179) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 17 04:28:43.399407 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-8dc57d76-4775-4c43-b21b-3b7b135f9e07 tempest-VolumesNegativeTest-1863895899 tempest-VolumesNegativeTest-1863895899-project] 10.222.0.78 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.014795 Feb 17 04:28:43.401919 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 31/52] 10.222.0.78 () {60 vars in 1146 bytes} [Wed Feb 17 04:28:43 2021] POST /compute/v2.1/os-volumes => generated 121 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Feb 17 04:28:43.414046 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-f0dee9b4-23ea-4a44-8a6c-e78d84f0ff56 tempest-VolumesNegativeTest-1863895899 tempest-VolumesNegativeTest-1863895899-project] Calling method '.version_select at 0x7f57c93d1bf8>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:28:43.510144 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.wsgi [None req-f0dee9b4-23ea-4a44-8a6c-e78d84f0ff56 tempest-VolumesNegativeTest-1863895899 tempest-VolumesNegativeTest-1863895899-project] HTTP exception thrown: Volume tempest-invalid-714894695 could not be found. Feb 17 04:28:43.511708 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-f0dee9b4-23ea-4a44-8a6c-e78d84f0ff56 tempest-VolumesNegativeTest-1863895899 tempest-VolumesNegativeTest-1863895899-project] Returning 404 to user: Volume tempest-invalid-714894695 could not be found. {{(pid=98179) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 17 04:28:43.512820 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-f0dee9b4-23ea-4a44-8a6c-e78d84f0ff56 tempest-VolumesNegativeTest-1863895899 tempest-VolumesNegativeTest-1863895899-project] 10.222.0.78 "DELETE /compute/v2.1/os-volumes/tempest-invalid-714894695" status: 404 len: 98 microversion: 2.1 time: 0.106041 Feb 17 04:28:43.514058 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 32/53] 10.222.0.78 () {58 vars in 1205 bytes} [Wed Feb 17 04:28:43 2021] DELETE /compute/v2.1/os-volumes/tempest-invalid-714894695 => generated 98 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Feb 17 04:28:43.523118 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-e5d3b893-0eec-4cba-92a1-84259810492b tempest-VolumesNegativeTest-1863895899 tempest-VolumesNegativeTest-1863895899-project] 10.222.0.78 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003978 Feb 17 04:28:43.524268 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 33/54] 10.222.0.78 () {58 vars in 1130 bytes} [Wed Feb 17 04:28:43 2021] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Feb 17 04:28:43.534237 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-c083efed-71c4-45d3-9a39-e0d118ccd4bc tempest-VolumesNegativeTest-1863895899 tempest-VolumesNegativeTest-1863895899-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004436 Feb 17 04:28:43.534965 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 34/55] 10.222.0.78 () {58 vars in 1127 bytes} [Wed Feb 17 04:28:43 2021] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Feb 17 04:28:43.551110 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-ce04d852-1ab0-419c-b66c-b2571e62c2e0 tempest-VolumesNegativeTest-1863895899 tempest-VolumesNegativeTest-1863895899-project] Calling method '.version_select at 0x7f57c93b71e0>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:28:43.663881 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.wsgi [None req-ce04d852-1ab0-419c-b66c-b2571e62c2e0 tempest-VolumesNegativeTest-1863895899 tempest-VolumesNegativeTest-1863895899-project] HTTP exception thrown: Volume fcd10425-9c0a-4a73-b31c-809e54d11ad3 could not be found. Feb 17 04:28:43.664723 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-ce04d852-1ab0-419c-b66c-b2571e62c2e0 tempest-VolumesNegativeTest-1863895899 tempest-VolumesNegativeTest-1863895899-project] Returning 404 to user: Volume fcd10425-9c0a-4a73-b31c-809e54d11ad3 could not be found. {{(pid=98179) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 17 04:28:43.665693 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-ce04d852-1ab0-419c-b66c-b2571e62c2e0 tempest-VolumesNegativeTest-1863895899 tempest-VolumesNegativeTest-1863895899-project] 10.222.0.78 "DELETE /compute/v2.1/os-volumes/fcd10425-9c0a-4a73-b31c-809e54d11ad3" status: 404 len: 109 microversion: 2.1 time: 0.122439 Feb 17 04:28:43.673046 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 35/56] 10.222.0.78 () {58 vars in 1238 bytes} [Wed Feb 17 04:28:43 2021] DELETE /compute/v2.1/os-volumes/fcd10425-9c0a-4a73-b31c-809e54d11ad3 => generated 109 bytes in 130 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 17 04:28:43.688887 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-17b07a9d-0964-4069-a91b-f32a3c967ef8 tempest-VolumesNegativeTest-1863895899 tempest-VolumesNegativeTest-1863895899-project] Calling method '.version_select at 0x7f57c92c76a8>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:28:43.804148 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.wsgi [None req-17b07a9d-0964-4069-a91b-f32a3c967ef8 tempest-VolumesNegativeTest-1863895899 tempest-VolumesNegativeTest-1863895899-project] HTTP exception thrown: Volume 7aae09b3-b02d-4e93-8a4b-c64325780a29 could not be found. Feb 17 04:28:43.805246 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-17b07a9d-0964-4069-a91b-f32a3c967ef8 tempest-VolumesNegativeTest-1863895899 tempest-VolumesNegativeTest-1863895899-project] Returning 404 to user: Volume 7aae09b3-b02d-4e93-8a4b-c64325780a29 could not be found. {{(pid=98179) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 17 04:28:43.806773 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-17b07a9d-0964-4069-a91b-f32a3c967ef8 tempest-VolumesNegativeTest-1863895899 tempest-VolumesNegativeTest-1863895899-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/7aae09b3-b02d-4e93-8a4b-c64325780a29" status: 404 len: 109 microversion: 2.1 time: 0.132204 Feb 17 04:28:43.808095 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 36/57] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Feb 17 04:28:43 2021] GET /compute/v2.1/os-volumes/7aae09b3-b02d-4e93-8a4b-c64325780a29 => generated 109 bytes in 135 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 17 04:28:44.172929 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-2d05cd68-cf1f-48e8-b399-881aa7df7cb9 tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:28:44.174080 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-2d05cd68-cf1f-48e8-b399-881aa7df7cb9 tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] [instance: fc3441c6-9dd2-4b3e-8aea-c1ea786a445e] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:28:44.192286 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-2d05cd68-cf1f-48e8-b399-881aa7df7cb9 tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:28:44.196241 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-2d05cd68-cf1f-48e8-b399-881aa7df7cb9 tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:28:44.198727 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-2d05cd68-cf1f-48e8-b399-881aa7df7cb9 tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:28:44.200719 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-2d05cd68-cf1f-48e8-b399-881aa7df7cb9 tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:28:44.367009 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-c4e6fa3d-30cd-434a-bcfd-d343415a965b tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d68d4a6c12e4331b8df8191cdd7a669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2a1ca6347d4278899a1cc009d87d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:28:44.404668 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-c4e6fa3d-30cd-434a-bcfd-d343415a965b tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] 10.222.0.78 "GET /compute/v2.1/servers/21edfff0-5c5c-43a5-a4e5-22ddd5f452eb" status: 200 len: 1318 microversion: 2.1 time: 1.170271 Feb 17 04:28:44.407218 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 22/58] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:28:43 2021] GET /compute/v2.1/servers/21edfff0-5c5c-43a5-a4e5-22ddd5f452eb => generated 1318 bytes in 1174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:28:44.953169 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-540865dd-0047-4832-8a3f-a594029f82f4 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1048806323", "imageRef": "b005ed36-a85a-4c46-ba22-9fa8c5ec62e5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "81bb7ddb-3c03-4021-a815-f1376954373e"}]}} {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:28:45.050433 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.network.neutron [None req-540865dd-0047-4832-8a3f-a594029f82f4 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] validate_networks() for [('81bb7ddb-3c03-4021-a815-f1376954373e', None, None, None)] {{(pid=98178) validate_networks /opt/stack/nova/nova/network/neutron.py:2345}} Feb 17 04:28:45.265785 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-2d05cd68-cf1f-48e8-b399-881aa7df7cb9 tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b59e91a6423843459340bbd8d875007e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd156b69e0ec24a8782b15c83a8c4cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:28:45.282468 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-2d05cd68-cf1f-48e8-b399-881aa7df7cb9 tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] 10.222.0.78 "GET /compute/v2.1/servers/fc3441c6-9dd2-4b3e-8aea-c1ea786a445e" status: 200 len: 1314 microversion: 2.1 time: 1.114115 Feb 17 04:28:45.283399 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 37/59] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:28:44 2021] GET /compute/v2.1/servers/fc3441c6-9dd2-4b3e-8aea-c1ea786a445e => generated 1314 bytes in 1121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:28:45.425100 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-ba3545b2-a00e-4c2a-b137-e2a231b6f050 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:28:45.425889 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-ba3545b2-a00e-4c2a-b137-e2a231b6f050 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] [instance: 21edfff0-5c5c-43a5-a4e5-22ddd5f452eb] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:28:45.446573 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-ba3545b2-a00e-4c2a-b137-e2a231b6f050 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:28:45.448152 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-ba3545b2-a00e-4c2a-b137-e2a231b6f050 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:28:45.451136 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-ba3545b2-a00e-4c2a-b137-e2a231b6f050 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:28:45.460682 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-ba3545b2-a00e-4c2a-b137-e2a231b6f050 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:28:46.268723 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-ba3545b2-a00e-4c2a-b137-e2a231b6f050 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d68d4a6c12e4331b8df8191cdd7a669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2a1ca6347d4278899a1cc009d87d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:28:46.281630 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-ba3545b2-a00e-4c2a-b137-e2a231b6f050 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] 10.222.0.78 "GET /compute/v2.1/servers/21edfff0-5c5c-43a5-a4e5-22ddd5f452eb" status: 200 len: 1318 microversion: 2.1 time: 0.861472 Feb 17 04:28:46.282263 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 38/60] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:28:45 2021] GET /compute/v2.1/servers/21edfff0-5c5c-43a5-a4e5-22ddd5f452eb => generated 1318 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:28:46.504533 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [req-79ea3e36-5d41-4004-a972-e3d78dd4efb2 req-9949d31d-6392-455b-9109-ad922a544443 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fc3441c6-9dd2-4b3e-8aea-c1ea786a445e", "tag": "a3fb43ae-c2fe-478c-b9a6-913bf7c74695"}]} {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:28:46.506913 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:28:46.506913 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: warnings.warn(msg) Feb 17 04:28:46.518750 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [req-79ea3e36-5d41-4004-a972-e3d78dd4efb2 req-9949d31d-6392-455b-9109-ad922a544443 service nova] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:28:46.519546 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [req-79ea3e36-5d41-4004-a972-e3d78dd4efb2 req-9949d31d-6392-455b-9109-ad922a544443 service nova] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:28:46.545448 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.virt.hardware [None req-540865dd-0047-4832-8a3f-a594029f82f4 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Flavor limits 0:0:0 {{(pid=98178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 17 04:28:46.546351 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.virt.hardware [None req-540865dd-0047-4832-8a3f-a594029f82f4 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Image limits 0:0:0 {{(pid=98178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Feb 17 04:28:46.547018 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.virt.hardware [None req-540865dd-0047-4832-8a3f-a594029f82f4 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Flavor pref 0:0:0 {{(pid=98178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 17 04:28:46.547686 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.virt.hardware [None req-540865dd-0047-4832-8a3f-a594029f82f4 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Image pref 0:0:0 {{(pid=98178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Feb 17 04:28:46.548268 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.virt.hardware [None req-540865dd-0047-4832-8a3f-a594029f82f4 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Feb 17 04:28:46.601917 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-540865dd-0047-4832-8a3f-a594029f82f4 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:28:46.602633 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-540865dd-0047-4832-8a3f-a594029f82f4 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:28:46.603850 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-540865dd-0047-4832-8a3f-a594029f82f4 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:28:46.606518 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-540865dd-0047-4832-8a3f-a594029f82f4 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:28:46.630384 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.compute.server_external_events [req-79ea3e36-5d41-4004-a972-e3d78dd4efb2 req-9949d31d-6392-455b-9109-ad922a544443 service nova] Creating event network-changed:a3fb43ae-c2fe-478c-b9a6-913bf7c74695 for instance fc3441c6-9dd2-4b3e-8aea-c1ea786a445e on hv-cinder-75998 Feb 17 04:28:46.630965 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [req-79ea3e36-5d41-4004-a972-e3d78dd4efb2 req-9949d31d-6392-455b-9109-ad922a544443 service nova] Acquired lock "compute-rpcapi-router" {{(pid=98179) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:266}} Feb 17 04:28:46.632301 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-2055ae1f-1699-4d94-9c55-67f38af52eba None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:28:46.639826 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-2055ae1f-1699-4d94-9c55-67f38af52eba None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:28:46.640860 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-2055ae1f-1699-4d94-9c55-67f38af52eba None None] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:28:46.641369 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-2055ae1f-1699-4d94-9c55-67f38af52eba None None] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:28:46.659980 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.quota [None req-540865dd-0047-4832-8a3f-a594029f82f4 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Getting quotas for project 5336afdcf4aa4b46b0655432b7a1323c. Resources: {'ram', 'cores', 'instances'} {{(pid=98178) _get_quotas /opt/stack/nova/nova/quota.py:388}} Feb 17 04:28:46.670327 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.quota [None req-540865dd-0047-4832-8a3f-a594029f82f4 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Getting quotas for user 1daf9a83b1d24033a3d4c0f531a4eb2d and project 5336afdcf4aa4b46b0655432b7a1323c. Resources: {'ram', 'cores', 'instances'} {{(pid=98178) _get_quotas /opt/stack/nova/nova/quota.py:380}} Feb 17 04:28:46.679497 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.compute.rpcapi [None req-2055ae1f-1699-4d94-9c55-67f38af52eba None None] Automatically selected compute RPC version 5.13 from minimum service version 54 Feb 17 04:28:46.688447 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-2055ae1f-1699-4d94-9c55-67f38af52eba None None] Releasing lock "compute-rpcapi-router" {{(pid=98179) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:282}} Feb 17 04:28:46.710364 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-540865dd-0047-4832-8a3f-a594029f82f4 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Going to run 1 instances... {{(pid=98178) _provision_instances /opt/stack/nova/nova/compute/api.py:1264}} Feb 17 04:28:46.716253 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-540865dd-0047-4832-8a3f-a594029f82f4 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] [instance: 20760e77-fe67-4ebe-87f1-34d840495341] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b005ed36-a85a-4c46-ba22-9fa8c5ec62e5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98178) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1666}} Feb 17 04:28:46.772842 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-2055ae1f-1699-4d94-9c55-67f38af52eba None None] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.489189 Feb 17 04:28:46.773693 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 39/61] 10.222.0.78 () {64 vars in 1308 bytes} [Wed Feb 17 04:28:46 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:28:46.779955 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-36733010-d35f-448c-b4d5-475f4d9cb4eb tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:28:46.780736 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-36733010-d35f-448c-b4d5-475f4d9cb4eb tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] [instance: fc3441c6-9dd2-4b3e-8aea-c1ea786a445e] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:28:46.792538 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-36733010-d35f-448c-b4d5-475f4d9cb4eb tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:28:46.793396 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-36733010-d35f-448c-b4d5-475f4d9cb4eb tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:28:46.795338 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-36733010-d35f-448c-b4d5-475f4d9cb4eb tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:28:46.796233 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-36733010-d35f-448c-b4d5-475f4d9cb4eb tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:28:46.837166 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-540865dd-0047-4832-8a3f-a594029f82f4 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.125374 Feb 17 04:28:46.843379 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 23/62] 10.222.0.78 () {60 vars in 1137 bytes} [Wed Feb 17 04:28:44 2021] POST /compute/v2.1/servers => generated 383 bytes in 2127 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 17 04:28:46.850065 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-e69420d4-2119-486f-b8c5-fea79a2a1927 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:28:46.851155 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-e69420d4-2119-486f-b8c5-fea79a2a1927 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] [instance: 20760e77-fe67-4ebe-87f1-34d840495341] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:28:46.981425 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-e69420d4-2119-486f-b8c5-fea79a2a1927 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1daf9a83b1d24033a3d4c0f531a4eb2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5336afdcf4aa4b46b0655432b7a1323c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:28:46.996195 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-e69420d4-2119-486f-b8c5-fea79a2a1927 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] 10.222.0.78 "GET /compute/v2.1/servers/20760e77-fe67-4ebe-87f1-34d840495341" status: 200 len: 1222 microversion: 2.1 time: 0.150333 Feb 17 04:28:46.997941 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 24/63] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:28:46 2021] GET /compute/v2.1/servers/20760e77-fe67-4ebe-87f1-34d840495341 => generated 1222 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:28:47.227476 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-b1fac88e-3352-497c-9477-de3345b35489 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-794290064", "imageRef": "b005ed36-a85a-4c46-ba22-9fa8c5ec62e5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "81bb7ddb-3c03-4021-a815-f1376954373e"}]}} {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:28:47.582422 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.network.neutron [None req-b1fac88e-3352-497c-9477-de3345b35489 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] validate_networks() for [('81bb7ddb-3c03-4021-a815-f1376954373e', None, None, None)] {{(pid=98178) validate_networks /opt/stack/nova/nova/network/neutron.py:2345}} Feb 17 04:28:47.669916 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-36733010-d35f-448c-b4d5-475f4d9cb4eb tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b59e91a6423843459340bbd8d875007e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd156b69e0ec24a8782b15c83a8c4cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:28:47.679334 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-36733010-d35f-448c-b4d5-475f4d9cb4eb tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] 10.222.0.78 "GET /compute/v2.1/servers/fc3441c6-9dd2-4b3e-8aea-c1ea786a445e" status: 200 len: 1314 microversion: 2.1 time: 0.903995 Feb 17 04:28:47.683469 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 40/64] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:28:46 2021] GET /compute/v2.1/servers/fc3441c6-9dd2-4b3e-8aea-c1ea786a445e => generated 1314 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:28:47.698420 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-d56f3caa-527d-4eb8-b77f-5c1f3135fce0 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:28:47.707607 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-d56f3caa-527d-4eb8-b77f-5c1f3135fce0 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] [instance: 21edfff0-5c5c-43a5-a4e5-22ddd5f452eb] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:28:47.720410 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-d56f3caa-527d-4eb8-b77f-5c1f3135fce0 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:28:47.723634 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-d56f3caa-527d-4eb8-b77f-5c1f3135fce0 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:28:47.724690 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-d56f3caa-527d-4eb8-b77f-5c1f3135fce0 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:28:47.725193 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-d56f3caa-527d-4eb8-b77f-5c1f3135fce0 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:28:48.297837 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-d56f3caa-527d-4eb8-b77f-5c1f3135fce0 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d68d4a6c12e4331b8df8191cdd7a669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2a1ca6347d4278899a1cc009d87d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:28:48.307449 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-d56f3caa-527d-4eb8-b77f-5c1f3135fce0 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] 10.222.0.78 "GET /compute/v2.1/servers/21edfff0-5c5c-43a5-a4e5-22ddd5f452eb" status: 200 len: 1318 microversion: 2.1 time: 0.613359 Feb 17 04:28:48.308038 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 41/65] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:28:47 2021] GET /compute/v2.1/servers/21edfff0-5c5c-43a5-a4e5-22ddd5f452eb => generated 1318 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:28:48.333257 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-95b7de07-401b-4ccd-b7bd-2cfaa3342914 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1305853449", "imageRef": "b005ed36-a85a-4c46-ba22-9fa8c5ec62e5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a4759f4f-636c-409c-a003-149d7d8e5a4a"}], "security_groups": [{"name": "tempest-securitygroup--259243922"}], "key_name": "tempest-keypair-1175688493", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:28:48.765694 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.network.neutron [None req-95b7de07-401b-4ccd-b7bd-2cfaa3342914 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] validate_networks() for [('a4759f4f-636c-409c-a003-149d7d8e5a4a', None, None, None)] {{(pid=98179) validate_networks /opt/stack/nova/nova/network/neutron.py:2345}} Feb 17 04:28:50.736413 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.virt.hardware [None req-b1fac88e-3352-497c-9477-de3345b35489 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Flavor limits 0:0:0 {{(pid=98178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 17 04:28:50.736960 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.virt.hardware [None req-b1fac88e-3352-497c-9477-de3345b35489 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Image limits 0:0:0 {{(pid=98178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Feb 17 04:28:50.737400 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.virt.hardware [None req-b1fac88e-3352-497c-9477-de3345b35489 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Flavor pref 0:0:0 {{(pid=98178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 17 04:28:50.737868 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.virt.hardware [None req-b1fac88e-3352-497c-9477-de3345b35489 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Image pref 0:0:0 {{(pid=98178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Feb 17 04:28:50.738758 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.virt.hardware [None req-b1fac88e-3352-497c-9477-de3345b35489 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Feb 17 04:28:50.764816 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-b1fac88e-3352-497c-9477-de3345b35489 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:28:50.765322 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-b1fac88e-3352-497c-9477-de3345b35489 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:28:50.766195 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-b1fac88e-3352-497c-9477-de3345b35489 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:28:50.766664 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-b1fac88e-3352-497c-9477-de3345b35489 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:28:50.808183 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.quota [None req-b1fac88e-3352-497c-9477-de3345b35489 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Getting quotas for project 5336afdcf4aa4b46b0655432b7a1323c. Resources: {'ram', 'cores', 'instances'} {{(pid=98178) _get_quotas /opt/stack/nova/nova/quota.py:388}} Feb 17 04:28:50.816181 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.quota [None req-b1fac88e-3352-497c-9477-de3345b35489 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Getting quotas for user 1daf9a83b1d24033a3d4c0f531a4eb2d and project 5336afdcf4aa4b46b0655432b7a1323c. Resources: {'ram', 'cores', 'instances'} {{(pid=98178) _get_quotas /opt/stack/nova/nova/quota.py:380}} Feb 17 04:28:50.852477 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-b1fac88e-3352-497c-9477-de3345b35489 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Going to run 1 instances... {{(pid=98178) _provision_instances /opt/stack/nova/nova/compute/api.py:1264}} Feb 17 04:28:50.855833 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-b1fac88e-3352-497c-9477-de3345b35489 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] [instance: 2fe5b190-5679-4b9d-8d5f-fac1a1c407d9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b005ed36-a85a-4c46-ba22-9fa8c5ec62e5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98178) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1666}} Feb 17 04:28:50.967576 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-b1fac88e-3352-497c-9477-de3345b35489 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.743162 Feb 17 04:28:50.968486 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 25/66] 10.222.0.78 () {60 vars in 1137 bytes} [Wed Feb 17 04:28:47 2021] POST /compute/v2.1/servers => generated 383 bytes in 3746 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Feb 17 04:28:50.974632 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.virt.hardware [None req-95b7de07-401b-4ccd-b7bd-2cfaa3342914 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Flavor limits 0:0:0 {{(pid=98179) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 17 04:28:50.975641 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.virt.hardware [None req-95b7de07-401b-4ccd-b7bd-2cfaa3342914 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Image limits 0:0:0 {{(pid=98179) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Feb 17 04:28:50.978909 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.virt.hardware [None req-95b7de07-401b-4ccd-b7bd-2cfaa3342914 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Flavor pref 0:0:0 {{(pid=98179) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 17 04:28:50.979751 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.virt.hardware [None req-95b7de07-401b-4ccd-b7bd-2cfaa3342914 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Image pref 0:0:0 {{(pid=98179) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Feb 17 04:28:50.980582 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.virt.hardware [None req-95b7de07-401b-4ccd-b7bd-2cfaa3342914 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98179) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Feb 17 04:28:50.983477 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-014d304c-2cfa-4c60-af9b-9e741e6b3b3d tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:28:50.984310 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-014d304c-2cfa-4c60-af9b-9e741e6b3b3d tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] [instance: fc3441c6-9dd2-4b3e-8aea-c1ea786a445e] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:28:50.999388 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-95b7de07-401b-4ccd-b7bd-2cfaa3342914 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:28:50.999694 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-95b7de07-401b-4ccd-b7bd-2cfaa3342914 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:28:51.000634 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-95b7de07-401b-4ccd-b7bd-2cfaa3342914 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:28:51.001127 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-95b7de07-401b-4ccd-b7bd-2cfaa3342914 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:28:51.003855 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-014d304c-2cfa-4c60-af9b-9e741e6b3b3d tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:28:51.005813 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-014d304c-2cfa-4c60-af9b-9e741e6b3b3d tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:28:51.008152 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-014d304c-2cfa-4c60-af9b-9e741e6b3b3d tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:28:51.008815 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-014d304c-2cfa-4c60-af9b-9e741e6b3b3d tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:28:51.020857 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.quota [None req-95b7de07-401b-4ccd-b7bd-2cfaa3342914 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Getting quotas for project a2c8716a46f54187902492f8ce162f58. Resources: {'ram', 'cores', 'instances'} {{(pid=98179) _get_quotas /opt/stack/nova/nova/quota.py:388}} Feb 17 04:28:51.026800 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.quota [None req-95b7de07-401b-4ccd-b7bd-2cfaa3342914 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Getting quotas for user 2deb449189ba427a9b8fcb0e21f22566 and project a2c8716a46f54187902492f8ce162f58. Resources: {'ram', 'cores', 'instances'} {{(pid=98179) _get_quotas /opt/stack/nova/nova/quota.py:380}} Feb 17 04:28:51.047180 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-95b7de07-401b-4ccd-b7bd-2cfaa3342914 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Going to run 1 instances... {{(pid=98179) _provision_instances /opt/stack/nova/nova/compute/api.py:1264}} Feb 17 04:28:51.050379 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-95b7de07-401b-4ccd-b7bd-2cfaa3342914 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: 29d1ce27-f63b-4523-88be-55f65a6a2529] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b005ed36-a85a-4c46-ba22-9fa8c5ec62e5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98179) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1666}} Feb 17 04:28:51.140616 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-95b7de07-401b-4ccd-b7bd-2cfaa3342914 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.812099 Feb 17 04:28:51.143371 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 42/67] 10.222.0.78 () {60 vars in 1137 bytes} [Wed Feb 17 04:28:48 2021] POST /compute/v2.1/servers => generated 401 bytes in 2816 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Feb 17 04:28:51.167780 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-92c5c0de-ef41-4cf2-a27a-53f3183ca64c tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:28:51.168473 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-92c5c0de-ef41-4cf2-a27a-53f3183ca64c tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] [instance: 21edfff0-5c5c-43a5-a4e5-22ddd5f452eb] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:28:51.194684 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-92c5c0de-ef41-4cf2-a27a-53f3183ca64c tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:28:51.195650 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-92c5c0de-ef41-4cf2-a27a-53f3183ca64c tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:28:51.197457 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-92c5c0de-ef41-4cf2-a27a-53f3183ca64c tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:28:51.198162 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-92c5c0de-ef41-4cf2-a27a-53f3183ca64c tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:28:51.895546 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-92c5c0de-ef41-4cf2-a27a-53f3183ca64c tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d68d4a6c12e4331b8df8191cdd7a669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2a1ca6347d4278899a1cc009d87d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:28:51.911798 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-92c5c0de-ef41-4cf2-a27a-53f3183ca64c tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] 10.222.0.78 "GET /compute/v2.1/servers/21edfff0-5c5c-43a5-a4e5-22ddd5f452eb" status: 200 len: 1318 microversion: 2.1 time: 0.765808 Feb 17 04:28:51.913324 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 43/68] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:28:51 2021] GET /compute/v2.1/servers/21edfff0-5c5c-43a5-a4e5-22ddd5f452eb => generated 1318 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:28:51.923545 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-43bfc6b8-8e5d-4d5e-850f-9ea3f14510ea tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:28:51.924414 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-43bfc6b8-8e5d-4d5e-850f-9ea3f14510ea tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] [instance: 2fe5b190-5679-4b9d-8d5f-fac1a1c407d9] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:28:51.949633 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-43bfc6b8-8e5d-4d5e-850f-9ea3f14510ea tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:28:51.950147 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-43bfc6b8-8e5d-4d5e-850f-9ea3f14510ea tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:28:51.951002 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-43bfc6b8-8e5d-4d5e-850f-9ea3f14510ea tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:28:51.951526 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-43bfc6b8-8e5d-4d5e-850f-9ea3f14510ea tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:28:52.272411 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-43bfc6b8-8e5d-4d5e-850f-9ea3f14510ea tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1daf9a83b1d24033a3d4c0f531a4eb2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5336afdcf4aa4b46b0655432b7a1323c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:28:52.291244 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-43bfc6b8-8e5d-4d5e-850f-9ea3f14510ea tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] 10.222.0.78 "GET /compute/v2.1/servers/2fe5b190-5679-4b9d-8d5f-fac1a1c407d9" status: 200 len: 1225 microversion: 2.1 time: 0.374908 Feb 17 04:28:52.291738 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 44/69] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:28:51 2021] GET /compute/v2.1/servers/2fe5b190-5679-4b9d-8d5f-fac1a1c407d9 => generated 1225 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:28:52.320189 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-64f638b1-45a8-45fb-a74b-8ffb1a37dcb2 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:28:52.323556 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-64f638b1-45a8-45fb-a74b-8ffb1a37dcb2 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: 29d1ce27-f63b-4523-88be-55f65a6a2529] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:28:52.344415 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-64f638b1-45a8-45fb-a74b-8ffb1a37dcb2 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:28:52.344940 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-64f638b1-45a8-45fb-a74b-8ffb1a37dcb2 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:28:52.345797 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-64f638b1-45a8-45fb-a74b-8ffb1a37dcb2 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:28:52.346270 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-64f638b1-45a8-45fb-a74b-8ffb1a37dcb2 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:28:52.560248 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-64f638b1-45a8-45fb-a74b-8ffb1a37dcb2 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2deb449189ba427a9b8fcb0e21f22566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2c8716a46f54187902492f8ce162f58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:28:52.582740 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-64f638b1-45a8-45fb-a74b-8ffb1a37dcb2 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "GET /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529" status: 200 len: 1234 microversion: 2.1 time: 0.285103 Feb 17 04:28:52.585740 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 45/70] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:28:52 2021] GET /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529 => generated 1234 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:28:52.619784 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-014d304c-2cfa-4c60-af9b-9e741e6b3b3d tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b59e91a6423843459340bbd8d875007e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd156b69e0ec24a8782b15c83a8c4cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:28:52.630730 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-014d304c-2cfa-4c60-af9b-9e741e6b3b3d tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] 10.222.0.78 "GET /compute/v2.1/servers/fc3441c6-9dd2-4b3e-8aea-c1ea786a445e" status: 200 len: 1314 microversion: 2.1 time: 1.658420 Feb 17 04:28:52.631698 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 26/71] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:28:50 2021] GET /compute/v2.1/servers/fc3441c6-9dd2-4b3e-8aea-c1ea786a445e => generated 1314 bytes in 1663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:28:52.930945 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-087e2b76-5d00-4866-b5c6-58df7939598b tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:28:52.932402 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-087e2b76-5d00-4866-b5c6-58df7939598b tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] [instance: 21edfff0-5c5c-43a5-a4e5-22ddd5f452eb] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:28:52.943187 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-087e2b76-5d00-4866-b5c6-58df7939598b tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:28:52.943880 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-087e2b76-5d00-4866-b5c6-58df7939598b tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:28:52.945313 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-087e2b76-5d00-4866-b5c6-58df7939598b tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:28:52.945986 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-087e2b76-5d00-4866-b5c6-58df7939598b tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:28:53.293064 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-087e2b76-5d00-4866-b5c6-58df7939598b tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d68d4a6c12e4331b8df8191cdd7a669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2a1ca6347d4278899a1cc009d87d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:28:53.309795 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-087e2b76-5d00-4866-b5c6-58df7939598b tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] 10.222.0.78 "GET /compute/v2.1/servers/21edfff0-5c5c-43a5-a4e5-22ddd5f452eb" status: 200 len: 1318 microversion: 2.1 time: 0.383471 Feb 17 04:28:53.310003 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-d56950e2-aa57-47fe-83da-880466d0aa17 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:28:53.310777 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-d56950e2-aa57-47fe-83da-880466d0aa17 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] [instance: 2fe5b190-5679-4b9d-8d5f-fac1a1c407d9] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:28:53.317634 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 46/72] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:28:52 2021] GET /compute/v2.1/servers/21edfff0-5c5c-43a5-a4e5-22ddd5f452eb => generated 1318 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:28:53.319442 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-d56950e2-aa57-47fe-83da-880466d0aa17 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:28:53.327552 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-d56950e2-aa57-47fe-83da-880466d0aa17 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:28:53.328615 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-d56950e2-aa57-47fe-83da-880466d0aa17 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:28:53.329193 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-d56950e2-aa57-47fe-83da-880466d0aa17 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:28:53.602733 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-d56950e2-aa57-47fe-83da-880466d0aa17 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1daf9a83b1d24033a3d4c0f531a4eb2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5336afdcf4aa4b46b0655432b7a1323c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:28:53.622936 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-d56950e2-aa57-47fe-83da-880466d0aa17 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] 10.222.0.78 "GET /compute/v2.1/servers/2fe5b190-5679-4b9d-8d5f-fac1a1c407d9" status: 200 len: 1273 microversion: 2.1 time: 0.317800 Feb 17 04:28:53.633141 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 27/73] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:28:53 2021] GET /compute/v2.1/servers/2fe5b190-5679-4b9d-8d5f-fac1a1c407d9 => generated 1273 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:28:53.638012 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-5107742e-f9d7-4427-89ee-8172b25394da tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:28:53.638703 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-5107742e-f9d7-4427-89ee-8172b25394da tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: 29d1ce27-f63b-4523-88be-55f65a6a2529] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:28:53.650852 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-5107742e-f9d7-4427-89ee-8172b25394da tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:28:53.651472 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-5107742e-f9d7-4427-89ee-8172b25394da tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:28:53.652249 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-5107742e-f9d7-4427-89ee-8172b25394da tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:28:53.652746 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-5107742e-f9d7-4427-89ee-8172b25394da tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:28:53.788726 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [req-94192b0f-e3d1-44e2-b244-eb3a12faebaa req-e274cbd2-1b91-4992-9415-2893d10c8fa3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "21edfff0-5c5c-43a5-a4e5-22ddd5f452eb", "tag": "e825e7f4-3daa-4bfe-9c61-a440fc5474f1"}]} {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:28:53.791118 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:28:53.791118 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: warnings.warn(msg) Feb 17 04:28:53.804763 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [req-94192b0f-e3d1-44e2-b244-eb3a12faebaa req-e274cbd2-1b91-4992-9415-2893d10c8fa3 service nova] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:28:53.805472 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [req-94192b0f-e3d1-44e2-b244-eb3a12faebaa req-e274cbd2-1b91-4992-9415-2893d10c8fa3 service nova] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:28:53.829542 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.compute.server_external_events [req-94192b0f-e3d1-44e2-b244-eb3a12faebaa req-e274cbd2-1b91-4992-9415-2893d10c8fa3 service nova] Creating event network-changed:e825e7f4-3daa-4bfe-9c61-a440fc5474f1 for instance 21edfff0-5c5c-43a5-a4e5-22ddd5f452eb on hv-cinder-75998 Feb 17 04:28:53.836099 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [req-94192b0f-e3d1-44e2-b244-eb3a12faebaa req-e274cbd2-1b91-4992-9415-2893d10c8fa3 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.300677 Feb 17 04:28:53.837934 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 47/74] 10.222.0.78 () {64 vars in 1308 bytes} [Wed Feb 17 04:28:53 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 17 04:28:53.864260 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-91b7526e-5145-4e9a-b63d-c01cdf2a3525 tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:28:53.865301 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-91b7526e-5145-4e9a-b63d-c01cdf2a3525 tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] [instance: fc3441c6-9dd2-4b3e-8aea-c1ea786a445e] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:28:53.874096 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-5107742e-f9d7-4427-89ee-8172b25394da tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2deb449189ba427a9b8fcb0e21f22566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2c8716a46f54187902492f8ce162f58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:28:53.882898 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-91b7526e-5145-4e9a-b63d-c01cdf2a3525 tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:28:53.883662 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-91b7526e-5145-4e9a-b63d-c01cdf2a3525 tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:28:53.885251 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-5107742e-f9d7-4427-89ee-8172b25394da tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "GET /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529" status: 200 len: 1234 microversion: 2.1 time: 0.260535 Feb 17 04:28:53.885833 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-91b7526e-5145-4e9a-b63d-c01cdf2a3525 tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:28:53.885955 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 28/75] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:28:53 2021] GET /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529 => generated 1234 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:28:53.886417 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-91b7526e-5145-4e9a-b63d-c01cdf2a3525 tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:28:54.177468 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-91b7526e-5145-4e9a-b63d-c01cdf2a3525 tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b59e91a6423843459340bbd8d875007e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd156b69e0ec24a8782b15c83a8c4cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:28:54.187543 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-91b7526e-5145-4e9a-b63d-c01cdf2a3525 tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] 10.222.0.78 "GET /compute/v2.1/servers/fc3441c6-9dd2-4b3e-8aea-c1ea786a445e" status: 200 len: 1314 microversion: 2.1 time: 0.347849 Feb 17 04:28:54.188312 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 48/76] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:28:53 2021] GET /compute/v2.1/servers/fc3441c6-9dd2-4b3e-8aea-c1ea786a445e => generated 1314 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:28:54.329954 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-9228e683-d1ce-439d-b681-009d4737ebdd tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:28:54.330654 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-9228e683-d1ce-439d-b681-009d4737ebdd tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] [instance: 21edfff0-5c5c-43a5-a4e5-22ddd5f452eb] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:28:54.339289 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-9228e683-d1ce-439d-b681-009d4737ebdd tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:28:54.339802 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-9228e683-d1ce-439d-b681-009d4737ebdd tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:28:54.340660 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-9228e683-d1ce-439d-b681-009d4737ebdd tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:28:54.341155 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-9228e683-d1ce-439d-b681-009d4737ebdd tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:28:54.564336 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-9228e683-d1ce-439d-b681-009d4737ebdd tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d68d4a6c12e4331b8df8191cdd7a669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2a1ca6347d4278899a1cc009d87d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:28:54.573802 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-9228e683-d1ce-439d-b681-009d4737ebdd tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] 10.222.0.78 "GET /compute/v2.1/servers/21edfff0-5c5c-43a5-a4e5-22ddd5f452eb" status: 200 len: 1318 microversion: 2.1 time: 0.247466 Feb 17 04:28:54.574722 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 29/77] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:28:54 2021] GET /compute/v2.1/servers/21edfff0-5c5c-43a5-a4e5-22ddd5f452eb => generated 1318 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:28:54.641826 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-cb739c92-f133-48b1-89b7-b4ba356f93a6 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:28:54.642498 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-cb739c92-f133-48b1-89b7-b4ba356f93a6 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] [instance: 2fe5b190-5679-4b9d-8d5f-fac1a1c407d9] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:28:54.650670 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-cb739c92-f133-48b1-89b7-b4ba356f93a6 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:28:54.651280 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-cb739c92-f133-48b1-89b7-b4ba356f93a6 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:28:54.652129 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-cb739c92-f133-48b1-89b7-b4ba356f93a6 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:28:54.652620 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-cb739c92-f133-48b1-89b7-b4ba356f93a6 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:28:54.807016 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-cb739c92-f133-48b1-89b7-b4ba356f93a6 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1daf9a83b1d24033a3d4c0f531a4eb2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5336afdcf4aa4b46b0655432b7a1323c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:28:54.815687 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-cb739c92-f133-48b1-89b7-b4ba356f93a6 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] 10.222.0.78 "GET /compute/v2.1/servers/2fe5b190-5679-4b9d-8d5f-fac1a1c407d9" status: 200 len: 1273 microversion: 2.1 time: 0.177793 Feb 17 04:28:54.816270 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 49/78] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:28:54 2021] GET /compute/v2.1/servers/2fe5b190-5679-4b9d-8d5f-fac1a1c407d9 => generated 1273 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:28:54.903796 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-7b04102f-3a96-46b9-b3e0-c4ff4e200615 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:28:54.904692 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-7b04102f-3a96-46b9-b3e0-c4ff4e200615 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: 29d1ce27-f63b-4523-88be-55f65a6a2529] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:28:54.912555 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-7b04102f-3a96-46b9-b3e0-c4ff4e200615 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:28:54.914137 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-7b04102f-3a96-46b9-b3e0-c4ff4e200615 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:28:54.915716 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-7b04102f-3a96-46b9-b3e0-c4ff4e200615 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:28:54.916662 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-7b04102f-3a96-46b9-b3e0-c4ff4e200615 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:28:55.078530 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-7b04102f-3a96-46b9-b3e0-c4ff4e200615 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2deb449189ba427a9b8fcb0e21f22566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2c8716a46f54187902492f8ce162f58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:28:55.108197 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-7b04102f-3a96-46b9-b3e0-c4ff4e200615 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "GET /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529" status: 200 len: 1234 microversion: 2.1 time: 0.190884 Feb 17 04:28:55.109575 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 30/79] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:28:54 2021] GET /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529 => generated 1234 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:28:55.205942 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-100e5429-14f4-472f-abba-9b28220bcbb5 tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:28:55.206652 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-100e5429-14f4-472f-abba-9b28220bcbb5 tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] [instance: fc3441c6-9dd2-4b3e-8aea-c1ea786a445e] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:28:55.215653 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-100e5429-14f4-472f-abba-9b28220bcbb5 tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:28:55.216161 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-100e5429-14f4-472f-abba-9b28220bcbb5 tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:28:55.216983 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-100e5429-14f4-472f-abba-9b28220bcbb5 tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:28:55.217464 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-100e5429-14f4-472f-abba-9b28220bcbb5 tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:28:55.435125 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-100e5429-14f4-472f-abba-9b28220bcbb5 tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b59e91a6423843459340bbd8d875007e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd156b69e0ec24a8782b15c83a8c4cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:28:55.443824 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-100e5429-14f4-472f-abba-9b28220bcbb5 tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] 10.222.0.78 "GET /compute/v2.1/servers/fc3441c6-9dd2-4b3e-8aea-c1ea786a445e" status: 200 len: 1314 microversion: 2.1 time: 0.241853 Feb 17 04:28:55.444432 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 50/80] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:28:55 2021] GET /compute/v2.1/servers/fc3441c6-9dd2-4b3e-8aea-c1ea786a445e => generated 1314 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:28:55.592063 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-5b150200-3630-4a97-908f-2dacdf49f245 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:28:55.592787 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-5b150200-3630-4a97-908f-2dacdf49f245 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] [instance: 21edfff0-5c5c-43a5-a4e5-22ddd5f452eb] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:28:55.600491 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-5b150200-3630-4a97-908f-2dacdf49f245 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:28:55.600996 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-5b150200-3630-4a97-908f-2dacdf49f245 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:28:55.601829 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-5b150200-3630-4a97-908f-2dacdf49f245 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:28:55.602317 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-5b150200-3630-4a97-908f-2dacdf49f245 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:28:55.819634 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-5b150200-3630-4a97-908f-2dacdf49f245 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d68d4a6c12e4331b8df8191cdd7a669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2a1ca6347d4278899a1cc009d87d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:28:55.829202 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-5b150200-3630-4a97-908f-2dacdf49f245 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] 10.222.0.78 "GET /compute/v2.1/servers/21edfff0-5c5c-43a5-a4e5-22ddd5f452eb" status: 200 len: 1318 microversion: 2.1 time: 0.241322 Feb 17 04:28:55.829789 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 31/81] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:28:55 2021] GET /compute/v2.1/servers/21edfff0-5c5c-43a5-a4e5-22ddd5f452eb => generated 1318 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:28:55.834251 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-e0d4c971-e33d-4d00-ba14-bb4087963c16 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:28:55.834928 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-e0d4c971-e33d-4d00-ba14-bb4087963c16 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] [instance: 2fe5b190-5679-4b9d-8d5f-fac1a1c407d9] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:28:55.846117 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-e0d4c971-e33d-4d00-ba14-bb4087963c16 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:28:55.846632 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-e0d4c971-e33d-4d00-ba14-bb4087963c16 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:28:55.847499 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-e0d4c971-e33d-4d00-ba14-bb4087963c16 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:28:55.847993 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-e0d4c971-e33d-4d00-ba14-bb4087963c16 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:28:55.979392 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-e0d4c971-e33d-4d00-ba14-bb4087963c16 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1daf9a83b1d24033a3d4c0f531a4eb2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5336afdcf4aa4b46b0655432b7a1323c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:28:55.988235 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-e0d4c971-e33d-4d00-ba14-bb4087963c16 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] 10.222.0.78 "GET /compute/v2.1/servers/2fe5b190-5679-4b9d-8d5f-fac1a1c407d9" status: 200 len: 1273 microversion: 2.1 time: 0.158124 Feb 17 04:28:55.989091 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 51/82] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:28:55 2021] GET /compute/v2.1/servers/2fe5b190-5679-4b9d-8d5f-fac1a1c407d9 => generated 1273 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:28:56.140948 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-bb9f0b39-d7c6-409a-892e-445dfeb6eb76 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:28:56.141910 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-bb9f0b39-d7c6-409a-892e-445dfeb6eb76 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: 29d1ce27-f63b-4523-88be-55f65a6a2529] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:28:56.176500 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-bb9f0b39-d7c6-409a-892e-445dfeb6eb76 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:28:56.180651 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-bb9f0b39-d7c6-409a-892e-445dfeb6eb76 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:28:56.184489 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-bb9f0b39-d7c6-409a-892e-445dfeb6eb76 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:28:56.186565 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-bb9f0b39-d7c6-409a-892e-445dfeb6eb76 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:28:56.376651 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-bb9f0b39-d7c6-409a-892e-445dfeb6eb76 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2deb449189ba427a9b8fcb0e21f22566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2c8716a46f54187902492f8ce162f58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:28:56.385697 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-bb9f0b39-d7c6-409a-892e-445dfeb6eb76 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "GET /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529" status: 200 len: 1234 microversion: 2.1 time: 0.259567 Feb 17 04:28:56.387118 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 32/83] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:28:56 2021] GET /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529 => generated 1234 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:28:56.462268 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-5c575bf8-ff30-4da8-9442-309dc0abdaeb tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:28:56.463330 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-5c575bf8-ff30-4da8-9442-309dc0abdaeb tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] [instance: fc3441c6-9dd2-4b3e-8aea-c1ea786a445e] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:28:56.485840 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-5c575bf8-ff30-4da8-9442-309dc0abdaeb tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:28:56.487984 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-5c575bf8-ff30-4da8-9442-309dc0abdaeb tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:28:56.489872 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-5c575bf8-ff30-4da8-9442-309dc0abdaeb tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:28:56.491228 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-5c575bf8-ff30-4da8-9442-309dc0abdaeb tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:28:56.848652 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-01925c6e-384c-48c3-80ea-c75620fda2de tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:28:56.849862 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-01925c6e-384c-48c3-80ea-c75620fda2de tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] [instance: 21edfff0-5c5c-43a5-a4e5-22ddd5f452eb] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:28:56.858559 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-01925c6e-384c-48c3-80ea-c75620fda2de tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:28:56.859424 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-01925c6e-384c-48c3-80ea-c75620fda2de tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:28:56.860489 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-01925c6e-384c-48c3-80ea-c75620fda2de tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:28:56.861170 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-01925c6e-384c-48c3-80ea-c75620fda2de tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:28:57.008045 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-5c575bf8-ff30-4da8-9442-309dc0abdaeb tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b59e91a6423843459340bbd8d875007e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd156b69e0ec24a8782b15c83a8c4cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:28:57.018062 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-5c575bf8-ff30-4da8-9442-309dc0abdaeb tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] 10.222.0.78 "GET /compute/v2.1/servers/fc3441c6-9dd2-4b3e-8aea-c1ea786a445e" status: 200 len: 1314 microversion: 2.1 time: 0.559973 Feb 17 04:28:57.019476 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 52/84] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:28:56 2021] GET /compute/v2.1/servers/fc3441c6-9dd2-4b3e-8aea-c1ea786a445e => generated 1314 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:28:57.024384 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-5a8c1d79-c657-4170-adfc-7a3848bede62 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:28:57.025965 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-5a8c1d79-c657-4170-adfc-7a3848bede62 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] [instance: 2fe5b190-5679-4b9d-8d5f-fac1a1c407d9] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:28:57.034568 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-5a8c1d79-c657-4170-adfc-7a3848bede62 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:28:57.035426 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-5a8c1d79-c657-4170-adfc-7a3848bede62 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:28:57.036465 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-5a8c1d79-c657-4170-adfc-7a3848bede62 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:28:57.037819 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-5a8c1d79-c657-4170-adfc-7a3848bede62 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:28:57.264371 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-5a8c1d79-c657-4170-adfc-7a3848bede62 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1daf9a83b1d24033a3d4c0f531a4eb2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5336afdcf4aa4b46b0655432b7a1323c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:28:57.275016 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-5a8c1d79-c657-4170-adfc-7a3848bede62 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] 10.222.0.78 "GET /compute/v2.1/servers/2fe5b190-5679-4b9d-8d5f-fac1a1c407d9" status: 200 len: 1279 microversion: 2.1 time: 0.254056 Feb 17 04:28:57.275639 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 53/85] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:28:57 2021] GET /compute/v2.1/servers/2fe5b190-5679-4b9d-8d5f-fac1a1c407d9 => generated 1279 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:28:57.405103 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-8503731f-e78f-4a26-94ab-4bc5d2781588 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:28:57.405791 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-8503731f-e78f-4a26-94ab-4bc5d2781588 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: 29d1ce27-f63b-4523-88be-55f65a6a2529] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:28:57.421134 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-8503731f-e78f-4a26-94ab-4bc5d2781588 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:28:57.421640 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-8503731f-e78f-4a26-94ab-4bc5d2781588 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:28:57.422497 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-8503731f-e78f-4a26-94ab-4bc5d2781588 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:28:57.422989 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-8503731f-e78f-4a26-94ab-4bc5d2781588 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:28:57.468066 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-01925c6e-384c-48c3-80ea-c75620fda2de tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d68d4a6c12e4331b8df8191cdd7a669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2a1ca6347d4278899a1cc009d87d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:28:57.483629 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-01925c6e-384c-48c3-80ea-c75620fda2de tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] 10.222.0.78 "GET /compute/v2.1/servers/21edfff0-5c5c-43a5-a4e5-22ddd5f452eb" status: 200 len: 1318 microversion: 2.1 time: 0.639005 Feb 17 04:28:57.497300 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 33/86] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:28:56 2021] GET /compute/v2.1/servers/21edfff0-5c5c-43a5-a4e5-22ddd5f452eb => generated 1318 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:28:57.792776 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-8503731f-e78f-4a26-94ab-4bc5d2781588 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2deb449189ba427a9b8fcb0e21f22566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2c8716a46f54187902492f8ce162f58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:28:57.803204 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-8503731f-e78f-4a26-94ab-4bc5d2781588 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "GET /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529" status: 200 len: 1308 microversion: 2.1 time: 0.402280 Feb 17 04:28:57.811407 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 54/87] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:28:57 2021] GET /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529 => generated 1308 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:28:58.037459 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-7d095219-5914-4675-830f-d033e90235be tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:28:58.038147 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-7d095219-5914-4675-830f-d033e90235be tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] [instance: fc3441c6-9dd2-4b3e-8aea-c1ea786a445e] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:28:58.052728 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-7d095219-5914-4675-830f-d033e90235be tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:28:58.053252 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-7d095219-5914-4675-830f-d033e90235be tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:28:58.054136 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-7d095219-5914-4675-830f-d033e90235be tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:28:58.054628 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-7d095219-5914-4675-830f-d033e90235be tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:28:58.294064 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-8ab0ec65-e121-4ae3-b9c7-5ec6453bab06 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:28:58.294770 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-8ab0ec65-e121-4ae3-b9c7-5ec6453bab06 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] [instance: 2fe5b190-5679-4b9d-8d5f-fac1a1c407d9] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:28:58.308937 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-8ab0ec65-e121-4ae3-b9c7-5ec6453bab06 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:28:58.309444 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-8ab0ec65-e121-4ae3-b9c7-5ec6453bab06 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:28:58.310286 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-8ab0ec65-e121-4ae3-b9c7-5ec6453bab06 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:28:58.317171 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-8ab0ec65-e121-4ae3-b9c7-5ec6453bab06 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:28:58.587896 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-8ab0ec65-e121-4ae3-b9c7-5ec6453bab06 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1daf9a83b1d24033a3d4c0f531a4eb2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5336afdcf4aa4b46b0655432b7a1323c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:28:58.605558 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-8ab0ec65-e121-4ae3-b9c7-5ec6453bab06 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] 10.222.0.78 "GET /compute/v2.1/servers/2fe5b190-5679-4b9d-8d5f-fac1a1c407d9" status: 200 len: 1279 microversion: 2.1 time: 0.311335 Feb 17 04:28:58.606643 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 55/88] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:28:58 2021] GET /compute/v2.1/servers/2fe5b190-5679-4b9d-8d5f-fac1a1c407d9 => generated 1279 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:28:58.620921 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-8ffe7082-4970-4e30-a08b-001732d060dc tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:28:58.621599 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-8ffe7082-4970-4e30-a08b-001732d060dc tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] [instance: 21edfff0-5c5c-43a5-a4e5-22ddd5f452eb] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:28:58.639009 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-8ffe7082-4970-4e30-a08b-001732d060dc tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:28:58.639760 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-8ffe7082-4970-4e30-a08b-001732d060dc tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:28:58.641435 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-8ffe7082-4970-4e30-a08b-001732d060dc tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:28:58.643355 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-8ffe7082-4970-4e30-a08b-001732d060dc tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:28:59.190697 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-8ffe7082-4970-4e30-a08b-001732d060dc tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d68d4a6c12e4331b8df8191cdd7a669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2a1ca6347d4278899a1cc009d87d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:28:59.201094 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-8ffe7082-4970-4e30-a08b-001732d060dc tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] 10.222.0.78 "GET /compute/v2.1/servers/21edfff0-5c5c-43a5-a4e5-22ddd5f452eb" status: 200 len: 1318 microversion: 2.1 time: 0.593171 Feb 17 04:28:59.201693 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 56/89] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:28:58 2021] GET /compute/v2.1/servers/21edfff0-5c5c-43a5-a4e5-22ddd5f452eb => generated 1318 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:28:59.207852 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-e7182d89-afba-4082-be37-c38cc54fb872 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:28:59.208680 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-e7182d89-afba-4082-be37-c38cc54fb872 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: 29d1ce27-f63b-4523-88be-55f65a6a2529] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:28:59.218153 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-e7182d89-afba-4082-be37-c38cc54fb872 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:28:59.218665 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-e7182d89-afba-4082-be37-c38cc54fb872 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:28:59.219532 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-e7182d89-afba-4082-be37-c38cc54fb872 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:28:59.220025 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-e7182d89-afba-4082-be37-c38cc54fb872 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:28:59.315143 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-7d095219-5914-4675-830f-d033e90235be tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b59e91a6423843459340bbd8d875007e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd156b69e0ec24a8782b15c83a8c4cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:28:59.324191 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-7d095219-5914-4675-830f-d033e90235be tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] 10.222.0.78 "GET /compute/v2.1/servers/fc3441c6-9dd2-4b3e-8aea-c1ea786a445e" status: 200 len: 1314 microversion: 2.1 time: 1.290781 Feb 17 04:28:59.325036 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 34/90] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:28:58 2021] GET /compute/v2.1/servers/fc3441c6-9dd2-4b3e-8aea-c1ea786a445e => generated 1314 bytes in 1292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:28:59.406788 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-e7182d89-afba-4082-be37-c38cc54fb872 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2deb449189ba427a9b8fcb0e21f22566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2c8716a46f54187902492f8ce162f58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:28:59.416710 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-e7182d89-afba-4082-be37-c38cc54fb872 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "GET /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529" status: 200 len: 1296 microversion: 2.1 time: 0.212379 Feb 17 04:28:59.424781 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 57/91] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:28:59 2021] GET /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529 => generated 1296 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:28:59.629396 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-de0dab06-ea20-4b60-9770-ad3908a81834 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:28:59.632739 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-de0dab06-ea20-4b60-9770-ad3908a81834 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] [instance: 2fe5b190-5679-4b9d-8d5f-fac1a1c407d9] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:28:59.645379 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-de0dab06-ea20-4b60-9770-ad3908a81834 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:28:59.646398 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-de0dab06-ea20-4b60-9770-ad3908a81834 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:28:59.648191 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-de0dab06-ea20-4b60-9770-ad3908a81834 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:28:59.649061 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-de0dab06-ea20-4b60-9770-ad3908a81834 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:00.219917 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-ed1b3851-c2af-4c25-b901-58932a42137e tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:29:00.220597 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-ed1b3851-c2af-4c25-b901-58932a42137e tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] [instance: 21edfff0-5c5c-43a5-a4e5-22ddd5f452eb] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:29:00.236671 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-ed1b3851-c2af-4c25-b901-58932a42137e tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:00.237210 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-ed1b3851-c2af-4c25-b901-58932a42137e tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:00.238496 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-ed1b3851-c2af-4c25-b901-58932a42137e tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:00.239221 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-ed1b3851-c2af-4c25-b901-58932a42137e tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:00.671084 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-de0dab06-ea20-4b60-9770-ad3908a81834 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1daf9a83b1d24033a3d4c0f531a4eb2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5336afdcf4aa4b46b0655432b7a1323c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:29:00.684150 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-de0dab06-ea20-4b60-9770-ad3908a81834 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] 10.222.0.78 "GET /compute/v2.1/servers/2fe5b190-5679-4b9d-8d5f-fac1a1c407d9" status: 200 len: 1321 microversion: 2.1 time: 1.061524 Feb 17 04:29:00.685707 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 35/92] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:28:59 2021] GET /compute/v2.1/servers/2fe5b190-5679-4b9d-8d5f-fac1a1c407d9 => generated 1321 bytes in 1064 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:29:00.696581 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-42aecff6-5505-421f-ab8b-715036e7e10b tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:29:00.697292 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-42aecff6-5505-421f-ab8b-715036e7e10b tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] [instance: fc3441c6-9dd2-4b3e-8aea-c1ea786a445e] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:29:00.705313 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-42aecff6-5505-421f-ab8b-715036e7e10b tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:00.706015 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-42aecff6-5505-421f-ab8b-715036e7e10b tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:00.707057 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-42aecff6-5505-421f-ab8b-715036e7e10b tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:00.712714 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-42aecff6-5505-421f-ab8b-715036e7e10b tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:00.950543 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-ed1b3851-c2af-4c25-b901-58932a42137e tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d68d4a6c12e4331b8df8191cdd7a669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2a1ca6347d4278899a1cc009d87d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:29:00.962550 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-ed1b3851-c2af-4c25-b901-58932a42137e tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] 10.222.0.78 "GET /compute/v2.1/servers/21edfff0-5c5c-43a5-a4e5-22ddd5f452eb" status: 200 len: 1318 microversion: 2.1 time: 0.746719 Feb 17 04:29:00.967625 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 58/93] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:29:00 2021] GET /compute/v2.1/servers/21edfff0-5c5c-43a5-a4e5-22ddd5f452eb => generated 1318 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:29:00.988128 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [req-b86e83a3-1d92-4d28-96c5-1b498d649897 req-f35569da-f851-41df-b6d4-730879f5b1ce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "20760e77-fe67-4ebe-87f1-34d840495341", "tag": "8f824d75-b2bf-47d0-90e8-3ba823dae40e"}]} {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:29:00.990740 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:29:00.990740 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: warnings.warn(msg) Feb 17 04:29:01.001108 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [req-b86e83a3-1d92-4d28-96c5-1b498d649897 req-f35569da-f851-41df-b6d4-730879f5b1ce service nova] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:01.001689 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [req-b86e83a3-1d92-4d28-96c5-1b498d649897 req-f35569da-f851-41df-b6d4-730879f5b1ce service nova] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:01.023728 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.compute.server_external_events [req-b86e83a3-1d92-4d28-96c5-1b498d649897 req-f35569da-f851-41df-b6d4-730879f5b1ce service nova] Creating event network-changed:8f824d75-b2bf-47d0-90e8-3ba823dae40e for instance 20760e77-fe67-4ebe-87f1-34d840495341 on hv-cinder-75998 Feb 17 04:29:01.034368 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [req-b86e83a3-1d92-4d28-96c5-1b498d649897 req-f35569da-f851-41df-b6d4-730879f5b1ce service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063685 Feb 17 04:29:01.035249 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 59/94] 10.222.0.78 () {64 vars in 1308 bytes} [Wed Feb 17 04:29:00 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:29:01.042168 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-32218a7c-f0b4-4a3b-ba97-ec51b31ae6f0 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:29:01.043090 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-32218a7c-f0b4-4a3b-ba97-ec51b31ae6f0 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: 29d1ce27-f63b-4523-88be-55f65a6a2529] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:29:01.054141 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-32218a7c-f0b4-4a3b-ba97-ec51b31ae6f0 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:01.054754 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-32218a7c-f0b4-4a3b-ba97-ec51b31ae6f0 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:01.055917 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-32218a7c-f0b4-4a3b-ba97-ec51b31ae6f0 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:01.056443 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-32218a7c-f0b4-4a3b-ba97-ec51b31ae6f0 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:01.405648 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-42aecff6-5505-421f-ab8b-715036e7e10b tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b59e91a6423843459340bbd8d875007e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd156b69e0ec24a8782b15c83a8c4cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:29:01.417713 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-42aecff6-5505-421f-ab8b-715036e7e10b tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] 10.222.0.78 "GET /compute/v2.1/servers/fc3441c6-9dd2-4b3e-8aea-c1ea786a445e" status: 200 len: 1314 microversion: 2.1 time: 0.724948 Feb 17 04:29:01.418315 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 36/95] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:29:00 2021] GET /compute/v2.1/servers/fc3441c6-9dd2-4b3e-8aea-c1ea786a445e => generated 1314 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:29:01.602591 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-32218a7c-f0b4-4a3b-ba97-ec51b31ae6f0 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2deb449189ba427a9b8fcb0e21f22566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2c8716a46f54187902492f8ce162f58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:29:01.616451 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-32218a7c-f0b4-4a3b-ba97-ec51b31ae6f0 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "GET /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529" status: 200 len: 1363 microversion: 2.1 time: 0.579817 Feb 17 04:29:01.617068 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 60/96] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:29:01 2021] GET /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529 => generated 1363 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:29:01.702523 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-f517aa08-e559-446a-beeb-937e51085d21 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:29:01.703250 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-f517aa08-e559-446a-beeb-937e51085d21 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] [instance: 2fe5b190-5679-4b9d-8d5f-fac1a1c407d9] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:29:01.720525 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-f517aa08-e559-446a-beeb-937e51085d21 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:01.721047 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-f517aa08-e559-446a-beeb-937e51085d21 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:01.721924 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-f517aa08-e559-446a-beeb-937e51085d21 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:01.722423 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-f517aa08-e559-446a-beeb-937e51085d21 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:01.771488 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [req-8e766fac-ae40-4ee7-94ef-a62d9675cff9 req-76bca08f-f1af-4d25-994e-8378042f8c51 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2fe5b190-5679-4b9d-8d5f-fac1a1c407d9", "tag": "c06f3049-4f07-4c51-9968-0a06c58bb377"}]} {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:29:01.774333 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:29:01.774333 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: warnings.warn(msg) Feb 17 04:29:01.805519 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [req-8e766fac-ae40-4ee7-94ef-a62d9675cff9 req-76bca08f-f1af-4d25-994e-8378042f8c51 service nova] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:01.806450 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [req-8e766fac-ae40-4ee7-94ef-a62d9675cff9 req-76bca08f-f1af-4d25-994e-8378042f8c51 service nova] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:01.851863 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.compute.server_external_events [req-8e766fac-ae40-4ee7-94ef-a62d9675cff9 req-76bca08f-f1af-4d25-994e-8378042f8c51 service nova] Creating event network-changed:c06f3049-4f07-4c51-9968-0a06c58bb377 for instance 2fe5b190-5679-4b9d-8d5f-fac1a1c407d9 on hv-cinder-75998 Feb 17 04:29:01.858889 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [req-8e766fac-ae40-4ee7-94ef-a62d9675cff9 req-76bca08f-f1af-4d25-994e-8378042f8c51 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091526 Feb 17 04:29:01.860105 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 61/97] 10.222.0.78 () {64 vars in 1308 bytes} [Wed Feb 17 04:29:01 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:29:01.984230 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-8e16e330-379d-431e-8c02-e1ccbcf53ace tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:29:01.985295 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-8e16e330-379d-431e-8c02-e1ccbcf53ace tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] [instance: 21edfff0-5c5c-43a5-a4e5-22ddd5f452eb] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:29:01.995995 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-8e16e330-379d-431e-8c02-e1ccbcf53ace tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:01.996738 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-8e16e330-379d-431e-8c02-e1ccbcf53ace tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:01.997733 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-8e16e330-379d-431e-8c02-e1ccbcf53ace tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:01.998827 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-8e16e330-379d-431e-8c02-e1ccbcf53ace tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:02.118107 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-f517aa08-e559-446a-beeb-937e51085d21 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1daf9a83b1d24033a3d4c0f531a4eb2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5336afdcf4aa4b46b0655432b7a1323c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:29:02.128480 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-f517aa08-e559-446a-beeb-937e51085d21 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] 10.222.0.78 "GET /compute/v2.1/servers/2fe5b190-5679-4b9d-8d5f-fac1a1c407d9" status: 200 len: 1321 microversion: 2.1 time: 0.429784 Feb 17 04:29:02.129333 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 37/98] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:29:01 2021] GET /compute/v2.1/servers/2fe5b190-5679-4b9d-8d5f-fac1a1c407d9 => generated 1321 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:29:02.331382 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-8e16e330-379d-431e-8c02-e1ccbcf53ace tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d68d4a6c12e4331b8df8191cdd7a669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2a1ca6347d4278899a1cc009d87d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:29:02.342073 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-8e16e330-379d-431e-8c02-e1ccbcf53ace tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] 10.222.0.78 "GET /compute/v2.1/servers/21edfff0-5c5c-43a5-a4e5-22ddd5f452eb" status: 200 len: 1318 microversion: 2.1 time: 0.363031 Feb 17 04:29:02.342869 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 62/99] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:29:01 2021] GET /compute/v2.1/servers/21edfff0-5c5c-43a5-a4e5-22ddd5f452eb => generated 1318 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:29:02.436594 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-cc9586d4-14fe-4943-b205-ae29d941f7af tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:29:02.437489 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-cc9586d4-14fe-4943-b205-ae29d941f7af tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] [instance: fc3441c6-9dd2-4b3e-8aea-c1ea786a445e] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:29:02.445663 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-cc9586d4-14fe-4943-b205-ae29d941f7af tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:02.446111 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-cc9586d4-14fe-4943-b205-ae29d941f7af tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:02.448048 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-cc9586d4-14fe-4943-b205-ae29d941f7af tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:02.448526 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-cc9586d4-14fe-4943-b205-ae29d941f7af tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:02.635560 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-ed5b2542-87ae-46f9-ac63-d6be567edad0 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:29:02.636539 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-ed5b2542-87ae-46f9-ac63-d6be567edad0 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: 29d1ce27-f63b-4523-88be-55f65a6a2529] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:29:02.644945 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-ed5b2542-87ae-46f9-ac63-d6be567edad0 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:02.645460 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-ed5b2542-87ae-46f9-ac63-d6be567edad0 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:02.646294 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-ed5b2542-87ae-46f9-ac63-d6be567edad0 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:02.646994 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-ed5b2542-87ae-46f9-ac63-d6be567edad0 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:02.688777 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-cc9586d4-14fe-4943-b205-ae29d941f7af tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b59e91a6423843459340bbd8d875007e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd156b69e0ec24a8782b15c83a8c4cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:29:02.706304 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-cc9586d4-14fe-4943-b205-ae29d941f7af tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] 10.222.0.78 "GET /compute/v2.1/servers/fc3441c6-9dd2-4b3e-8aea-c1ea786a445e" status: 200 len: 1314 microversion: 2.1 time: 0.273474 Feb 17 04:29:02.707595 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 38/100] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:29:02 2021] GET /compute/v2.1/servers/fc3441c6-9dd2-4b3e-8aea-c1ea786a445e => generated 1314 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:29:02.890152 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-ed5b2542-87ae-46f9-ac63-d6be567edad0 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2deb449189ba427a9b8fcb0e21f22566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2c8716a46f54187902492f8ce162f58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:29:02.901662 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-ed5b2542-87ae-46f9-ac63-d6be567edad0 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "GET /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529" status: 200 len: 1363 microversion: 2.1 time: 0.270434 Feb 17 04:29:02.909180 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 63/101] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:29:02 2021] GET /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529 => generated 1363 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:29:03.147498 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-8e0e642d-d34f-4e20-9666-dcff2d8b56b3 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:29:03.148452 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-8e0e642d-d34f-4e20-9666-dcff2d8b56b3 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] [instance: 2fe5b190-5679-4b9d-8d5f-fac1a1c407d9] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:29:03.157934 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-8e0e642d-d34f-4e20-9666-dcff2d8b56b3 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:03.159204 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-8e0e642d-d34f-4e20-9666-dcff2d8b56b3 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:03.160260 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-8e0e642d-d34f-4e20-9666-dcff2d8b56b3 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:03.160946 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-8e0e642d-d34f-4e20-9666-dcff2d8b56b3 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:03.360401 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-4d383023-be36-4405-92e3-c03cb2dc91d9 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:29:03.361066 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-4d383023-be36-4405-92e3-c03cb2dc91d9 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] [instance: 21edfff0-5c5c-43a5-a4e5-22ddd5f452eb] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:29:03.369535 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-4d383023-be36-4405-92e3-c03cb2dc91d9 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:03.370272 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-4d383023-be36-4405-92e3-c03cb2dc91d9 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:03.371282 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-4d383023-be36-4405-92e3-c03cb2dc91d9 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:03.371907 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-4d383023-be36-4405-92e3-c03cb2dc91d9 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:03.429593 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-8e0e642d-d34f-4e20-9666-dcff2d8b56b3 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1daf9a83b1d24033a3d4c0f531a4eb2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5336afdcf4aa4b46b0655432b7a1323c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:29:03.448385 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-8e0e642d-d34f-4e20-9666-dcff2d8b56b3 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] 10.222.0.78 "GET /compute/v2.1/servers/2fe5b190-5679-4b9d-8d5f-fac1a1c407d9" status: 200 len: 1321 microversion: 2.1 time: 0.305909 Feb 17 04:29:03.449561 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 39/102] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:29:03 2021] GET /compute/v2.1/servers/2fe5b190-5679-4b9d-8d5f-fac1a1c407d9 => generated 1321 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:29:03.655165 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-4d383023-be36-4405-92e3-c03cb2dc91d9 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d68d4a6c12e4331b8df8191cdd7a669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2a1ca6347d4278899a1cc009d87d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:29:03.664534 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-4d383023-be36-4405-92e3-c03cb2dc91d9 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] 10.222.0.78 "GET /compute/v2.1/servers/21edfff0-5c5c-43a5-a4e5-22ddd5f452eb" status: 200 len: 1318 microversion: 2.1 time: 0.308295 Feb 17 04:29:03.665167 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 64/103] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:29:03 2021] GET /compute/v2.1/servers/21edfff0-5c5c-43a5-a4e5-22ddd5f452eb => generated 1318 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:29:03.726574 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-28d07def-def7-4264-8f33-213b2873f63f tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:29:03.727279 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-28d07def-def7-4264-8f33-213b2873f63f tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] [instance: fc3441c6-9dd2-4b3e-8aea-c1ea786a445e] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:29:03.735734 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-28d07def-def7-4264-8f33-213b2873f63f tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:03.736378 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-28d07def-def7-4264-8f33-213b2873f63f tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:03.737351 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-28d07def-def7-4264-8f33-213b2873f63f tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:03.737854 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-28d07def-def7-4264-8f33-213b2873f63f tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:03.924507 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-3212e93f-6d0f-4b87-a1e1-1bba0d5ff6c3 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:29:03.925216 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-3212e93f-6d0f-4b87-a1e1-1bba0d5ff6c3 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: 29d1ce27-f63b-4523-88be-55f65a6a2529] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:29:03.938207 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-3212e93f-6d0f-4b87-a1e1-1bba0d5ff6c3 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:03.938724 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-3212e93f-6d0f-4b87-a1e1-1bba0d5ff6c3 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:03.939599 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-3212e93f-6d0f-4b87-a1e1-1bba0d5ff6c3 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:03.940094 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-3212e93f-6d0f-4b87-a1e1-1bba0d5ff6c3 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:04.217629 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-28d07def-def7-4264-8f33-213b2873f63f tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b59e91a6423843459340bbd8d875007e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd156b69e0ec24a8782b15c83a8c4cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:29:04.231559 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-28d07def-def7-4264-8f33-213b2873f63f tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] 10.222.0.78 "GET /compute/v2.1/servers/fc3441c6-9dd2-4b3e-8aea-c1ea786a445e" status: 200 len: 1314 microversion: 2.1 time: 0.509806 Feb 17 04:29:04.232476 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 40/104] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:29:03 2021] GET /compute/v2.1/servers/fc3441c6-9dd2-4b3e-8aea-c1ea786a445e => generated 1314 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:29:04.466021 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-3212e93f-6d0f-4b87-a1e1-1bba0d5ff6c3 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2deb449189ba427a9b8fcb0e21f22566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2c8716a46f54187902492f8ce162f58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:29:04.474758 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-cebcd632-c6d8-4c0e-8d4b-0aa9b741409a tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:29:04.475476 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-cebcd632-c6d8-4c0e-8d4b-0aa9b741409a tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] [instance: 2fe5b190-5679-4b9d-8d5f-fac1a1c407d9] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:29:04.481033 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-3212e93f-6d0f-4b87-a1e1-1bba0d5ff6c3 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "GET /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529" status: 200 len: 1363 microversion: 2.1 time: 0.561279 Feb 17 04:29:04.481639 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 65/105] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:29:03 2021] GET /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529 => generated 1363 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:29:04.483782 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-cebcd632-c6d8-4c0e-8d4b-0aa9b741409a tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:04.484430 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-cebcd632-c6d8-4c0e-8d4b-0aa9b741409a tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:04.485575 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-cebcd632-c6d8-4c0e-8d4b-0aa9b741409a tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:04.486368 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-cebcd632-c6d8-4c0e-8d4b-0aa9b741409a tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:04.682144 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-6fddcfa2-be75-46fb-a3b7-281c9609965f tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:29:04.683016 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-6fddcfa2-be75-46fb-a3b7-281c9609965f tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] [instance: 21edfff0-5c5c-43a5-a4e5-22ddd5f452eb] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:29:04.691570 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-6fddcfa2-be75-46fb-a3b7-281c9609965f tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:04.692238 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-6fddcfa2-be75-46fb-a3b7-281c9609965f tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:04.693409 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-6fddcfa2-be75-46fb-a3b7-281c9609965f tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:04.694237 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-6fddcfa2-be75-46fb-a3b7-281c9609965f tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:05.203971 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-6fddcfa2-be75-46fb-a3b7-281c9609965f tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d68d4a6c12e4331b8df8191cdd7a669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2a1ca6347d4278899a1cc009d87d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:29:05.220669 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-6fddcfa2-be75-46fb-a3b7-281c9609965f tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] 10.222.0.78 "GET /compute/v2.1/servers/21edfff0-5c5c-43a5-a4e5-22ddd5f452eb" status: 200 len: 1318 microversion: 2.1 time: 0.542540 Feb 17 04:29:05.221530 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 66/106] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:29:04 2021] GET /compute/v2.1/servers/21edfff0-5c5c-43a5-a4e5-22ddd5f452eb => generated 1318 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:29:05.249860 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-792ea649-2fbd-4313-9945-7b078025cec9 tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:29:05.250691 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-792ea649-2fbd-4313-9945-7b078025cec9 tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] [instance: fc3441c6-9dd2-4b3e-8aea-c1ea786a445e] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:29:05.261362 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-792ea649-2fbd-4313-9945-7b078025cec9 tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:05.268689 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-792ea649-2fbd-4313-9945-7b078025cec9 tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:05.269815 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-792ea649-2fbd-4313-9945-7b078025cec9 tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:05.270462 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-792ea649-2fbd-4313-9945-7b078025cec9 tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:05.695998 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-cebcd632-c6d8-4c0e-8d4b-0aa9b741409a tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1daf9a83b1d24033a3d4c0f531a4eb2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5336afdcf4aa4b46b0655432b7a1323c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:29:05.711160 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-cebcd632-c6d8-4c0e-8d4b-0aa9b741409a tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] 10.222.0.78 "GET /compute/v2.1/servers/2fe5b190-5679-4b9d-8d5f-fac1a1c407d9" status: 200 len: 1321 microversion: 2.1 time: 1.249117 Feb 17 04:29:05.713133 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 41/107] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:29:04 2021] GET /compute/v2.1/servers/2fe5b190-5679-4b9d-8d5f-fac1a1c407d9 => generated 1321 bytes in 1252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:29:05.720652 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-d6619968-9577-4805-bf9e-be2a95e0939f tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:29:05.721484 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-d6619968-9577-4805-bf9e-be2a95e0939f tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: 29d1ce27-f63b-4523-88be-55f65a6a2529] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:29:05.730743 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-d6619968-9577-4805-bf9e-be2a95e0939f tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:05.731393 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-d6619968-9577-4805-bf9e-be2a95e0939f tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:05.732627 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-d6619968-9577-4805-bf9e-be2a95e0939f tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:05.733609 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-d6619968-9577-4805-bf9e-be2a95e0939f tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:05.835541 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-792ea649-2fbd-4313-9945-7b078025cec9 tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b59e91a6423843459340bbd8d875007e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd156b69e0ec24a8782b15c83a8c4cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:29:05.845897 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-792ea649-2fbd-4313-9945-7b078025cec9 tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] 10.222.0.78 "GET /compute/v2.1/servers/fc3441c6-9dd2-4b3e-8aea-c1ea786a445e" status: 200 len: 1314 microversion: 2.1 time: 0.600554 Feb 17 04:29:05.846522 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 67/108] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:29:05 2021] GET /compute/v2.1/servers/fc3441c6-9dd2-4b3e-8aea-c1ea786a445e => generated 1314 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:29:06.240448 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-dc3460b5-34ae-4b01-bdeb-2e2f6104cec8 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:29:06.241592 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-dc3460b5-34ae-4b01-bdeb-2e2f6104cec8 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] [instance: 21edfff0-5c5c-43a5-a4e5-22ddd5f452eb] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:29:06.254314 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-dc3460b5-34ae-4b01-bdeb-2e2f6104cec8 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:06.255243 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-dc3460b5-34ae-4b01-bdeb-2e2f6104cec8 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:06.256880 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-dc3460b5-34ae-4b01-bdeb-2e2f6104cec8 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:06.257538 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-dc3460b5-34ae-4b01-bdeb-2e2f6104cec8 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:06.542119 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-dc3460b5-34ae-4b01-bdeb-2e2f6104cec8 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d68d4a6c12e4331b8df8191cdd7a669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2a1ca6347d4278899a1cc009d87d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:29:06.562871 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-dc3460b5-34ae-4b01-bdeb-2e2f6104cec8 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] 10.222.0.78 "GET /compute/v2.1/servers/21edfff0-5c5c-43a5-a4e5-22ddd5f452eb" status: 200 len: 1318 microversion: 2.1 time: 0.326999 Feb 17 04:29:06.568888 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 68/109] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:29:06 2021] GET /compute/v2.1/servers/21edfff0-5c5c-43a5-a4e5-22ddd5f452eb => generated 1318 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:29:06.731138 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-78bb1f92-c5da-4386-950e-2ae6c2e2c6dc tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:29:06.731971 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-78bb1f92-c5da-4386-950e-2ae6c2e2c6dc tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] [instance: 2fe5b190-5679-4b9d-8d5f-fac1a1c407d9] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:29:06.751525 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-78bb1f92-c5da-4386-950e-2ae6c2e2c6dc tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:06.753316 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-78bb1f92-c5da-4386-950e-2ae6c2e2c6dc tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:06.757335 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-78bb1f92-c5da-4386-950e-2ae6c2e2c6dc tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:06.758065 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-78bb1f92-c5da-4386-950e-2ae6c2e2c6dc tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:06.817444 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-d6619968-9577-4805-bf9e-be2a95e0939f tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2deb449189ba427a9b8fcb0e21f22566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2c8716a46f54187902492f8ce162f58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:29:06.829183 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-d6619968-9577-4805-bf9e-be2a95e0939f tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "GET /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529" status: 200 len: 1363 microversion: 2.1 time: 1.114642 Feb 17 04:29:06.835245 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 42/110] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:29:05 2021] GET /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529 => generated 1363 bytes in 1121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:29:06.864527 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-259f1e6f-115f-4d9c-9785-13e1b2a3aea4 tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:29:06.865589 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-259f1e6f-115f-4d9c-9785-13e1b2a3aea4 tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] [instance: fc3441c6-9dd2-4b3e-8aea-c1ea786a445e] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:29:06.884820 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-259f1e6f-115f-4d9c-9785-13e1b2a3aea4 tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:06.886460 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-259f1e6f-115f-4d9c-9785-13e1b2a3aea4 tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:06.889013 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-259f1e6f-115f-4d9c-9785-13e1b2a3aea4 tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:06.893869 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-259f1e6f-115f-4d9c-9785-13e1b2a3aea4 tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:07.144866 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-78bb1f92-c5da-4386-950e-2ae6c2e2c6dc tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1daf9a83b1d24033a3d4c0f531a4eb2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5336afdcf4aa4b46b0655432b7a1323c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:29:07.154249 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-78bb1f92-c5da-4386-950e-2ae6c2e2c6dc tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] 10.222.0.78 "GET /compute/v2.1/servers/2fe5b190-5679-4b9d-8d5f-fac1a1c407d9" status: 200 len: 1321 microversion: 2.1 time: 0.428324 Feb 17 04:29:07.154991 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 69/111] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:29:06 2021] GET /compute/v2.1/servers/2fe5b190-5679-4b9d-8d5f-fac1a1c407d9 => generated 1321 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:29:07.620736 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [req-05d8c060-3088-4abe-9ee7-2abd99a3768c req-41ef9e92-dc4b-4201-87a5-f7181c692877 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc3441c6-9dd2-4b3e-8aea-c1ea786a445e", "name": "network-vif-plugged", "status": "completed", "tag": "a3fb43ae-c2fe-478c-b9a6-913bf7c74695"}]} {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:29:07.623432 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:29:07.623432 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: warnings.warn(msg) Feb 17 04:29:07.645325 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [req-05d8c060-3088-4abe-9ee7-2abd99a3768c req-41ef9e92-dc4b-4201-87a5-f7181c692877 service nova] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:07.645830 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [req-05d8c060-3088-4abe-9ee7-2abd99a3768c req-41ef9e92-dc4b-4201-87a5-f7181c692877 service nova] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:07.683049 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.compute.server_external_events [req-05d8c060-3088-4abe-9ee7-2abd99a3768c req-41ef9e92-dc4b-4201-87a5-f7181c692877 service nova] Creating event network-vif-plugged:a3fb43ae-c2fe-478c-b9a6-913bf7c74695 for instance fc3441c6-9dd2-4b3e-8aea-c1ea786a445e on hv-cinder-75998 Feb 17 04:29:07.693475 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [req-05d8c060-3088-4abe-9ee7-2abd99a3768c req-41ef9e92-dc4b-4201-87a5-f7181c692877 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.182402 Feb 17 04:29:07.694408 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 70/112] 10.222.0.78 () {64 vars in 1308 bytes} [Wed Feb 17 04:29:07 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:29:07.700809 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-1c40ef91-0efe-46ed-bbd6-de8ce30fbecc tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:29:07.701574 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-1c40ef91-0efe-46ed-bbd6-de8ce30fbecc tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] [instance: 21edfff0-5c5c-43a5-a4e5-22ddd5f452eb] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:29:07.721066 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-1c40ef91-0efe-46ed-bbd6-de8ce30fbecc tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:07.721574 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-1c40ef91-0efe-46ed-bbd6-de8ce30fbecc tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:07.722434 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-1c40ef91-0efe-46ed-bbd6-de8ce30fbecc tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:07.722914 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-1c40ef91-0efe-46ed-bbd6-de8ce30fbecc tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:07.867916 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-259f1e6f-115f-4d9c-9785-13e1b2a3aea4 tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b59e91a6423843459340bbd8d875007e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd156b69e0ec24a8782b15c83a8c4cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:29:07.881299 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-259f1e6f-115f-4d9c-9785-13e1b2a3aea4 tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] 10.222.0.78 "GET /compute/v2.1/servers/fc3441c6-9dd2-4b3e-8aea-c1ea786a445e" status: 200 len: 1314 microversion: 2.1 time: 1.020937 Feb 17 04:29:07.882645 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 43/113] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:29:06 2021] GET /compute/v2.1/servers/fc3441c6-9dd2-4b3e-8aea-c1ea786a445e => generated 1314 bytes in 1023 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:29:07.896089 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-2fab80e9-c13c-43d2-b443-7389bef4af76 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:29:07.898344 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-2fab80e9-c13c-43d2-b443-7389bef4af76 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: 29d1ce27-f63b-4523-88be-55f65a6a2529] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:29:07.920746 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-2fab80e9-c13c-43d2-b443-7389bef4af76 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:07.921519 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-2fab80e9-c13c-43d2-b443-7389bef4af76 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:07.923259 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-2fab80e9-c13c-43d2-b443-7389bef4af76 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:07.923899 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-2fab80e9-c13c-43d2-b443-7389bef4af76 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:08.087863 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-1c40ef91-0efe-46ed-bbd6-de8ce30fbecc tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d68d4a6c12e4331b8df8191cdd7a669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2a1ca6347d4278899a1cc009d87d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:29:08.099636 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-1c40ef91-0efe-46ed-bbd6-de8ce30fbecc tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] 10.222.0.78 "GET /compute/v2.1/servers/21edfff0-5c5c-43a5-a4e5-22ddd5f452eb" status: 200 len: 1318 microversion: 2.1 time: 0.403601 Feb 17 04:29:08.100614 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 71/114] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:29:07 2021] GET /compute/v2.1/servers/21edfff0-5c5c-43a5-a4e5-22ddd5f452eb => generated 1318 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:29:08.107108 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [req-58db90f1-b590-4f4f-8353-d98abbed688a req-607fcbd3-a3e7-49f1-b513-ad55a503cf62 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "29d1ce27-f63b-4523-88be-55f65a6a2529", "tag": "55e2629a-f0a2-41a8-b1d3-df6b83ba5111"}]} {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:29:08.108818 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:29:08.108818 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: warnings.warn(msg) Feb 17 04:29:08.119859 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [req-58db90f1-b590-4f4f-8353-d98abbed688a req-607fcbd3-a3e7-49f1-b513-ad55a503cf62 service nova] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:08.120473 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [req-58db90f1-b590-4f4f-8353-d98abbed688a req-607fcbd3-a3e7-49f1-b513-ad55a503cf62 service nova] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:08.140126 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.compute.server_external_events [req-58db90f1-b590-4f4f-8353-d98abbed688a req-607fcbd3-a3e7-49f1-b513-ad55a503cf62 service nova] Creating event network-changed:55e2629a-f0a2-41a8-b1d3-df6b83ba5111 for instance 29d1ce27-f63b-4523-88be-55f65a6a2529 on hv-cinder-75998 Feb 17 04:29:08.151653 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [req-58db90f1-b590-4f4f-8353-d98abbed688a req-607fcbd3-a3e7-49f1-b513-ad55a503cf62 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044130 Feb 17 04:29:08.152415 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 72/115] 10.222.0.78 () {64 vars in 1308 bytes} [Wed Feb 17 04:29:08 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:29:08.173869 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-ae15e75b-b5b0-482a-b8b2-d3c53358767e tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:29:08.174759 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-ae15e75b-b5b0-482a-b8b2-d3c53358767e tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] [instance: 2fe5b190-5679-4b9d-8d5f-fac1a1c407d9] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:29:08.183100 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-ae15e75b-b5b0-482a-b8b2-d3c53358767e tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:08.183700 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-ae15e75b-b5b0-482a-b8b2-d3c53358767e tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:08.184618 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-ae15e75b-b5b0-482a-b8b2-d3c53358767e tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:08.185186 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-ae15e75b-b5b0-482a-b8b2-d3c53358767e tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:08.201594 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-2fab80e9-c13c-43d2-b443-7389bef4af76 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2deb449189ba427a9b8fcb0e21f22566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2c8716a46f54187902492f8ce162f58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:29:08.210638 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-2fab80e9-c13c-43d2-b443-7389bef4af76 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "GET /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529" status: 200 len: 1363 microversion: 2.1 time: 0.325263 Feb 17 04:29:08.211266 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 44/116] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:29:07 2021] GET /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529 => generated 1363 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:29:08.397522 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-ae15e75b-b5b0-482a-b8b2-d3c53358767e tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1daf9a83b1d24033a3d4c0f531a4eb2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5336afdcf4aa4b46b0655432b7a1323c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:29:08.407345 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-ae15e75b-b5b0-482a-b8b2-d3c53358767e tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] 10.222.0.78 "GET /compute/v2.1/servers/2fe5b190-5679-4b9d-8d5f-fac1a1c407d9" status: 200 len: 1321 microversion: 2.1 time: 0.237971 Feb 17 04:29:08.408269 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 73/117] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:29:08 2021] GET /compute/v2.1/servers/2fe5b190-5679-4b9d-8d5f-fac1a1c407d9 => generated 1321 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:29:08.902799 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-b5d541fc-5f5a-4c50-8639-76253396d18a tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:29:08.903516 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-b5d541fc-5f5a-4c50-8639-76253396d18a tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] [instance: fc3441c6-9dd2-4b3e-8aea-c1ea786a445e] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:29:08.923740 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-b5d541fc-5f5a-4c50-8639-76253396d18a tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:08.924724 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-b5d541fc-5f5a-4c50-8639-76253396d18a tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:08.925616 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-b5d541fc-5f5a-4c50-8639-76253396d18a tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:08.926107 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-b5d541fc-5f5a-4c50-8639-76253396d18a tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:09.118334 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-bddb16fe-d4a9-43c5-943b-aa5ea514e314 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:29:09.119157 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-bddb16fe-d4a9-43c5-943b-aa5ea514e314 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] [instance: 21edfff0-5c5c-43a5-a4e5-22ddd5f452eb] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:29:09.131401 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-bddb16fe-d4a9-43c5-943b-aa5ea514e314 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:09.132035 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-bddb16fe-d4a9-43c5-943b-aa5ea514e314 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:09.132943 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-bddb16fe-d4a9-43c5-943b-aa5ea514e314 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:09.133463 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-bddb16fe-d4a9-43c5-943b-aa5ea514e314 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:09.164645 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-b5d541fc-5f5a-4c50-8639-76253396d18a tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b59e91a6423843459340bbd8d875007e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd156b69e0ec24a8782b15c83a8c4cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:29:09.174477 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-b5d541fc-5f5a-4c50-8639-76253396d18a tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] 10.222.0.78 "GET /compute/v2.1/servers/fc3441c6-9dd2-4b3e-8aea-c1ea786a445e" status: 200 len: 1314 microversion: 2.1 time: 0.276510 Feb 17 04:29:09.175693 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 45/118] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:29:08 2021] GET /compute/v2.1/servers/fc3441c6-9dd2-4b3e-8aea-c1ea786a445e => generated 1314 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:29:09.230208 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-b1ba52cb-22ac-4d4d-9e59-f889ed716bd2 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:29:09.230884 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-b1ba52cb-22ac-4d4d-9e59-f889ed716bd2 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: 29d1ce27-f63b-4523-88be-55f65a6a2529] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:29:09.240493 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-b1ba52cb-22ac-4d4d-9e59-f889ed716bd2 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:09.240493 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-b1ba52cb-22ac-4d4d-9e59-f889ed716bd2 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:09.240644 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-b1ba52cb-22ac-4d4d-9e59-f889ed716bd2 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:09.241127 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-b1ba52cb-22ac-4d4d-9e59-f889ed716bd2 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:09.374909 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-bddb16fe-d4a9-43c5-943b-aa5ea514e314 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d68d4a6c12e4331b8df8191cdd7a669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2a1ca6347d4278899a1cc009d87d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:29:09.384767 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-bddb16fe-d4a9-43c5-943b-aa5ea514e314 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] 10.222.0.78 "GET /compute/v2.1/servers/21edfff0-5c5c-43a5-a4e5-22ddd5f452eb" status: 200 len: 1318 microversion: 2.1 time: 0.270542 Feb 17 04:29:09.385391 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 74/119] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:29:09 2021] GET /compute/v2.1/servers/21edfff0-5c5c-43a5-a4e5-22ddd5f452eb => generated 1318 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:29:09.425063 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-70369fd2-6ff6-4947-bda3-09e993d47de5 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:29:09.425699 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-70369fd2-6ff6-4947-bda3-09e993d47de5 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] [instance: 2fe5b190-5679-4b9d-8d5f-fac1a1c407d9] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:29:09.434327 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-70369fd2-6ff6-4947-bda3-09e993d47de5 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:09.434760 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-70369fd2-6ff6-4947-bda3-09e993d47de5 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:09.435701 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-70369fd2-6ff6-4947-bda3-09e993d47de5 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:09.436115 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-70369fd2-6ff6-4947-bda3-09e993d47de5 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:09.458779 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-b1ba52cb-22ac-4d4d-9e59-f889ed716bd2 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2deb449189ba427a9b8fcb0e21f22566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2c8716a46f54187902492f8ce162f58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:29:09.467936 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-b1ba52cb-22ac-4d4d-9e59-f889ed716bd2 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "GET /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529" status: 200 len: 1363 microversion: 2.1 time: 0.242035 Feb 17 04:29:09.468568 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 46/120] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:29:09 2021] GET /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529 => generated 1363 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:29:09.761363 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-70369fd2-6ff6-4947-bda3-09e993d47de5 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1daf9a83b1d24033a3d4c0f531a4eb2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5336afdcf4aa4b46b0655432b7a1323c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:29:09.770260 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-70369fd2-6ff6-4947-bda3-09e993d47de5 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] 10.222.0.78 "GET /compute/v2.1/servers/2fe5b190-5679-4b9d-8d5f-fac1a1c407d9" status: 200 len: 1321 microversion: 2.1 time: 0.349542 Feb 17 04:29:09.770864 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 75/121] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:29:09 2021] GET /compute/v2.1/servers/2fe5b190-5679-4b9d-8d5f-fac1a1c407d9 => generated 1321 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:29:10.193196 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-004fffb6-6219-4a69-9e06-e3fedf9684e2 tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:29:10.193878 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-004fffb6-6219-4a69-9e06-e3fedf9684e2 tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] [instance: fc3441c6-9dd2-4b3e-8aea-c1ea786a445e] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:29:10.201773 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-004fffb6-6219-4a69-9e06-e3fedf9684e2 tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:10.202286 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-004fffb6-6219-4a69-9e06-e3fedf9684e2 tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:10.203164 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-004fffb6-6219-4a69-9e06-e3fedf9684e2 tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:10.203635 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-004fffb6-6219-4a69-9e06-e3fedf9684e2 tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:10.403736 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-122df2a3-44b8-43cf-a46a-a6930f7c467a tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:29:10.404462 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-122df2a3-44b8-43cf-a46a-a6930f7c467a tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] [instance: 21edfff0-5c5c-43a5-a4e5-22ddd5f452eb] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:29:10.413530 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-122df2a3-44b8-43cf-a46a-a6930f7c467a tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:10.414196 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-122df2a3-44b8-43cf-a46a-a6930f7c467a tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:10.415412 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-122df2a3-44b8-43cf-a46a-a6930f7c467a tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:10.416192 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-122df2a3-44b8-43cf-a46a-a6930f7c467a tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:10.421176 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-004fffb6-6219-4a69-9e06-e3fedf9684e2 tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b59e91a6423843459340bbd8d875007e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd156b69e0ec24a8782b15c83a8c4cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:29:10.431425 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-004fffb6-6219-4a69-9e06-e3fedf9684e2 tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] 10.222.0.78 "GET /compute/v2.1/servers/fc3441c6-9dd2-4b3e-8aea-c1ea786a445e" status: 200 len: 1314 microversion: 2.1 time: 0.241161 Feb 17 04:29:10.431847 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 47/122] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:29:10 2021] GET /compute/v2.1/servers/fc3441c6-9dd2-4b3e-8aea-c1ea786a445e => generated 1314 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:29:10.485960 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-95d6834f-fb1a-418e-8e47-848d2342b18b tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:29:10.486927 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-95d6834f-fb1a-418e-8e47-848d2342b18b tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: 29d1ce27-f63b-4523-88be-55f65a6a2529] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:29:10.495849 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-95d6834f-fb1a-418e-8e47-848d2342b18b tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:10.496580 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-95d6834f-fb1a-418e-8e47-848d2342b18b tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:10.497647 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-95d6834f-fb1a-418e-8e47-848d2342b18b tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:10.498208 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-95d6834f-fb1a-418e-8e47-848d2342b18b tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:10.643341 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-122df2a3-44b8-43cf-a46a-a6930f7c467a tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d68d4a6c12e4331b8df8191cdd7a669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2a1ca6347d4278899a1cc009d87d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:29:10.655135 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-122df2a3-44b8-43cf-a46a-a6930f7c467a tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] 10.222.0.78 "GET /compute/v2.1/servers/21edfff0-5c5c-43a5-a4e5-22ddd5f452eb" status: 200 len: 1318 microversion: 2.1 time: 0.255413 Feb 17 04:29:10.656077 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 76/123] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:29:10 2021] GET /compute/v2.1/servers/21edfff0-5c5c-43a5-a4e5-22ddd5f452eb => generated 1318 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:29:10.722539 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-95d6834f-fb1a-418e-8e47-848d2342b18b tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2deb449189ba427a9b8fcb0e21f22566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2c8716a46f54187902492f8ce162f58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:29:10.732185 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-95d6834f-fb1a-418e-8e47-848d2342b18b tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "GET /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529" status: 200 len: 1363 microversion: 2.1 time: 0.250308 Feb 17 04:29:10.732865 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 48/124] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:29:10 2021] GET /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529 => generated 1363 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:29:10.788776 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-d3985e39-8401-45e9-a0d0-46fe7fbb7c7d tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:29:10.789218 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-d3985e39-8401-45e9-a0d0-46fe7fbb7c7d tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] [instance: 2fe5b190-5679-4b9d-8d5f-fac1a1c407d9] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:29:10.798096 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-d3985e39-8401-45e9-a0d0-46fe7fbb7c7d tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:10.798612 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-d3985e39-8401-45e9-a0d0-46fe7fbb7c7d tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:10.799518 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-d3985e39-8401-45e9-a0d0-46fe7fbb7c7d tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:10.800019 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-d3985e39-8401-45e9-a0d0-46fe7fbb7c7d tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:11.017526 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-d3985e39-8401-45e9-a0d0-46fe7fbb7c7d tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1daf9a83b1d24033a3d4c0f531a4eb2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5336afdcf4aa4b46b0655432b7a1323c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:29:11.027128 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-d3985e39-8401-45e9-a0d0-46fe7fbb7c7d tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] 10.222.0.78 "GET /compute/v2.1/servers/2fe5b190-5679-4b9d-8d5f-fac1a1c407d9" status: 200 len: 1321 microversion: 2.1 time: 0.242660 Feb 17 04:29:11.027734 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 77/125] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:29:10 2021] GET /compute/v2.1/servers/2fe5b190-5679-4b9d-8d5f-fac1a1c407d9 => generated 1321 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:29:11.448352 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-52173fc6-6e83-4503-9bfb-54eec77e3bc1 tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:29:11.449023 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-52173fc6-6e83-4503-9bfb-54eec77e3bc1 tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] [instance: fc3441c6-9dd2-4b3e-8aea-c1ea786a445e] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:29:11.457041 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-52173fc6-6e83-4503-9bfb-54eec77e3bc1 tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:11.457545 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-52173fc6-6e83-4503-9bfb-54eec77e3bc1 tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:11.458379 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-52173fc6-6e83-4503-9bfb-54eec77e3bc1 tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:11.458868 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-52173fc6-6e83-4503-9bfb-54eec77e3bc1 tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:11.673556 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-e25b9459-7859-4e46-92eb-76f868ceff78 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:29:11.674231 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-e25b9459-7859-4e46-92eb-76f868ceff78 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] [instance: 21edfff0-5c5c-43a5-a4e5-22ddd5f452eb] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:29:11.679718 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-52173fc6-6e83-4503-9bfb-54eec77e3bc1 tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b59e91a6423843459340bbd8d875007e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd156b69e0ec24a8782b15c83a8c4cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:29:11.683109 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-e25b9459-7859-4e46-92eb-76f868ceff78 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:11.683623 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-e25b9459-7859-4e46-92eb-76f868ceff78 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:11.684477 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-e25b9459-7859-4e46-92eb-76f868ceff78 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:11.684973 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-e25b9459-7859-4e46-92eb-76f868ceff78 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:11.689735 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-52173fc6-6e83-4503-9bfb-54eec77e3bc1 tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] 10.222.0.78 "GET /compute/v2.1/servers/fc3441c6-9dd2-4b3e-8aea-c1ea786a445e" status: 200 len: 1314 microversion: 2.1 time: 0.245759 Feb 17 04:29:11.694613 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 49/126] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:29:11 2021] GET /compute/v2.1/servers/fc3441c6-9dd2-4b3e-8aea-c1ea786a445e => generated 1314 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:29:11.750970 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-480939a6-2572-4721-9c14-0562f58d3117 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:29:11.752066 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-480939a6-2572-4721-9c14-0562f58d3117 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: 29d1ce27-f63b-4523-88be-55f65a6a2529] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:29:11.761180 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-480939a6-2572-4721-9c14-0562f58d3117 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:11.761690 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-480939a6-2572-4721-9c14-0562f58d3117 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:11.762537 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-480939a6-2572-4721-9c14-0562f58d3117 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:11.763051 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-480939a6-2572-4721-9c14-0562f58d3117 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:11.924304 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-e25b9459-7859-4e46-92eb-76f868ceff78 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d68d4a6c12e4331b8df8191cdd7a669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2a1ca6347d4278899a1cc009d87d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:29:11.934026 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-e25b9459-7859-4e46-92eb-76f868ceff78 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] 10.222.0.78 "GET /compute/v2.1/servers/21edfff0-5c5c-43a5-a4e5-22ddd5f452eb" status: 200 len: 1318 microversion: 2.1 time: 0.264436 Feb 17 04:29:11.934879 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 78/127] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:29:11 2021] GET /compute/v2.1/servers/21edfff0-5c5c-43a5-a4e5-22ddd5f452eb => generated 1318 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:29:11.998812 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-480939a6-2572-4721-9c14-0562f58d3117 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2deb449189ba427a9b8fcb0e21f22566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2c8716a46f54187902492f8ce162f58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:29:12.007715 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-480939a6-2572-4721-9c14-0562f58d3117 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "GET /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529" status: 200 len: 1363 microversion: 2.1 time: 0.260912 Feb 17 04:29:12.008327 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 50/128] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:29:11 2021] GET /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529 => generated 1363 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:29:12.044543 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-e77114fe-3f5b-4c40-9c47-2eda6844c981 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:29:12.045147 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-e77114fe-3f5b-4c40-9c47-2eda6844c981 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] [instance: 2fe5b190-5679-4b9d-8d5f-fac1a1c407d9] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:29:12.053105 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-e77114fe-3f5b-4c40-9c47-2eda6844c981 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:12.053616 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-e77114fe-3f5b-4c40-9c47-2eda6844c981 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:12.054462 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-e77114fe-3f5b-4c40-9c47-2eda6844c981 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:12.054953 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-e77114fe-3f5b-4c40-9c47-2eda6844c981 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:12.372090 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-e77114fe-3f5b-4c40-9c47-2eda6844c981 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1daf9a83b1d24033a3d4c0f531a4eb2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5336afdcf4aa4b46b0655432b7a1323c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:29:12.381032 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-e77114fe-3f5b-4c40-9c47-2eda6844c981 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] 10.222.0.78 "GET /compute/v2.1/servers/2fe5b190-5679-4b9d-8d5f-fac1a1c407d9" status: 200 len: 1321 microversion: 2.1 time: 0.340791 Feb 17 04:29:12.381674 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 79/129] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:29:12 2021] GET /compute/v2.1/servers/2fe5b190-5679-4b9d-8d5f-fac1a1c407d9 => generated 1321 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:29:12.708453 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-b1edc119-5a53-4700-a293-043dac427e98 tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:29:12.709425 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-b1edc119-5a53-4700-a293-043dac427e98 tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] [instance: fc3441c6-9dd2-4b3e-8aea-c1ea786a445e] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:29:12.719519 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-b1edc119-5a53-4700-a293-043dac427e98 tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:12.720371 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-b1edc119-5a53-4700-a293-043dac427e98 tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:12.721234 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-b1edc119-5a53-4700-a293-043dac427e98 tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:12.721731 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-b1edc119-5a53-4700-a293-043dac427e98 tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:12.952520 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-b1edc119-5a53-4700-a293-043dac427e98 tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b59e91a6423843459340bbd8d875007e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd156b69e0ec24a8782b15c83a8c4cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:29:12.952679 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-c99ac3ce-084c-4fe1-b62a-7605b33ca5d2 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:29:12.953289 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-c99ac3ce-084c-4fe1-b62a-7605b33ca5d2 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] [instance: 21edfff0-5c5c-43a5-a4e5-22ddd5f452eb] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:29:12.961168 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-c99ac3ce-084c-4fe1-b62a-7605b33ca5d2 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:12.961569 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-b1edc119-5a53-4700-a293-043dac427e98 tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] 10.222.0.78 "GET /compute/v2.1/servers/fc3441c6-9dd2-4b3e-8aea-c1ea786a445e" status: 200 len: 1314 microversion: 2.1 time: 0.257106 Feb 17 04:29:12.961713 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-c99ac3ce-084c-4fe1-b62a-7605b33ca5d2 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:12.962485 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 51/130] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:29:12 2021] GET /compute/v2.1/servers/fc3441c6-9dd2-4b3e-8aea-c1ea786a445e => generated 1314 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:29:12.962620 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-c99ac3ce-084c-4fe1-b62a-7605b33ca5d2 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:12.962990 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-c99ac3ce-084c-4fe1-b62a-7605b33ca5d2 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:13.027291 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-e78f5575-a747-4512-a11f-0323a724067c tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:29:13.027954 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-e78f5575-a747-4512-a11f-0323a724067c tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: 29d1ce27-f63b-4523-88be-55f65a6a2529] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:29:13.035890 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-e78f5575-a747-4512-a11f-0323a724067c tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:13.036390 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-e78f5575-a747-4512-a11f-0323a724067c tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:13.037206 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-e78f5575-a747-4512-a11f-0323a724067c tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:13.037688 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-e78f5575-a747-4512-a11f-0323a724067c tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:13.183591 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-c99ac3ce-084c-4fe1-b62a-7605b33ca5d2 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d68d4a6c12e4331b8df8191cdd7a669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2a1ca6347d4278899a1cc009d87d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:29:13.193080 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-c99ac3ce-084c-4fe1-b62a-7605b33ca5d2 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] 10.222.0.78 "GET /compute/v2.1/servers/21edfff0-5c5c-43a5-a4e5-22ddd5f452eb" status: 200 len: 1318 microversion: 2.1 time: 0.244403 Feb 17 04:29:13.193684 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 80/131] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:29:12 2021] GET /compute/v2.1/servers/21edfff0-5c5c-43a5-a4e5-22ddd5f452eb => generated 1318 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:29:13.254658 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-e78f5575-a747-4512-a11f-0323a724067c tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2deb449189ba427a9b8fcb0e21f22566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2c8716a46f54187902492f8ce162f58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:29:13.263594 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-e78f5575-a747-4512-a11f-0323a724067c tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "GET /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529" status: 200 len: 1363 microversion: 2.1 time: 0.240677 Feb 17 04:29:13.264194 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 52/132] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:29:13 2021] GET /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529 => generated 1363 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:29:13.401048 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-d54a329c-8226-4645-a482-6cc04730167c tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:29:13.401814 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-d54a329c-8226-4645-a482-6cc04730167c tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] [instance: 2fe5b190-5679-4b9d-8d5f-fac1a1c407d9] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:29:13.409773 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-d54a329c-8226-4645-a482-6cc04730167c tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:13.410287 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-d54a329c-8226-4645-a482-6cc04730167c tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:13.411168 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-d54a329c-8226-4645-a482-6cc04730167c tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:13.411828 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-d54a329c-8226-4645-a482-6cc04730167c tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:13.628742 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-d54a329c-8226-4645-a482-6cc04730167c tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1daf9a83b1d24033a3d4c0f531a4eb2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5336afdcf4aa4b46b0655432b7a1323c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:29:13.638120 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-d54a329c-8226-4645-a482-6cc04730167c tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] 10.222.0.78 "GET /compute/v2.1/servers/2fe5b190-5679-4b9d-8d5f-fac1a1c407d9" status: 200 len: 1321 microversion: 2.1 time: 0.242043 Feb 17 04:29:13.638666 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 81/133] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:29:13 2021] GET /compute/v2.1/servers/2fe5b190-5679-4b9d-8d5f-fac1a1c407d9 => generated 1321 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:29:13.981408 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-a7c2a52b-9daa-4c2f-9d90-9f86b9bdd9f8 tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:29:13.982085 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-a7c2a52b-9daa-4c2f-9d90-9f86b9bdd9f8 tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] [instance: fc3441c6-9dd2-4b3e-8aea-c1ea786a445e] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:29:13.990666 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-a7c2a52b-9daa-4c2f-9d90-9f86b9bdd9f8 tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:13.991202 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-a7c2a52b-9daa-4c2f-9d90-9f86b9bdd9f8 tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:13.992051 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-a7c2a52b-9daa-4c2f-9d90-9f86b9bdd9f8 tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:13.992539 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-a7c2a52b-9daa-4c2f-9d90-9f86b9bdd9f8 tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:14.212673 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-97444064-a54b-49a1-92f1-4dcedd227e30 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:29:14.213777 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-97444064-a54b-49a1-92f1-4dcedd227e30 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] [instance: 21edfff0-5c5c-43a5-a4e5-22ddd5f452eb] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:29:14.223323 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-97444064-a54b-49a1-92f1-4dcedd227e30 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:14.224002 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-97444064-a54b-49a1-92f1-4dcedd227e30 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:14.225685 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-97444064-a54b-49a1-92f1-4dcedd227e30 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:14.226185 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-97444064-a54b-49a1-92f1-4dcedd227e30 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:14.270705 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-a7c2a52b-9daa-4c2f-9d90-9f86b9bdd9f8 tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b59e91a6423843459340bbd8d875007e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd156b69e0ec24a8782b15c83a8c4cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:29:14.282188 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-a7c2a52b-9daa-4c2f-9d90-9f86b9bdd9f8 tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] 10.222.0.78 "GET /compute/v2.1/servers/fc3441c6-9dd2-4b3e-8aea-c1ea786a445e" status: 200 len: 1314 microversion: 2.1 time: 0.306358 Feb 17 04:29:14.282785 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 53/134] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:29:13 2021] GET /compute/v2.1/servers/fc3441c6-9dd2-4b3e-8aea-c1ea786a445e => generated 1314 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:29:14.287630 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-95151511-2295-4901-b32a-3a28b8f8e7cd tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:29:14.288493 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-95151511-2295-4901-b32a-3a28b8f8e7cd tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: 29d1ce27-f63b-4523-88be-55f65a6a2529] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:29:14.296628 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-95151511-2295-4901-b32a-3a28b8f8e7cd tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:14.297367 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-95151511-2295-4901-b32a-3a28b8f8e7cd tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:14.298221 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-95151511-2295-4901-b32a-3a28b8f8e7cd tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:14.298716 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-95151511-2295-4901-b32a-3a28b8f8e7cd tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:14.451259 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-97444064-a54b-49a1-92f1-4dcedd227e30 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d68d4a6c12e4331b8df8191cdd7a669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2a1ca6347d4278899a1cc009d87d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:29:14.476382 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-97444064-a54b-49a1-92f1-4dcedd227e30 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] 10.222.0.78 "GET /compute/v2.1/servers/21edfff0-5c5c-43a5-a4e5-22ddd5f452eb" status: 200 len: 1318 microversion: 2.1 time: 0.268373 Feb 17 04:29:14.479249 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 82/135] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:29:14 2021] GET /compute/v2.1/servers/21edfff0-5c5c-43a5-a4e5-22ddd5f452eb => generated 1318 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:29:14.564516 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [req-6575df99-02d0-444f-b9ec-635325cb6edd req-ed22b497-5ce1-439b-8eae-d2ded286d9ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21edfff0-5c5c-43a5-a4e5-22ddd5f452eb", "name": "network-vif-plugged", "status": "completed", "tag": "e825e7f4-3daa-4bfe-9c61-a440fc5474f1"}]} {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:29:14.566663 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:29:14.566663 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: warnings.warn(msg) Feb 17 04:29:14.577539 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [req-6575df99-02d0-444f-b9ec-635325cb6edd req-ed22b497-5ce1-439b-8eae-d2ded286d9ac service nova] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:14.578404 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [req-6575df99-02d0-444f-b9ec-635325cb6edd req-ed22b497-5ce1-439b-8eae-d2ded286d9ac service nova] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:14.598295 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.compute.server_external_events [req-6575df99-02d0-444f-b9ec-635325cb6edd req-ed22b497-5ce1-439b-8eae-d2ded286d9ac service nova] Creating event network-vif-plugged:e825e7f4-3daa-4bfe-9c61-a440fc5474f1 for instance 21edfff0-5c5c-43a5-a4e5-22ddd5f452eb on hv-cinder-75998 Feb 17 04:29:14.604407 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [req-6575df99-02d0-444f-b9ec-635325cb6edd req-ed22b497-5ce1-439b-8eae-d2ded286d9ac service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043707 Feb 17 04:29:14.605902 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 83/136] 10.222.0.78 () {64 vars in 1308 bytes} [Wed Feb 17 04:29:14 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:29:14.657641 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-550ff3dd-3cfa-47ba-b250-5cf618bae4df tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:29:14.658432 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-550ff3dd-3cfa-47ba-b250-5cf618bae4df tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] [instance: 2fe5b190-5679-4b9d-8d5f-fac1a1c407d9] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:29:14.670719 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-95151511-2295-4901-b32a-3a28b8f8e7cd tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2deb449189ba427a9b8fcb0e21f22566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2c8716a46f54187902492f8ce162f58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:29:14.671434 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-550ff3dd-3cfa-47ba-b250-5cf618bae4df tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:14.675126 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-550ff3dd-3cfa-47ba-b250-5cf618bae4df tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:14.676100 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-550ff3dd-3cfa-47ba-b250-5cf618bae4df tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:14.676410 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-550ff3dd-3cfa-47ba-b250-5cf618bae4df tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:14.690098 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-95151511-2295-4901-b32a-3a28b8f8e7cd tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "GET /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529" status: 200 len: 1363 microversion: 2.1 time: 0.405918 Feb 17 04:29:14.695344 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 54/137] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:29:14 2021] GET /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529 => generated 1363 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:29:14.996226 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-550ff3dd-3cfa-47ba-b250-5cf618bae4df tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1daf9a83b1d24033a3d4c0f531a4eb2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5336afdcf4aa4b46b0655432b7a1323c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:29:15.005617 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-550ff3dd-3cfa-47ba-b250-5cf618bae4df tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] 10.222.0.78 "GET /compute/v2.1/servers/2fe5b190-5679-4b9d-8d5f-fac1a1c407d9" status: 200 len: 1321 microversion: 2.1 time: 0.353274 Feb 17 04:29:15.006221 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 84/138] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:29:14 2021] GET /compute/v2.1/servers/2fe5b190-5679-4b9d-8d5f-fac1a1c407d9 => generated 1321 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:29:15.300242 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-b956de51-c712-4c46-8e47-5ea418dee775 tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:29:15.301125 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-b956de51-c712-4c46-8e47-5ea418dee775 tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] [instance: fc3441c6-9dd2-4b3e-8aea-c1ea786a445e] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:29:15.309723 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-b956de51-c712-4c46-8e47-5ea418dee775 tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:15.310231 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-b956de51-c712-4c46-8e47-5ea418dee775 tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:15.311142 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-b956de51-c712-4c46-8e47-5ea418dee775 tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:15.311636 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-b956de51-c712-4c46-8e47-5ea418dee775 tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:15.499217 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-cc811d15-113b-4779-9163-c7c79fba6f56 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:29:15.500630 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-cc811d15-113b-4779-9163-c7c79fba6f56 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] [instance: 21edfff0-5c5c-43a5-a4e5-22ddd5f452eb] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:29:15.513163 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-cc811d15-113b-4779-9163-c7c79fba6f56 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:15.514233 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-cc811d15-113b-4779-9163-c7c79fba6f56 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:15.515867 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-cc811d15-113b-4779-9163-c7c79fba6f56 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:15.516951 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-cc811d15-113b-4779-9163-c7c79fba6f56 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:15.536301 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-b956de51-c712-4c46-8e47-5ea418dee775 tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b59e91a6423843459340bbd8d875007e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd156b69e0ec24a8782b15c83a8c4cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:29:15.548977 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-b956de51-c712-4c46-8e47-5ea418dee775 tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] 10.222.0.78 "GET /compute/v2.1/servers/fc3441c6-9dd2-4b3e-8aea-c1ea786a445e" status: 200 len: 1314 microversion: 2.1 time: 0.252663 Feb 17 04:29:15.549857 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 55/139] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:29:15 2021] GET /compute/v2.1/servers/fc3441c6-9dd2-4b3e-8aea-c1ea786a445e => generated 1314 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:29:15.709803 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-ae1336fd-4dfd-45be-9c47-68ec706d40a6 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:29:15.710471 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-ae1336fd-4dfd-45be-9c47-68ec706d40a6 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: 29d1ce27-f63b-4523-88be-55f65a6a2529] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:29:15.729386 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-ae1336fd-4dfd-45be-9c47-68ec706d40a6 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:15.730448 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-ae1336fd-4dfd-45be-9c47-68ec706d40a6 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:15.731612 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-ae1336fd-4dfd-45be-9c47-68ec706d40a6 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:15.735296 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-ae1336fd-4dfd-45be-9c47-68ec706d40a6 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:15.833316 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-cc811d15-113b-4779-9163-c7c79fba6f56 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d68d4a6c12e4331b8df8191cdd7a669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2a1ca6347d4278899a1cc009d87d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:29:15.845353 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-cc811d15-113b-4779-9163-c7c79fba6f56 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] 10.222.0.78 "GET /compute/v2.1/servers/21edfff0-5c5c-43a5-a4e5-22ddd5f452eb" status: 200 len: 1318 microversion: 2.1 time: 0.352072 Feb 17 04:29:15.846505 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 85/140] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:29:15 2021] GET /compute/v2.1/servers/21edfff0-5c5c-43a5-a4e5-22ddd5f452eb => generated 1318 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:29:15.986524 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-ae1336fd-4dfd-45be-9c47-68ec706d40a6 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2deb449189ba427a9b8fcb0e21f22566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2c8716a46f54187902492f8ce162f58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:29:15.996877 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-ae1336fd-4dfd-45be-9c47-68ec706d40a6 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "GET /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529" status: 200 len: 1363 microversion: 2.1 time: 0.290833 Feb 17 04:29:16.003713 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 56/141] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:29:15 2021] GET /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529 => generated 1363 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:29:16.025669 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-0e74a075-8ef8-4e30-8706-7f90bdd6382f tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:29:16.026388 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-0e74a075-8ef8-4e30-8706-7f90bdd6382f tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] [instance: 2fe5b190-5679-4b9d-8d5f-fac1a1c407d9] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:29:16.034340 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-0e74a075-8ef8-4e30-8706-7f90bdd6382f tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:16.035014 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-0e74a075-8ef8-4e30-8706-7f90bdd6382f tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:16.035915 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-0e74a075-8ef8-4e30-8706-7f90bdd6382f tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:16.036461 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-0e74a075-8ef8-4e30-8706-7f90bdd6382f tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:16.275132 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-0e74a075-8ef8-4e30-8706-7f90bdd6382f tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1daf9a83b1d24033a3d4c0f531a4eb2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5336afdcf4aa4b46b0655432b7a1323c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:29:16.284348 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-0e74a075-8ef8-4e30-8706-7f90bdd6382f tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] 10.222.0.78 "GET /compute/v2.1/servers/2fe5b190-5679-4b9d-8d5f-fac1a1c407d9" status: 200 len: 1321 microversion: 2.1 time: 0.263048 Feb 17 04:29:16.285184 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 86/142] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:29:16 2021] GET /compute/v2.1/servers/2fe5b190-5679-4b9d-8d5f-fac1a1c407d9 => generated 1321 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:29:16.568803 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-d39c21b8-e37f-4b2a-80ab-6a54b543e722 tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:29:16.569753 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-d39c21b8-e37f-4b2a-80ab-6a54b543e722 tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] [instance: fc3441c6-9dd2-4b3e-8aea-c1ea786a445e] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:29:16.579325 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-d39c21b8-e37f-4b2a-80ab-6a54b543e722 tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:16.580116 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-d39c21b8-e37f-4b2a-80ab-6a54b543e722 tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:16.581193 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-d39c21b8-e37f-4b2a-80ab-6a54b543e722 tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:16.581913 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-d39c21b8-e37f-4b2a-80ab-6a54b543e722 tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:16.837818 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-d39c21b8-e37f-4b2a-80ab-6a54b543e722 tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b59e91a6423843459340bbd8d875007e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd156b69e0ec24a8782b15c83a8c4cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:29:16.851452 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-d39c21b8-e37f-4b2a-80ab-6a54b543e722 tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] 10.222.0.78 "GET /compute/v2.1/servers/fc3441c6-9dd2-4b3e-8aea-c1ea786a445e" status: 200 len: 1314 microversion: 2.1 time: 0.286500 Feb 17 04:29:16.852695 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 57/143] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:29:16 2021] GET /compute/v2.1/servers/fc3441c6-9dd2-4b3e-8aea-c1ea786a445e => generated 1314 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:29:16.864454 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-083eee70-d74d-4ce9-adb5-6d889f804e76 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:29:16.865315 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-083eee70-d74d-4ce9-adb5-6d889f804e76 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] [instance: 21edfff0-5c5c-43a5-a4e5-22ddd5f452eb] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:29:16.873781 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-083eee70-d74d-4ce9-adb5-6d889f804e76 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:16.874310 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-083eee70-d74d-4ce9-adb5-6d889f804e76 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:16.875174 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-083eee70-d74d-4ce9-adb5-6d889f804e76 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:16.875679 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-083eee70-d74d-4ce9-adb5-6d889f804e76 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:17.016038 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-72c3645b-364c-4a93-be63-a085ebdc36dc tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:29:17.016721 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-72c3645b-364c-4a93-be63-a085ebdc36dc tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: 29d1ce27-f63b-4523-88be-55f65a6a2529] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:29:17.026194 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-72c3645b-364c-4a93-be63-a085ebdc36dc tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:17.026736 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-72c3645b-364c-4a93-be63-a085ebdc36dc tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:17.027807 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-72c3645b-364c-4a93-be63-a085ebdc36dc tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:17.028462 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-72c3645b-364c-4a93-be63-a085ebdc36dc tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:17.119593 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-083eee70-d74d-4ce9-adb5-6d889f804e76 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d68d4a6c12e4331b8df8191cdd7a669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2a1ca6347d4278899a1cc009d87d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:29:17.150808 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-083eee70-d74d-4ce9-adb5-6d889f804e76 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] 10.222.0.78 "GET /compute/v2.1/servers/21edfff0-5c5c-43a5-a4e5-22ddd5f452eb" status: 200 len: 1318 microversion: 2.1 time: 0.290454 Feb 17 04:29:17.151595 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 87/144] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:29:16 2021] GET /compute/v2.1/servers/21edfff0-5c5c-43a5-a4e5-22ddd5f452eb => generated 1318 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:29:17.272288 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-72c3645b-364c-4a93-be63-a085ebdc36dc tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2deb449189ba427a9b8fcb0e21f22566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2c8716a46f54187902492f8ce162f58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:29:17.281464 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-72c3645b-364c-4a93-be63-a085ebdc36dc tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "GET /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529" status: 200 len: 1363 microversion: 2.1 time: 0.269379 Feb 17 04:29:17.282072 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 58/145] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:29:17 2021] GET /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529 => generated 1363 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:29:17.301975 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-5a14be45-b8d1-4d1c-a575-33bed8dc7990 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:29:17.302640 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-5a14be45-b8d1-4d1c-a575-33bed8dc7990 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] [instance: 2fe5b190-5679-4b9d-8d5f-fac1a1c407d9] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:29:17.311257 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-5a14be45-b8d1-4d1c-a575-33bed8dc7990 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:17.311770 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-5a14be45-b8d1-4d1c-a575-33bed8dc7990 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:17.312600 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-5a14be45-b8d1-4d1c-a575-33bed8dc7990 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:17.313112 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-5a14be45-b8d1-4d1c-a575-33bed8dc7990 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:17.528341 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-5a14be45-b8d1-4d1c-a575-33bed8dc7990 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1daf9a83b1d24033a3d4c0f531a4eb2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5336afdcf4aa4b46b0655432b7a1323c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:29:17.537689 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-5a14be45-b8d1-4d1c-a575-33bed8dc7990 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] 10.222.0.78 "GET /compute/v2.1/servers/2fe5b190-5679-4b9d-8d5f-fac1a1c407d9" status: 200 len: 1321 microversion: 2.1 time: 0.239717 Feb 17 04:29:17.538287 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 88/146] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:29:17 2021] GET /compute/v2.1/servers/2fe5b190-5679-4b9d-8d5f-fac1a1c407d9 => generated 1321 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:29:17.870389 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-d22cf041-dae0-4182-a303-7ea42c355fbf tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:29:17.870978 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-d22cf041-dae0-4182-a303-7ea42c355fbf tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] [instance: fc3441c6-9dd2-4b3e-8aea-c1ea786a445e] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:29:17.878803 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-d22cf041-dae0-4182-a303-7ea42c355fbf tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:17.879335 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-d22cf041-dae0-4182-a303-7ea42c355fbf tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:17.880163 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-d22cf041-dae0-4182-a303-7ea42c355fbf tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:17.880652 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-d22cf041-dae0-4182-a303-7ea42c355fbf tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:18.096911 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-d22cf041-dae0-4182-a303-7ea42c355fbf tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b59e91a6423843459340bbd8d875007e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd156b69e0ec24a8782b15c83a8c4cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:29:18.106633 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-d22cf041-dae0-4182-a303-7ea42c355fbf tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] 10.222.0.78 "GET /compute/v2.1/servers/fc3441c6-9dd2-4b3e-8aea-c1ea786a445e" status: 200 len: 1314 microversion: 2.1 time: 0.240427 Feb 17 04:29:18.107268 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 59/147] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:29:17 2021] GET /compute/v2.1/servers/fc3441c6-9dd2-4b3e-8aea-c1ea786a445e => generated 1314 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:29:18.170075 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-03f575f9-9a6c-434b-ae63-67606e01bba6 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:29:18.170676 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-03f575f9-9a6c-434b-ae63-67606e01bba6 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] [instance: 21edfff0-5c5c-43a5-a4e5-22ddd5f452eb] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:29:18.178556 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-03f575f9-9a6c-434b-ae63-67606e01bba6 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:18.179102 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-03f575f9-9a6c-434b-ae63-67606e01bba6 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:18.179938 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-03f575f9-9a6c-434b-ae63-67606e01bba6 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:18.180613 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-03f575f9-9a6c-434b-ae63-67606e01bba6 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:18.299330 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-920cce70-1b68-4130-8fd8-c46245ef6b1e tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:29:18.300004 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-920cce70-1b68-4130-8fd8-c46245ef6b1e tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: 29d1ce27-f63b-4523-88be-55f65a6a2529] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:29:18.307925 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-920cce70-1b68-4130-8fd8-c46245ef6b1e tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:18.308437 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-920cce70-1b68-4130-8fd8-c46245ef6b1e tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:18.309277 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-920cce70-1b68-4130-8fd8-c46245ef6b1e tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:18.309771 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-920cce70-1b68-4130-8fd8-c46245ef6b1e tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:18.396955 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-03f575f9-9a6c-434b-ae63-67606e01bba6 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d68d4a6c12e4331b8df8191cdd7a669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2a1ca6347d4278899a1cc009d87d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:29:18.406532 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-03f575f9-9a6c-434b-ae63-67606e01bba6 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] 10.222.0.78 "GET /compute/v2.1/servers/21edfff0-5c5c-43a5-a4e5-22ddd5f452eb" status: 200 len: 1318 microversion: 2.1 time: 0.241624 Feb 17 04:29:18.407133 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 89/148] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:29:18 2021] GET /compute/v2.1/servers/21edfff0-5c5c-43a5-a4e5-22ddd5f452eb => generated 1318 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:29:18.521163 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-920cce70-1b68-4130-8fd8-c46245ef6b1e tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2deb449189ba427a9b8fcb0e21f22566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2c8716a46f54187902492f8ce162f58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:29:18.530092 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-920cce70-1b68-4130-8fd8-c46245ef6b1e tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "GET /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529" status: 200 len: 1363 microversion: 2.1 time: 0.234739 Feb 17 04:29:18.530688 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 60/149] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:29:18 2021] GET /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529 => generated 1363 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:29:18.556963 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-a7011247-97d4-4e63-bcdc-e28a47e75209 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:29:18.557641 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-a7011247-97d4-4e63-bcdc-e28a47e75209 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] [instance: 2fe5b190-5679-4b9d-8d5f-fac1a1c407d9] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:29:18.565501 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-a7011247-97d4-4e63-bcdc-e28a47e75209 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:18.566012 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-a7011247-97d4-4e63-bcdc-e28a47e75209 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:18.566847 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-a7011247-97d4-4e63-bcdc-e28a47e75209 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:18.567392 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-a7011247-97d4-4e63-bcdc-e28a47e75209 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:18.780410 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-a7011247-97d4-4e63-bcdc-e28a47e75209 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1daf9a83b1d24033a3d4c0f531a4eb2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5336afdcf4aa4b46b0655432b7a1323c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:29:18.789088 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-a7011247-97d4-4e63-bcdc-e28a47e75209 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] 10.222.0.78 "GET /compute/v2.1/servers/2fe5b190-5679-4b9d-8d5f-fac1a1c407d9" status: 200 len: 1321 microversion: 2.1 time: 0.236677 Feb 17 04:29:18.790295 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 90/150] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:29:18 2021] GET /compute/v2.1/servers/2fe5b190-5679-4b9d-8d5f-fac1a1c407d9 => generated 1321 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:29:19.125531 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-4b391188-94cb-4b3d-b74e-7089378985c7 tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:29:19.127195 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-4b391188-94cb-4b3d-b74e-7089378985c7 tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] [instance: fc3441c6-9dd2-4b3e-8aea-c1ea786a445e] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:29:19.143383 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-4b391188-94cb-4b3d-b74e-7089378985c7 tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:19.143911 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-4b391188-94cb-4b3d-b74e-7089378985c7 tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:19.147879 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-4b391188-94cb-4b3d-b74e-7089378985c7 tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:19.148400 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-4b391188-94cb-4b3d-b74e-7089378985c7 tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:19.367248 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-4b391188-94cb-4b3d-b74e-7089378985c7 tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b59e91a6423843459340bbd8d875007e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd156b69e0ec24a8782b15c83a8c4cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:29:19.376779 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-4b391188-94cb-4b3d-b74e-7089378985c7 tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] 10.222.0.78 "GET /compute/v2.1/servers/fc3441c6-9dd2-4b3e-8aea-c1ea786a445e" status: 200 len: 1314 microversion: 2.1 time: 0.255501 Feb 17 04:29:19.377373 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 61/151] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:29:19 2021] GET /compute/v2.1/servers/fc3441c6-9dd2-4b3e-8aea-c1ea786a445e => generated 1314 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:29:19.424975 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-a64f0571-36c9-46cb-b5d8-236859315bab tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:29:19.425650 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-a64f0571-36c9-46cb-b5d8-236859315bab tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] [instance: 21edfff0-5c5c-43a5-a4e5-22ddd5f452eb] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:29:19.433783 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-a64f0571-36c9-46cb-b5d8-236859315bab tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:19.434293 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-a64f0571-36c9-46cb-b5d8-236859315bab tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:19.435158 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-a64f0571-36c9-46cb-b5d8-236859315bab tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:19.435661 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-a64f0571-36c9-46cb-b5d8-236859315bab tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:19.549057 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-cf98dde2-e2b2-443a-ac2e-c81c2d594c3d tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:29:19.549852 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-cf98dde2-e2b2-443a-ac2e-c81c2d594c3d tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: 29d1ce27-f63b-4523-88be-55f65a6a2529] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:29:19.557835 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-cf98dde2-e2b2-443a-ac2e-c81c2d594c3d tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:19.558445 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-cf98dde2-e2b2-443a-ac2e-c81c2d594c3d tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:19.559398 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-cf98dde2-e2b2-443a-ac2e-c81c2d594c3d tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:19.559970 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-cf98dde2-e2b2-443a-ac2e-c81c2d594c3d tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:19.654264 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-a64f0571-36c9-46cb-b5d8-236859315bab tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d68d4a6c12e4331b8df8191cdd7a669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2a1ca6347d4278899a1cc009d87d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:29:19.663415 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-a64f0571-36c9-46cb-b5d8-236859315bab tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] 10.222.0.78 "GET /compute/v2.1/servers/21edfff0-5c5c-43a5-a4e5-22ddd5f452eb" status: 200 len: 1318 microversion: 2.1 time: 0.242337 Feb 17 04:29:19.664008 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 91/152] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:29:19 2021] GET /compute/v2.1/servers/21edfff0-5c5c-43a5-a4e5-22ddd5f452eb => generated 1318 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:29:19.778882 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-cf98dde2-e2b2-443a-ac2e-c81c2d594c3d tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2deb449189ba427a9b8fcb0e21f22566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2c8716a46f54187902492f8ce162f58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:29:19.787581 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-cf98dde2-e2b2-443a-ac2e-c81c2d594c3d tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "GET /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529" status: 200 len: 1363 microversion: 2.1 time: 0.242727 Feb 17 04:29:19.788160 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 62/153] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:29:19 2021] GET /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529 => generated 1363 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:29:19.807371 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-6fe2fb84-a83f-48a6-a211-dc56c1e9ac08 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:29:19.808044 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-6fe2fb84-a83f-48a6-a211-dc56c1e9ac08 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] [instance: 2fe5b190-5679-4b9d-8d5f-fac1a1c407d9] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:29:19.815787 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-6fe2fb84-a83f-48a6-a211-dc56c1e9ac08 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:19.816295 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-6fe2fb84-a83f-48a6-a211-dc56c1e9ac08 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:19.817126 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-6fe2fb84-a83f-48a6-a211-dc56c1e9ac08 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:19.817613 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-6fe2fb84-a83f-48a6-a211-dc56c1e9ac08 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:20.029332 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-6fe2fb84-a83f-48a6-a211-dc56c1e9ac08 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1daf9a83b1d24033a3d4c0f531a4eb2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5336afdcf4aa4b46b0655432b7a1323c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:29:20.038271 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-6fe2fb84-a83f-48a6-a211-dc56c1e9ac08 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] 10.222.0.78 "GET /compute/v2.1/servers/2fe5b190-5679-4b9d-8d5f-fac1a1c407d9" status: 200 len: 1321 microversion: 2.1 time: 0.235044 Feb 17 04:29:20.038869 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 92/154] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:29:19 2021] GET /compute/v2.1/servers/2fe5b190-5679-4b9d-8d5f-fac1a1c407d9 => generated 1321 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:29:20.395617 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-73fabdec-aa21-4bbb-8ba5-c8efad13eb4e tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:29:20.396292 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-73fabdec-aa21-4bbb-8ba5-c8efad13eb4e tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] [instance: fc3441c6-9dd2-4b3e-8aea-c1ea786a445e] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:29:20.404275 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-73fabdec-aa21-4bbb-8ba5-c8efad13eb4e tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:20.404753 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-73fabdec-aa21-4bbb-8ba5-c8efad13eb4e tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:20.405618 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-73fabdec-aa21-4bbb-8ba5-c8efad13eb4e tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:20.406103 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-73fabdec-aa21-4bbb-8ba5-c8efad13eb4e tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:20.616715 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-73fabdec-aa21-4bbb-8ba5-c8efad13eb4e tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b59e91a6423843459340bbd8d875007e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd156b69e0ec24a8782b15c83a8c4cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:29:20.625911 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-73fabdec-aa21-4bbb-8ba5-c8efad13eb4e tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] 10.222.0.78 "GET /compute/v2.1/servers/fc3441c6-9dd2-4b3e-8aea-c1ea786a445e" status: 200 len: 1314 microversion: 2.1 time: 0.234387 Feb 17 04:29:20.626503 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 63/155] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:29:20 2021] GET /compute/v2.1/servers/fc3441c6-9dd2-4b3e-8aea-c1ea786a445e => generated 1314 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:29:20.682820 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-fa0f32b4-5585-4407-9bfe-417be2c9bc80 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:29:20.683520 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-fa0f32b4-5585-4407-9bfe-417be2c9bc80 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] [instance: 21edfff0-5c5c-43a5-a4e5-22ddd5f452eb] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:29:20.691440 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-fa0f32b4-5585-4407-9bfe-417be2c9bc80 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:20.691951 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-fa0f32b4-5585-4407-9bfe-417be2c9bc80 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:20.692794 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-fa0f32b4-5585-4407-9bfe-417be2c9bc80 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:20.693285 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-fa0f32b4-5585-4407-9bfe-417be2c9bc80 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:20.807652 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-277f22f3-cc8c-4188-8c32-b1dc7ca16188 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:29:20.808343 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-277f22f3-cc8c-4188-8c32-b1dc7ca16188 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: 29d1ce27-f63b-4523-88be-55f65a6a2529] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:29:20.817414 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-277f22f3-cc8c-4188-8c32-b1dc7ca16188 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:20.817868 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-277f22f3-cc8c-4188-8c32-b1dc7ca16188 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:20.818865 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-277f22f3-cc8c-4188-8c32-b1dc7ca16188 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:20.819392 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-277f22f3-cc8c-4188-8c32-b1dc7ca16188 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:20.921294 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-fa0f32b4-5585-4407-9bfe-417be2c9bc80 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d68d4a6c12e4331b8df8191cdd7a669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2a1ca6347d4278899a1cc009d87d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:29:20.930627 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-fa0f32b4-5585-4407-9bfe-417be2c9bc80 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] 10.222.0.78 "GET /compute/v2.1/servers/21edfff0-5c5c-43a5-a4e5-22ddd5f452eb" status: 200 len: 1318 microversion: 2.1 time: 0.252387 Feb 17 04:29:20.931537 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 93/156] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:29:20 2021] GET /compute/v2.1/servers/21edfff0-5c5c-43a5-a4e5-22ddd5f452eb => generated 1318 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:29:21.045402 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-277f22f3-cc8c-4188-8c32-b1dc7ca16188 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2deb449189ba427a9b8fcb0e21f22566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2c8716a46f54187902492f8ce162f58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:29:21.054381 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-277f22f3-cc8c-4188-8c32-b1dc7ca16188 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "GET /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529" status: 200 len: 1363 microversion: 2.1 time: 0.252326 Feb 17 04:29:21.054978 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 64/157] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:29:20 2021] GET /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529 => generated 1363 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:29:21.056243 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-9eb8c79f-afda-4aa2-a2de-2a5e68985212 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:29:21.056915 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-9eb8c79f-afda-4aa2-a2de-2a5e68985212 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] [instance: 2fe5b190-5679-4b9d-8d5f-fac1a1c407d9] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:29:21.064856 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-9eb8c79f-afda-4aa2-a2de-2a5e68985212 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:21.065363 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-9eb8c79f-afda-4aa2-a2de-2a5e68985212 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:21.066201 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-9eb8c79f-afda-4aa2-a2de-2a5e68985212 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:21.066696 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-9eb8c79f-afda-4aa2-a2de-2a5e68985212 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:21.283262 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-9eb8c79f-afda-4aa2-a2de-2a5e68985212 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1daf9a83b1d24033a3d4c0f531a4eb2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5336afdcf4aa4b46b0655432b7a1323c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:29:21.292792 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-9eb8c79f-afda-4aa2-a2de-2a5e68985212 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] 10.222.0.78 "GET /compute/v2.1/servers/2fe5b190-5679-4b9d-8d5f-fac1a1c407d9" status: 200 len: 1321 microversion: 2.1 time: 0.240699 Feb 17 04:29:21.293402 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 94/158] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:29:21 2021] GET /compute/v2.1/servers/2fe5b190-5679-4b9d-8d5f-fac1a1c407d9 => generated 1321 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:29:21.644134 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-ad71bf46-2d29-404d-b809-dd6c9333824a tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:29:21.644753 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-ad71bf46-2d29-404d-b809-dd6c9333824a tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] [instance: fc3441c6-9dd2-4b3e-8aea-c1ea786a445e] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:29:21.653931 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-ad71bf46-2d29-404d-b809-dd6c9333824a tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:21.654445 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-ad71bf46-2d29-404d-b809-dd6c9333824a tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:21.655366 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-ad71bf46-2d29-404d-b809-dd6c9333824a tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:21.655865 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-ad71bf46-2d29-404d-b809-dd6c9333824a tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:21.870309 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-ad71bf46-2d29-404d-b809-dd6c9333824a tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b59e91a6423843459340bbd8d875007e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd156b69e0ec24a8782b15c83a8c4cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:29:21.879420 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-ad71bf46-2d29-404d-b809-dd6c9333824a tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] 10.222.0.78 "GET /compute/v2.1/servers/fc3441c6-9dd2-4b3e-8aea-c1ea786a445e" status: 200 len: 1314 microversion: 2.1 time: 0.239538 Feb 17 04:29:21.880013 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 65/159] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:29:21 2021] GET /compute/v2.1/servers/fc3441c6-9dd2-4b3e-8aea-c1ea786a445e => generated 1314 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:29:21.949365 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-1d931bab-f325-45ce-981f-102a03595cc0 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:29:21.950047 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-1d931bab-f325-45ce-981f-102a03595cc0 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] [instance: 21edfff0-5c5c-43a5-a4e5-22ddd5f452eb] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:29:21.957916 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-1d931bab-f325-45ce-981f-102a03595cc0 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:21.958431 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-1d931bab-f325-45ce-981f-102a03595cc0 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:21.959308 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-1d931bab-f325-45ce-981f-102a03595cc0 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:21.959802 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-1d931bab-f325-45ce-981f-102a03595cc0 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:22.072643 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-93b2aab1-e85b-4783-9610-67b81115b0ab tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:29:22.073321 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-93b2aab1-e85b-4783-9610-67b81115b0ab tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: 29d1ce27-f63b-4523-88be-55f65a6a2529] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:29:22.081561 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-93b2aab1-e85b-4783-9610-67b81115b0ab tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:22.082074 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-93b2aab1-e85b-4783-9610-67b81115b0ab tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:22.082923 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-93b2aab1-e85b-4783-9610-67b81115b0ab tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:22.083446 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-93b2aab1-e85b-4783-9610-67b81115b0ab tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:22.192873 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-1d931bab-f325-45ce-981f-102a03595cc0 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d68d4a6c12e4331b8df8191cdd7a669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2a1ca6347d4278899a1cc009d87d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:29:22.202669 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-1d931bab-f325-45ce-981f-102a03595cc0 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] 10.222.0.78 "GET /compute/v2.1/servers/21edfff0-5c5c-43a5-a4e5-22ddd5f452eb" status: 200 len: 1318 microversion: 2.1 time: 0.257885 Feb 17 04:29:22.203336 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 95/160] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:29:21 2021] GET /compute/v2.1/servers/21edfff0-5c5c-43a5-a4e5-22ddd5f452eb => generated 1318 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:29:22.310884 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-b9892f76-ae87-42fd-b216-d3d8981fb061 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:29:22.311591 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-b9892f76-ae87-42fd-b216-d3d8981fb061 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] [instance: 2fe5b190-5679-4b9d-8d5f-fac1a1c407d9] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:29:22.316495 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-93b2aab1-e85b-4783-9610-67b81115b0ab tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2deb449189ba427a9b8fcb0e21f22566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2c8716a46f54187902492f8ce162f58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:29:22.319608 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-b9892f76-ae87-42fd-b216-d3d8981fb061 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:22.320117 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-b9892f76-ae87-42fd-b216-d3d8981fb061 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:22.321010 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-b9892f76-ae87-42fd-b216-d3d8981fb061 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:22.321605 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-b9892f76-ae87-42fd-b216-d3d8981fb061 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:22.326569 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-93b2aab1-e85b-4783-9610-67b81115b0ab tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "GET /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529" status: 200 len: 1363 microversion: 2.1 time: 0.258482 Feb 17 04:29:22.327412 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 66/161] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:29:22 2021] GET /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529 => generated 1363 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:29:22.569074 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-b9892f76-ae87-42fd-b216-d3d8981fb061 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1daf9a83b1d24033a3d4c0f531a4eb2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5336afdcf4aa4b46b0655432b7a1323c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:29:22.578836 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-b9892f76-ae87-42fd-b216-d3d8981fb061 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] 10.222.0.78 "GET /compute/v2.1/servers/2fe5b190-5679-4b9d-8d5f-fac1a1c407d9" status: 200 len: 1321 microversion: 2.1 time: 0.272047 Feb 17 04:29:22.584050 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 96/162] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:29:22 2021] GET /compute/v2.1/servers/2fe5b190-5679-4b9d-8d5f-fac1a1c407d9 => generated 1321 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:29:22.897485 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-0f5636eb-9f23-4a4a-b07f-b2803787aa53 tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:29:22.898165 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-0f5636eb-9f23-4a4a-b07f-b2803787aa53 tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] [instance: fc3441c6-9dd2-4b3e-8aea-c1ea786a445e] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:29:22.907288 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-0f5636eb-9f23-4a4a-b07f-b2803787aa53 tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:22.907802 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-0f5636eb-9f23-4a4a-b07f-b2803787aa53 tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:22.908639 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-0f5636eb-9f23-4a4a-b07f-b2803787aa53 tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:22.909128 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-0f5636eb-9f23-4a4a-b07f-b2803787aa53 tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:23.135937 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-0f5636eb-9f23-4a4a-b07f-b2803787aa53 tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b59e91a6423843459340bbd8d875007e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd156b69e0ec24a8782b15c83a8c4cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:29:23.145238 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-0f5636eb-9f23-4a4a-b07f-b2803787aa53 tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] 10.222.0.78 "GET /compute/v2.1/servers/fc3441c6-9dd2-4b3e-8aea-c1ea786a445e" status: 200 len: 1501 microversion: 2.1 time: 0.251823 Feb 17 04:29:23.146294 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 67/163] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:29:22 2021] GET /compute/v2.1/servers/fc3441c6-9dd2-4b3e-8aea-c1ea786a445e => generated 1501 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:29:23.220953 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-7d0adfa0-9593-4842-b2eb-b7073fbb4293 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:29:23.221631 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-7d0adfa0-9593-4842-b2eb-b7073fbb4293 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] [instance: 21edfff0-5c5c-43a5-a4e5-22ddd5f452eb] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:29:23.229996 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-7d0adfa0-9593-4842-b2eb-b7073fbb4293 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:23.230506 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-7d0adfa0-9593-4842-b2eb-b7073fbb4293 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:23.231386 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-7d0adfa0-9593-4842-b2eb-b7073fbb4293 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:23.231883 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-7d0adfa0-9593-4842-b2eb-b7073fbb4293 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:23.345943 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-d63f4b7d-4c34-4181-8479-5ba9bcc90efa tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:29:23.346615 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-d63f4b7d-4c34-4181-8479-5ba9bcc90efa tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: 29d1ce27-f63b-4523-88be-55f65a6a2529] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:29:23.354998 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-d63f4b7d-4c34-4181-8479-5ba9bcc90efa tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:23.355589 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-d63f4b7d-4c34-4181-8479-5ba9bcc90efa tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:23.356434 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-d63f4b7d-4c34-4181-8479-5ba9bcc90efa tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:23.356925 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-d63f4b7d-4c34-4181-8479-5ba9bcc90efa tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:23.452787 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-7d0adfa0-9593-4842-b2eb-b7073fbb4293 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d68d4a6c12e4331b8df8191cdd7a669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2a1ca6347d4278899a1cc009d87d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:29:23.462025 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-7d0adfa0-9593-4842-b2eb-b7073fbb4293 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] 10.222.0.78 "GET /compute/v2.1/servers/21edfff0-5c5c-43a5-a4e5-22ddd5f452eb" status: 200 len: 1318 microversion: 2.1 time: 0.244884 Feb 17 04:29:23.462606 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 97/164] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:29:23 2021] GET /compute/v2.1/servers/21edfff0-5c5c-43a5-a4e5-22ddd5f452eb => generated 1318 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:29:23.578499 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-d63f4b7d-4c34-4181-8479-5ba9bcc90efa tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2deb449189ba427a9b8fcb0e21f22566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2c8716a46f54187902492f8ce162f58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:29:23.588200 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-d63f4b7d-4c34-4181-8479-5ba9bcc90efa tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "GET /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529" status: 200 len: 1363 microversion: 2.1 time: 0.246464 Feb 17 04:29:23.589012 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 68/165] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:29:23 2021] GET /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529 => generated 1363 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:29:23.598645 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-d7d2304e-c2e9-4460-a8dc-26243fc70cee tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:29:23.598645 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-d7d2304e-c2e9-4460-a8dc-26243fc70cee tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] [instance: 2fe5b190-5679-4b9d-8d5f-fac1a1c407d9] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:29:23.606792 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-d7d2304e-c2e9-4460-a8dc-26243fc70cee tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:23.607511 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-d7d2304e-c2e9-4460-a8dc-26243fc70cee tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:23.608735 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-d7d2304e-c2e9-4460-a8dc-26243fc70cee tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:23.609690 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-d7d2304e-c2e9-4460-a8dc-26243fc70cee tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:23.826772 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-d7d2304e-c2e9-4460-a8dc-26243fc70cee tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1daf9a83b1d24033a3d4c0f531a4eb2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5336afdcf4aa4b46b0655432b7a1323c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:29:23.835640 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-d7d2304e-c2e9-4460-a8dc-26243fc70cee tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] 10.222.0.78 "GET /compute/v2.1/servers/2fe5b190-5679-4b9d-8d5f-fac1a1c407d9" status: 200 len: 1321 microversion: 2.1 time: 0.242024 Feb 17 04:29:23.836235 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 98/166] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:29:23 2021] GET /compute/v2.1/servers/2fe5b190-5679-4b9d-8d5f-fac1a1c407d9 => generated 1321 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:29:24.480838 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-7b790830-c650-4461-b314-e045b076bb8f tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:29:24.481504 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-7b790830-c650-4461-b314-e045b076bb8f tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] [instance: 21edfff0-5c5c-43a5-a4e5-22ddd5f452eb] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:29:24.489554 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-7b790830-c650-4461-b314-e045b076bb8f tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:24.490048 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-7b790830-c650-4461-b314-e045b076bb8f tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:24.490869 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-7b790830-c650-4461-b314-e045b076bb8f tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:24.491378 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-7b790830-c650-4461-b314-e045b076bb8f tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:24.606209 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-44402507-61d9-4da4-8c9a-67f9b1337d31 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:29:24.606797 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-44402507-61d9-4da4-8c9a-67f9b1337d31 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: 29d1ce27-f63b-4523-88be-55f65a6a2529] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:29:24.614839 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-44402507-61d9-4da4-8c9a-67f9b1337d31 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:24.615400 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-44402507-61d9-4da4-8c9a-67f9b1337d31 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:24.616241 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-44402507-61d9-4da4-8c9a-67f9b1337d31 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:24.616732 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-44402507-61d9-4da4-8c9a-67f9b1337d31 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:24.710609 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-7b790830-c650-4461-b314-e045b076bb8f tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d68d4a6c12e4331b8df8191cdd7a669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2a1ca6347d4278899a1cc009d87d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:29:24.720866 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-7b790830-c650-4461-b314-e045b076bb8f tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] 10.222.0.78 "GET /compute/v2.1/servers/21edfff0-5c5c-43a5-a4e5-22ddd5f452eb" status: 200 len: 1318 microversion: 2.1 time: 0.244102 Feb 17 04:29:24.722917 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 69/167] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:29:24 2021] GET /compute/v2.1/servers/21edfff0-5c5c-43a5-a4e5-22ddd5f452eb => generated 1318 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:29:24.848730 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-44402507-61d9-4da4-8c9a-67f9b1337d31 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2deb449189ba427a9b8fcb0e21f22566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2c8716a46f54187902492f8ce162f58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:29:24.854384 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-2564a201-e9a5-4e8d-87da-1f68130a25d3 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:29:24.855084 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-2564a201-e9a5-4e8d-87da-1f68130a25d3 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] [instance: 2fe5b190-5679-4b9d-8d5f-fac1a1c407d9] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:29:24.860325 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-44402507-61d9-4da4-8c9a-67f9b1337d31 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "GET /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529" status: 200 len: 1363 microversion: 2.1 time: 0.258156 Feb 17 04:29:24.860858 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 99/168] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:29:24 2021] GET /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529 => generated 1363 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:29:24.863323 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-2564a201-e9a5-4e8d-87da-1f68130a25d3 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:24.863845 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-2564a201-e9a5-4e8d-87da-1f68130a25d3 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:24.864692 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-2564a201-e9a5-4e8d-87da-1f68130a25d3 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:24.865187 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-2564a201-e9a5-4e8d-87da-1f68130a25d3 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:25.082592 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-2564a201-e9a5-4e8d-87da-1f68130a25d3 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1daf9a83b1d24033a3d4c0f531a4eb2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5336afdcf4aa4b46b0655432b7a1323c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:29:25.091847 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-2564a201-e9a5-4e8d-87da-1f68130a25d3 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] 10.222.0.78 "GET /compute/v2.1/servers/2fe5b190-5679-4b9d-8d5f-fac1a1c407d9" status: 200 len: 1321 microversion: 2.1 time: 0.241833 Feb 17 04:29:25.092450 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 70/169] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:29:24 2021] GET /compute/v2.1/servers/2fe5b190-5679-4b9d-8d5f-fac1a1c407d9 => generated 1321 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:29:25.740879 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-8df99b4c-bda5-4c8a-b697-2d2f7eddfed9 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:29:25.741564 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-8df99b4c-bda5-4c8a-b697-2d2f7eddfed9 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] [instance: 21edfff0-5c5c-43a5-a4e5-22ddd5f452eb] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:29:25.749455 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-8df99b4c-bda5-4c8a-b697-2d2f7eddfed9 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:25.749965 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-8df99b4c-bda5-4c8a-b697-2d2f7eddfed9 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:25.750796 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-8df99b4c-bda5-4c8a-b697-2d2f7eddfed9 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:25.751321 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-8df99b4c-bda5-4c8a-b697-2d2f7eddfed9 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:25.884042 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-8231ada3-2466-4a22-87ec-5ad5b2326645 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:29:25.884913 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-8231ada3-2466-4a22-87ec-5ad5b2326645 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: 29d1ce27-f63b-4523-88be-55f65a6a2529] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:29:25.893629 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-8231ada3-2466-4a22-87ec-5ad5b2326645 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:25.894342 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-8231ada3-2466-4a22-87ec-5ad5b2326645 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:25.895351 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-8231ada3-2466-4a22-87ec-5ad5b2326645 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:25.895978 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-8231ada3-2466-4a22-87ec-5ad5b2326645 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:25.970088 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-8df99b4c-bda5-4c8a-b697-2d2f7eddfed9 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d68d4a6c12e4331b8df8191cdd7a669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2a1ca6347d4278899a1cc009d87d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:29:25.979905 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-8df99b4c-bda5-4c8a-b697-2d2f7eddfed9 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] 10.222.0.78 "GET /compute/v2.1/servers/21edfff0-5c5c-43a5-a4e5-22ddd5f452eb" status: 200 len: 1318 microversion: 2.1 time: 0.243337 Feb 17 04:29:25.980500 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 100/170] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:29:25 2021] GET /compute/v2.1/servers/21edfff0-5c5c-43a5-a4e5-22ddd5f452eb => generated 1318 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:29:26.109460 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-8231ada3-2466-4a22-87ec-5ad5b2326645 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2deb449189ba427a9b8fcb0e21f22566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2c8716a46f54187902492f8ce162f58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:29:26.109912 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-35c444de-eaf5-465d-9191-b8d3553bb17e tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:29:26.110583 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-35c444de-eaf5-465d-9191-b8d3553bb17e tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] [instance: 2fe5b190-5679-4b9d-8d5f-fac1a1c407d9] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:29:26.119250 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-8231ada3-2466-4a22-87ec-5ad5b2326645 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "GET /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529" status: 200 len: 1363 microversion: 2.1 time: 0.239395 Feb 17 04:29:26.119571 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-35c444de-eaf5-465d-9191-b8d3553bb17e tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:26.119848 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 71/171] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:29:25 2021] GET /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529 => generated 1363 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:29:26.120163 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-35c444de-eaf5-465d-9191-b8d3553bb17e tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:26.121007 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-35c444de-eaf5-465d-9191-b8d3553bb17e tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:26.121497 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-35c444de-eaf5-465d-9191-b8d3553bb17e tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:26.341033 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-35c444de-eaf5-465d-9191-b8d3553bb17e tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1daf9a83b1d24033a3d4c0f531a4eb2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5336afdcf4aa4b46b0655432b7a1323c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:29:26.350428 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-35c444de-eaf5-465d-9191-b8d3553bb17e tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] 10.222.0.78 "GET /compute/v2.1/servers/2fe5b190-5679-4b9d-8d5f-fac1a1c407d9" status: 200 len: 1321 microversion: 2.1 time: 0.244655 Feb 17 04:29:26.351064 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 101/172] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:29:26 2021] GET /compute/v2.1/servers/2fe5b190-5679-4b9d-8d5f-fac1a1c407d9 => generated 1321 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:29:26.998668 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-5e4dd185-1dbd-40a3-9ac2-72a822203927 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:29:26.999523 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-5e4dd185-1dbd-40a3-9ac2-72a822203927 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] [instance: 21edfff0-5c5c-43a5-a4e5-22ddd5f452eb] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:29:27.009447 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-5e4dd185-1dbd-40a3-9ac2-72a822203927 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:27.010085 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-5e4dd185-1dbd-40a3-9ac2-72a822203927 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:27.011068 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-5e4dd185-1dbd-40a3-9ac2-72a822203927 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:27.011677 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-5e4dd185-1dbd-40a3-9ac2-72a822203927 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:27.139421 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-ab224f36-bd81-4e51-a22b-1a7f42b7644c tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:29:27.141661 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-ab224f36-bd81-4e51-a22b-1a7f42b7644c tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: 29d1ce27-f63b-4523-88be-55f65a6a2529] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:29:27.150539 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-ab224f36-bd81-4e51-a22b-1a7f42b7644c tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:27.151461 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-ab224f36-bd81-4e51-a22b-1a7f42b7644c tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:27.152462 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-ab224f36-bd81-4e51-a22b-1a7f42b7644c tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:27.153266 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-ab224f36-bd81-4e51-a22b-1a7f42b7644c tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:27.383660 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-ab224f36-bd81-4e51-a22b-1a7f42b7644c tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2deb449189ba427a9b8fcb0e21f22566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2c8716a46f54187902492f8ce162f58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:29:27.396215 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-ab224f36-bd81-4e51-a22b-1a7f42b7644c tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "GET /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529" status: 200 len: 1363 microversion: 2.1 time: 0.261189 Feb 17 04:29:27.407317 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 102/173] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:29:27 2021] GET /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529 => generated 1363 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:29:27.412728 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-ca624065-d2ba-4aae-8d3a-e2d9719177ea tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:29:27.413309 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-ca624065-d2ba-4aae-8d3a-e2d9719177ea tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] [instance: 2fe5b190-5679-4b9d-8d5f-fac1a1c407d9] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:29:27.422415 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-ca624065-d2ba-4aae-8d3a-e2d9719177ea tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:27.422929 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-ca624065-d2ba-4aae-8d3a-e2d9719177ea tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:27.423820 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-ca624065-d2ba-4aae-8d3a-e2d9719177ea tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:27.424350 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-ca624065-d2ba-4aae-8d3a-e2d9719177ea tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:27.434364 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-5e4dd185-1dbd-40a3-9ac2-72a822203927 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d68d4a6c12e4331b8df8191cdd7a669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2a1ca6347d4278899a1cc009d87d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:29:27.444188 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-5e4dd185-1dbd-40a3-9ac2-72a822203927 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] 10.222.0.78 "GET /compute/v2.1/servers/21edfff0-5c5c-43a5-a4e5-22ddd5f452eb" status: 200 len: 1318 microversion: 2.1 time: 0.449614 Feb 17 04:29:27.445042 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 72/174] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:29:26 2021] GET /compute/v2.1/servers/21edfff0-5c5c-43a5-a4e5-22ddd5f452eb => generated 1318 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:29:27.641836 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-ca624065-d2ba-4aae-8d3a-e2d9719177ea tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1daf9a83b1d24033a3d4c0f531a4eb2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5336afdcf4aa4b46b0655432b7a1323c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:29:27.651197 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-ca624065-d2ba-4aae-8d3a-e2d9719177ea tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] 10.222.0.78 "GET /compute/v2.1/servers/2fe5b190-5679-4b9d-8d5f-fac1a1c407d9" status: 200 len: 1321 microversion: 2.1 time: 0.253309 Feb 17 04:29:27.651799 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 103/175] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:29:27 2021] GET /compute/v2.1/servers/2fe5b190-5679-4b9d-8d5f-fac1a1c407d9 => generated 1321 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:29:28.417102 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-d3a6ccbe-5619-4466-8fde-74e39ddbdbde tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:29:28.417740 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-d3a6ccbe-5619-4466-8fde-74e39ddbdbde tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: 29d1ce27-f63b-4523-88be-55f65a6a2529] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:29:28.425996 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-d3a6ccbe-5619-4466-8fde-74e39ddbdbde tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:28.426387 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-d3a6ccbe-5619-4466-8fde-74e39ddbdbde tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:28.427115 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-d3a6ccbe-5619-4466-8fde-74e39ddbdbde tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:28.427618 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-d3a6ccbe-5619-4466-8fde-74e39ddbdbde tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:28.462481 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-a5dc4533-8d95-4ea8-a499-c1dc316a2220 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:29:28.463378 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-a5dc4533-8d95-4ea8-a499-c1dc316a2220 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] [instance: 21edfff0-5c5c-43a5-a4e5-22ddd5f452eb] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:29:28.471255 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-a5dc4533-8d95-4ea8-a499-c1dc316a2220 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:28.471706 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-a5dc4533-8d95-4ea8-a499-c1dc316a2220 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:28.472549 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-a5dc4533-8d95-4ea8-a499-c1dc316a2220 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:28.473046 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-a5dc4533-8d95-4ea8-a499-c1dc316a2220 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:28.645182 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-d3a6ccbe-5619-4466-8fde-74e39ddbdbde tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2deb449189ba427a9b8fcb0e21f22566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2c8716a46f54187902492f8ce162f58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:29:28.654951 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-d3a6ccbe-5619-4466-8fde-74e39ddbdbde tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "GET /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529" status: 200 len: 1363 microversion: 2.1 time: 0.242100 Feb 17 04:29:28.655593 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 73/176] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:29:28 2021] GET /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529 => generated 1363 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:29:28.670534 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-4533d89b-7e13-4e74-9ee4-f4f623dca4c4 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:29:28.671200 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-4533d89b-7e13-4e74-9ee4-f4f623dca4c4 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] [instance: 2fe5b190-5679-4b9d-8d5f-fac1a1c407d9] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:29:28.678914 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-4533d89b-7e13-4e74-9ee4-f4f623dca4c4 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:28.679455 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-4533d89b-7e13-4e74-9ee4-f4f623dca4c4 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:28.680872 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-4533d89b-7e13-4e74-9ee4-f4f623dca4c4 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:28.681391 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-4533d89b-7e13-4e74-9ee4-f4f623dca4c4 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:28.697511 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-a5dc4533-8d95-4ea8-a499-c1dc316a2220 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d68d4a6c12e4331b8df8191cdd7a669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2a1ca6347d4278899a1cc009d87d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:29:28.706211 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-a5dc4533-8d95-4ea8-a499-c1dc316a2220 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] 10.222.0.78 "GET /compute/v2.1/servers/21edfff0-5c5c-43a5-a4e5-22ddd5f452eb" status: 200 len: 1318 microversion: 2.1 time: 0.248133 Feb 17 04:29:28.706820 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 104/177] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:29:28 2021] GET /compute/v2.1/servers/21edfff0-5c5c-43a5-a4e5-22ddd5f452eb => generated 1318 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:29:28.946446 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-4533d89b-7e13-4e74-9ee4-f4f623dca4c4 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1daf9a83b1d24033a3d4c0f531a4eb2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5336afdcf4aa4b46b0655432b7a1323c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:29:28.955248 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-4533d89b-7e13-4e74-9ee4-f4f623dca4c4 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] 10.222.0.78 "GET /compute/v2.1/servers/2fe5b190-5679-4b9d-8d5f-fac1a1c407d9" status: 200 len: 1321 microversion: 2.1 time: 0.290130 Feb 17 04:29:28.955857 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 74/178] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:29:28 2021] GET /compute/v2.1/servers/2fe5b190-5679-4b9d-8d5f-fac1a1c407d9 => generated 1321 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:29:29.675600 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-9ff6318b-f318-464d-b5c0-25fcc085c3f5 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:29:29.677310 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-9ff6318b-f318-464d-b5c0-25fcc085c3f5 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: 29d1ce27-f63b-4523-88be-55f65a6a2529] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:29:29.686453 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-9ff6318b-f318-464d-b5c0-25fcc085c3f5 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:29.687194 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-9ff6318b-f318-464d-b5c0-25fcc085c3f5 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:29.688196 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-9ff6318b-f318-464d-b5c0-25fcc085c3f5 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:29.688863 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-9ff6318b-f318-464d-b5c0-25fcc085c3f5 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:29.728360 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-f0fde1a3-f60a-4924-9b1b-d3dd3d2ea4fe tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:29:29.728688 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-f0fde1a3-f60a-4924-9b1b-d3dd3d2ea4fe tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] [instance: 21edfff0-5c5c-43a5-a4e5-22ddd5f452eb] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:29:29.739018 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-f0fde1a3-f60a-4924-9b1b-d3dd3d2ea4fe tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:29.740003 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-f0fde1a3-f60a-4924-9b1b-d3dd3d2ea4fe tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:29.741298 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-f0fde1a3-f60a-4924-9b1b-d3dd3d2ea4fe tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:29.742089 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-f0fde1a3-f60a-4924-9b1b-d3dd3d2ea4fe tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:29.976801 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-9ff6318b-f318-464d-b5c0-25fcc085c3f5 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2deb449189ba427a9b8fcb0e21f22566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2c8716a46f54187902492f8ce162f58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:29:29.986316 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-9ff6318b-f318-464d-b5c0-25fcc085c3f5 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "GET /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529" status: 200 len: 1363 microversion: 2.1 time: 0.315624 Feb 17 04:29:29.986859 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 105/179] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:29:29 2021] GET /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529 => generated 1363 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:29:30.002083 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-dc7aee59-63ca-41d8-8a62-8f1d76d8f9e1 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:29:30.002751 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-dc7aee59-63ca-41d8-8a62-8f1d76d8f9e1 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] [instance: 2fe5b190-5679-4b9d-8d5f-fac1a1c407d9] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:29:30.011210 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-dc7aee59-63ca-41d8-8a62-8f1d76d8f9e1 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:30.011724 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-dc7aee59-63ca-41d8-8a62-8f1d76d8f9e1 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:30.012579 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-dc7aee59-63ca-41d8-8a62-8f1d76d8f9e1 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:30.013066 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-dc7aee59-63ca-41d8-8a62-8f1d76d8f9e1 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:30.103692 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-f0fde1a3-f60a-4924-9b1b-d3dd3d2ea4fe tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d68d4a6c12e4331b8df8191cdd7a669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2a1ca6347d4278899a1cc009d87d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:29:30.112677 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-f0fde1a3-f60a-4924-9b1b-d3dd3d2ea4fe tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] 10.222.0.78 "GET /compute/v2.1/servers/21edfff0-5c5c-43a5-a4e5-22ddd5f452eb" status: 200 len: 1508 microversion: 2.1 time: 0.390714 Feb 17 04:29:30.113555 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 75/180] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:29:29 2021] GET /compute/v2.1/servers/21edfff0-5c5c-43a5-a4e5-22ddd5f452eb => generated 1508 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:29:30.237872 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-dc7aee59-63ca-41d8-8a62-8f1d76d8f9e1 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1daf9a83b1d24033a3d4c0f531a4eb2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5336afdcf4aa4b46b0655432b7a1323c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:29:30.247912 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-dc7aee59-63ca-41d8-8a62-8f1d76d8f9e1 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] 10.222.0.78 "GET /compute/v2.1/servers/2fe5b190-5679-4b9d-8d5f-fac1a1c407d9" status: 200 len: 1321 microversion: 2.1 time: 0.249530 Feb 17 04:29:30.251076 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 106/181] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:29:29 2021] GET /compute/v2.1/servers/2fe5b190-5679-4b9d-8d5f-fac1a1c407d9 => generated 1321 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:29:30.330584 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-5e017a27-542d-47ee-a958-b76d4e3c2d9b tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e58ddcfa-a395-49b5-9c7e-f125e77491ed"}} {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:29:30.332120 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-5e017a27-542d-47ee-a958-b76d4e3c2d9b tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] [instance: fc3441c6-9dd2-4b3e-8aea-c1ea786a445e] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:29:30.340209 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-5e017a27-542d-47ee-a958-b76d4e3c2d9b tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:30.340726 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-5e017a27-542d-47ee-a958-b76d4e3c2d9b tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:30.341574 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-5e017a27-542d-47ee-a958-b76d4e3c2d9b tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:30.342074 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-5e017a27-542d-47ee-a958-b76d4e3c2d9b tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:30.572255 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-5e017a27-542d-47ee-a958-b76d4e3c2d9b tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] Acquired lock "compute-rpcapi-router" {{(pid=98178) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:266}} Feb 17 04:29:30.575225 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-e4e14f63-6c39-49be-9a6d-360afb0583da None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:30.575225 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-e4e14f63-6c39-49be-9a6d-360afb0583da None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:30.575225 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-e4e14f63-6c39-49be-9a6d-360afb0583da None None] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:30.575599 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-e4e14f63-6c39-49be-9a6d-360afb0583da None None] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:30.585498 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.compute.rpcapi [None req-e4e14f63-6c39-49be-9a6d-360afb0583da None None] Automatically selected compute RPC version 5.13 from minimum service version 54 Feb 17 04:29:30.587519 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-e4e14f63-6c39-49be-9a6d-360afb0583da None None] Releasing lock "compute-rpcapi-router" {{(pid=98178) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:282}} Feb 17 04:29:30.957274 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-e4e14f63-6c39-49be-9a6d-360afb0583da None None] 10.222.0.78 "POST /compute/v2.1/servers/fc3441c6-9dd2-4b3e-8aea-c1ea786a445e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.630578 Feb 17 04:29:30.958135 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 76/182] 10.222.0.78 () {60 vars in 1313 bytes} [Wed Feb 17 04:29:30 2021] POST /compute/v2.1/servers/fc3441c6-9dd2-4b3e-8aea-c1ea786a445e/os-volume_attachments => generated 194 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:29:31.006377 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-d075e2ae-f65b-4d63-9a98-cdc4f77a76b2 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:29:31.007132 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-d075e2ae-f65b-4d63-9a98-cdc4f77a76b2 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: 29d1ce27-f63b-4523-88be-55f65a6a2529] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:29:31.015810 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-d075e2ae-f65b-4d63-9a98-cdc4f77a76b2 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:31.016369 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-d075e2ae-f65b-4d63-9a98-cdc4f77a76b2 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:31.017426 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-d075e2ae-f65b-4d63-9a98-cdc4f77a76b2 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:31.017924 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-d075e2ae-f65b-4d63-9a98-cdc4f77a76b2 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:31.253378 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-d075e2ae-f65b-4d63-9a98-cdc4f77a76b2 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2deb449189ba427a9b8fcb0e21f22566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2c8716a46f54187902492f8ce162f58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:29:31.263185 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-d075e2ae-f65b-4d63-9a98-cdc4f77a76b2 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "GET /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529" status: 200 len: 1363 microversion: 2.1 time: 0.261903 Feb 17 04:29:31.263788 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 107/183] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:29:31 2021] GET /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529 => generated 1363 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:29:31.266832 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-bef534c8-015e-46e1-80e5-ef4713ba6e48 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:29:31.267593 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-bef534c8-015e-46e1-80e5-ef4713ba6e48 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] [instance: 2fe5b190-5679-4b9d-8d5f-fac1a1c407d9] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:29:31.276672 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-bef534c8-015e-46e1-80e5-ef4713ba6e48 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:31.277266 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-bef534c8-015e-46e1-80e5-ef4713ba6e48 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:31.278150 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-bef534c8-015e-46e1-80e5-ef4713ba6e48 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:31.278650 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-bef534c8-015e-46e1-80e5-ef4713ba6e48 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:31.502002 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-bef534c8-015e-46e1-80e5-ef4713ba6e48 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1daf9a83b1d24033a3d4c0f531a4eb2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5336afdcf4aa4b46b0655432b7a1323c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:29:31.510794 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-bef534c8-015e-46e1-80e5-ef4713ba6e48 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] 10.222.0.78 "GET /compute/v2.1/servers/2fe5b190-5679-4b9d-8d5f-fac1a1c407d9" status: 200 len: 1321 microversion: 2.1 time: 0.248491 Feb 17 04:29:31.511426 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 77/184] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:29:31 2021] GET /compute/v2.1/servers/2fe5b190-5679-4b9d-8d5f-fac1a1c407d9 => generated 1321 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:29:32.072244 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [req-8b365e17-de25-42d4-b78d-275b9bed9f43 req-32821bc3-5144-4753-9ae7-c121b7e5c7e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20760e77-fe67-4ebe-87f1-34d840495341", "name": "network-vif-plugged", "status": "completed", "tag": "8f824d75-b2bf-47d0-90e8-3ba823dae40e"}]} {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:29:32.075810 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:29:32.075810 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: warnings.warn(msg) Feb 17 04:29:32.096494 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [req-8b365e17-de25-42d4-b78d-275b9bed9f43 req-32821bc3-5144-4753-9ae7-c121b7e5c7e7 service nova] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:32.097358 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [req-8b365e17-de25-42d4-b78d-275b9bed9f43 req-32821bc3-5144-4753-9ae7-c121b7e5c7e7 service nova] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:32.117911 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.compute.server_external_events [req-8b365e17-de25-42d4-b78d-275b9bed9f43 req-32821bc3-5144-4753-9ae7-c121b7e5c7e7 service nova] Creating event network-vif-plugged:8f824d75-b2bf-47d0-90e8-3ba823dae40e for instance 20760e77-fe67-4ebe-87f1-34d840495341 on hv-cinder-75998 Feb 17 04:29:32.124468 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [req-8b365e17-de25-42d4-b78d-275b9bed9f43 req-32821bc3-5144-4753-9ae7-c121b7e5c7e7 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059838 Feb 17 04:29:32.125494 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 108/185] 10.222.0.78 () {64 vars in 1308 bytes} [Wed Feb 17 04:29:32 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:29:32.282059 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-4e23d1e1-2a17-453b-a2e8-5eee93115067 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:29:32.282851 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-4e23d1e1-2a17-453b-a2e8-5eee93115067 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: 29d1ce27-f63b-4523-88be-55f65a6a2529] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:29:32.299255 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-4e23d1e1-2a17-453b-a2e8-5eee93115067 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:32.300121 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-4e23d1e1-2a17-453b-a2e8-5eee93115067 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:32.301065 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-4e23d1e1-2a17-453b-a2e8-5eee93115067 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:32.303264 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-4e23d1e1-2a17-453b-a2e8-5eee93115067 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:32.530670 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-e67306f4-f529-4c61-9fa9-4b7e246842fa tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:29:32.532989 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-e67306f4-f529-4c61-9fa9-4b7e246842fa tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] [instance: 2fe5b190-5679-4b9d-8d5f-fac1a1c407d9] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:29:32.569327 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-e67306f4-f529-4c61-9fa9-4b7e246842fa tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:32.569900 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-e67306f4-f529-4c61-9fa9-4b7e246842fa tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:32.571390 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-e67306f4-f529-4c61-9fa9-4b7e246842fa tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:32.571892 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-e67306f4-f529-4c61-9fa9-4b7e246842fa tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:32.875117 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-4e23d1e1-2a17-453b-a2e8-5eee93115067 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2deb449189ba427a9b8fcb0e21f22566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2c8716a46f54187902492f8ce162f58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:29:32.893801 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-4e23d1e1-2a17-453b-a2e8-5eee93115067 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "GET /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529" status: 200 len: 1363 microversion: 2.1 time: 0.616344 Feb 17 04:29:32.894603 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 78/186] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:29:32 2021] GET /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529 => generated 1363 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:29:32.901087 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-139ee1db-2300-4464-86ae-e3f0688fe2c8 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fe9f2c16-089f-43a9-8385-1a4882c7700f"}} {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:29:32.902854 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-139ee1db-2300-4464-86ae-e3f0688fe2c8 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] [instance: 21edfff0-5c5c-43a5-a4e5-22ddd5f452eb] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:29:32.911054 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-139ee1db-2300-4464-86ae-e3f0688fe2c8 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:32.912124 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-139ee1db-2300-4464-86ae-e3f0688fe2c8 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:32.912993 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-139ee1db-2300-4464-86ae-e3f0688fe2c8 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:32.913482 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-139ee1db-2300-4464-86ae-e3f0688fe2c8 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:32.937896 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-e67306f4-f529-4c61-9fa9-4b7e246842fa tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1daf9a83b1d24033a3d4c0f531a4eb2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5336afdcf4aa4b46b0655432b7a1323c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:29:32.947610 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-e67306f4-f529-4c61-9fa9-4b7e246842fa tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] 10.222.0.78 "GET /compute/v2.1/servers/2fe5b190-5679-4b9d-8d5f-fac1a1c407d9" status: 200 len: 1321 microversion: 2.1 time: 0.422065 Feb 17 04:29:32.948514 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 109/187] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:29:32 2021] GET /compute/v2.1/servers/2fe5b190-5679-4b9d-8d5f-fac1a1c407d9 => generated 1321 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:29:33.564382 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-139ee1db-2300-4464-86ae-e3f0688fe2c8 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] 10.222.0.78 "POST /compute/v2.1/servers/21edfff0-5c5c-43a5-a4e5-22ddd5f452eb/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.667646 Feb 17 04:29:33.565044 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 79/188] 10.222.0.78 () {60 vars in 1313 bytes} [Wed Feb 17 04:29:32 2021] POST /compute/v2.1/servers/21edfff0-5c5c-43a5-a4e5-22ddd5f452eb/os-volume_attachments => generated 194 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 17 04:29:33.913398 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-a864c91d-45a4-4a7e-87be-d4310414f76f tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:29:33.914120 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-a864c91d-45a4-4a7e-87be-d4310414f76f tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: 29d1ce27-f63b-4523-88be-55f65a6a2529] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:29:33.924189 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-a864c91d-45a4-4a7e-87be-d4310414f76f tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:33.925600 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-a864c91d-45a4-4a7e-87be-d4310414f76f tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:33.926819 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-a864c91d-45a4-4a7e-87be-d4310414f76f tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:33.927689 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-a864c91d-45a4-4a7e-87be-d4310414f76f tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:33.969867 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-16ee5b44-4ad7-4385-973d-59dc8948f900 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:29:33.970649 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-16ee5b44-4ad7-4385-973d-59dc8948f900 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] [instance: 2fe5b190-5679-4b9d-8d5f-fac1a1c407d9] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:29:33.983696 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-16ee5b44-4ad7-4385-973d-59dc8948f900 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:33.984023 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-16ee5b44-4ad7-4385-973d-59dc8948f900 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:33.985460 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-16ee5b44-4ad7-4385-973d-59dc8948f900 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:33.986530 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-16ee5b44-4ad7-4385-973d-59dc8948f900 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:34.252767 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-a864c91d-45a4-4a7e-87be-d4310414f76f tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2deb449189ba427a9b8fcb0e21f22566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2c8716a46f54187902492f8ce162f58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:29:34.265745 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-a864c91d-45a4-4a7e-87be-d4310414f76f tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "GET /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529" status: 200 len: 1363 microversion: 2.1 time: 0.356496 Feb 17 04:29:34.266343 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 110/189] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:29:33 2021] GET /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529 => generated 1363 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:29:34.315537 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-16ee5b44-4ad7-4385-973d-59dc8948f900 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1daf9a83b1d24033a3d4c0f531a4eb2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5336afdcf4aa4b46b0655432b7a1323c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:29:34.324596 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-16ee5b44-4ad7-4385-973d-59dc8948f900 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] 10.222.0.78 "GET /compute/v2.1/servers/2fe5b190-5679-4b9d-8d5f-fac1a1c407d9" status: 200 len: 1321 microversion: 2.1 time: 0.359550 Feb 17 04:29:34.325196 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 80/190] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:29:33 2021] GET /compute/v2.1/servers/2fe5b190-5679-4b9d-8d5f-fac1a1c407d9 => generated 1321 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:29:35.284385 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-320a038d-1058-49be-9fc8-a878b20e786c tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:29:35.285281 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-320a038d-1058-49be-9fc8-a878b20e786c tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: 29d1ce27-f63b-4523-88be-55f65a6a2529] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:29:35.293471 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-320a038d-1058-49be-9fc8-a878b20e786c tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:35.293985 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-320a038d-1058-49be-9fc8-a878b20e786c tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:35.294867 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-320a038d-1058-49be-9fc8-a878b20e786c tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:35.295389 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-320a038d-1058-49be-9fc8-a878b20e786c tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:35.342552 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-b060a085-9a7a-4317-b8b7-3c04f37ddef0 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:29:35.343500 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-b060a085-9a7a-4317-b8b7-3c04f37ddef0 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] [instance: 2fe5b190-5679-4b9d-8d5f-fac1a1c407d9] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:29:35.352562 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-b060a085-9a7a-4317-b8b7-3c04f37ddef0 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:35.353218 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-b060a085-9a7a-4317-b8b7-3c04f37ddef0 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:35.354183 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-b060a085-9a7a-4317-b8b7-3c04f37ddef0 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:35.354794 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-b060a085-9a7a-4317-b8b7-3c04f37ddef0 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:35.573869 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-b060a085-9a7a-4317-b8b7-3c04f37ddef0 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1daf9a83b1d24033a3d4c0f531a4eb2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5336afdcf4aa4b46b0655432b7a1323c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:29:35.582782 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-b060a085-9a7a-4317-b8b7-3c04f37ddef0 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] 10.222.0.78 "GET /compute/v2.1/servers/2fe5b190-5679-4b9d-8d5f-fac1a1c407d9" status: 200 len: 1321 microversion: 2.1 time: 0.244345 Feb 17 04:29:35.583454 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 81/191] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:29:35 2021] GET /compute/v2.1/servers/2fe5b190-5679-4b9d-8d5f-fac1a1c407d9 => generated 1321 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:29:35.621976 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-320a038d-1058-49be-9fc8-a878b20e786c tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2deb449189ba427a9b8fcb0e21f22566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2c8716a46f54187902492f8ce162f58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:29:35.630780 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-320a038d-1058-49be-9fc8-a878b20e786c tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "GET /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529" status: 200 len: 1363 microversion: 2.1 time: 0.350475 Feb 17 04:29:35.631444 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 111/192] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:29:35 2021] GET /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529 => generated 1363 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:29:36.607866 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-85cb2393-ccd3-4771-bbb3-deb35d32bf1f tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:29:36.608488 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-85cb2393-ccd3-4771-bbb3-deb35d32bf1f tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] [instance: 2fe5b190-5679-4b9d-8d5f-fac1a1c407d9] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:29:36.622975 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-85cb2393-ccd3-4771-bbb3-deb35d32bf1f tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:36.623521 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-85cb2393-ccd3-4771-bbb3-deb35d32bf1f tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:36.624378 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-85cb2393-ccd3-4771-bbb3-deb35d32bf1f tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:36.624876 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-85cb2393-ccd3-4771-bbb3-deb35d32bf1f tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:36.649374 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-dd53f9c0-8bfa-4029-bd13-2d779b1321cb tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:29:36.650183 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-dd53f9c0-8bfa-4029-bd13-2d779b1321cb tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: 29d1ce27-f63b-4523-88be-55f65a6a2529] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:29:36.658189 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-dd53f9c0-8bfa-4029-bd13-2d779b1321cb tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:36.658867 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-dd53f9c0-8bfa-4029-bd13-2d779b1321cb tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:36.659922 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-dd53f9c0-8bfa-4029-bd13-2d779b1321cb tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:36.660416 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-dd53f9c0-8bfa-4029-bd13-2d779b1321cb tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:36.845138 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-85cb2393-ccd3-4771-bbb3-deb35d32bf1f tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1daf9a83b1d24033a3d4c0f531a4eb2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5336afdcf4aa4b46b0655432b7a1323c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:29:36.855820 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-85cb2393-ccd3-4771-bbb3-deb35d32bf1f tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] 10.222.0.78 "GET /compute/v2.1/servers/2fe5b190-5679-4b9d-8d5f-fac1a1c407d9" status: 200 len: 1321 microversion: 2.1 time: 0.259005 Feb 17 04:29:36.856629 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 82/193] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:29:36 2021] GET /compute/v2.1/servers/2fe5b190-5679-4b9d-8d5f-fac1a1c407d9 => generated 1321 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:29:36.901768 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-dd53f9c0-8bfa-4029-bd13-2d779b1321cb tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2deb449189ba427a9b8fcb0e21f22566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2c8716a46f54187902492f8ce162f58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:29:36.911126 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-dd53f9c0-8bfa-4029-bd13-2d779b1321cb tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "GET /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529" status: 200 len: 1363 microversion: 2.1 time: 0.266089 Feb 17 04:29:36.912285 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 112/194] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:29:36 2021] GET /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529 => generated 1363 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:29:37.874379 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-936a3731-9afe-49a1-b3fb-a222b0766205 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:29:37.875060 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-936a3731-9afe-49a1-b3fb-a222b0766205 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] [instance: 2fe5b190-5679-4b9d-8d5f-fac1a1c407d9] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:29:37.884185 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-936a3731-9afe-49a1-b3fb-a222b0766205 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:37.884680 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-936a3731-9afe-49a1-b3fb-a222b0766205 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:37.885600 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-936a3731-9afe-49a1-b3fb-a222b0766205 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:37.886091 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-936a3731-9afe-49a1-b3fb-a222b0766205 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:37.931174 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-a384ccc1-7a10-4ab5-bffa-9fc12675574b tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:29:37.932381 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-a384ccc1-7a10-4ab5-bffa-9fc12675574b tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: 29d1ce27-f63b-4523-88be-55f65a6a2529] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:29:37.940588 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-a384ccc1-7a10-4ab5-bffa-9fc12675574b tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:37.941172 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-a384ccc1-7a10-4ab5-bffa-9fc12675574b tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:37.942263 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-a384ccc1-7a10-4ab5-bffa-9fc12675574b tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:37.942839 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-a384ccc1-7a10-4ab5-bffa-9fc12675574b tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:38.108419 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-936a3731-9afe-49a1-b3fb-a222b0766205 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1daf9a83b1d24033a3d4c0f531a4eb2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5336afdcf4aa4b46b0655432b7a1323c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:29:38.120570 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-936a3731-9afe-49a1-b3fb-a222b0766205 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] 10.222.0.78 "GET /compute/v2.1/servers/2fe5b190-5679-4b9d-8d5f-fac1a1c407d9" status: 200 len: 1321 microversion: 2.1 time: 0.250086 Feb 17 04:29:38.121092 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 83/195] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:29:37 2021] GET /compute/v2.1/servers/2fe5b190-5679-4b9d-8d5f-fac1a1c407d9 => generated 1321 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:29:38.176854 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-a384ccc1-7a10-4ab5-bffa-9fc12675574b tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2deb449189ba427a9b8fcb0e21f22566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2c8716a46f54187902492f8ce162f58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:29:38.186102 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-a384ccc1-7a10-4ab5-bffa-9fc12675574b tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "GET /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529" status: 200 len: 1363 microversion: 2.1 time: 0.259133 Feb 17 04:29:38.186704 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 113/196] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:29:37 2021] GET /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529 => generated 1363 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:29:39.139143 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-a135df47-1f81-4e55-9c18-44c87918449d tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:29:39.140041 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-a135df47-1f81-4e55-9c18-44c87918449d tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] [instance: 2fe5b190-5679-4b9d-8d5f-fac1a1c407d9] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:29:39.148322 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-a135df47-1f81-4e55-9c18-44c87918449d tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:39.149406 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-a135df47-1f81-4e55-9c18-44c87918449d tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:39.150557 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-a135df47-1f81-4e55-9c18-44c87918449d tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:39.151054 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-a135df47-1f81-4e55-9c18-44c87918449d tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:39.204965 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-e83ecdac-3da6-40a6-bf8a-2da0ce94925c tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:29:39.206112 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-e83ecdac-3da6-40a6-bf8a-2da0ce94925c tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: 29d1ce27-f63b-4523-88be-55f65a6a2529] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:29:39.215684 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-e83ecdac-3da6-40a6-bf8a-2da0ce94925c tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:39.216292 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-e83ecdac-3da6-40a6-bf8a-2da0ce94925c tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:39.217257 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-e83ecdac-3da6-40a6-bf8a-2da0ce94925c tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:39.217988 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-e83ecdac-3da6-40a6-bf8a-2da0ce94925c tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:39.382153 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-a135df47-1f81-4e55-9c18-44c87918449d tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1daf9a83b1d24033a3d4c0f531a4eb2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5336afdcf4aa4b46b0655432b7a1323c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:29:39.391526 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-a135df47-1f81-4e55-9c18-44c87918449d tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] 10.222.0.78 "GET /compute/v2.1/servers/2fe5b190-5679-4b9d-8d5f-fac1a1c407d9" status: 200 len: 1321 microversion: 2.1 time: 0.256430 Feb 17 04:29:39.392132 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 84/197] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:29:39 2021] GET /compute/v2.1/servers/2fe5b190-5679-4b9d-8d5f-fac1a1c407d9 => generated 1321 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:29:39.436504 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-e83ecdac-3da6-40a6-bf8a-2da0ce94925c tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2deb449189ba427a9b8fcb0e21f22566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2c8716a46f54187902492f8ce162f58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:29:39.445375 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-e83ecdac-3da6-40a6-bf8a-2da0ce94925c tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "GET /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529" status: 200 len: 1363 microversion: 2.1 time: 0.244567 Feb 17 04:29:39.446360 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 114/198] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:29:39 2021] GET /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529 => generated 1363 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:29:40.409657 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-1741d8a3-354d-49ca-bb59-97ddddd2757d tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:29:40.410328 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-1741d8a3-354d-49ca-bb59-97ddddd2757d tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] [instance: 2fe5b190-5679-4b9d-8d5f-fac1a1c407d9] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:29:40.419664 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-1741d8a3-354d-49ca-bb59-97ddddd2757d tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:40.420398 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-1741d8a3-354d-49ca-bb59-97ddddd2757d tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:40.421393 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-1741d8a3-354d-49ca-bb59-97ddddd2757d tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:40.422049 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-1741d8a3-354d-49ca-bb59-97ddddd2757d tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:40.465146 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-2193272f-8e18-4ed6-9d5f-ed96d02e5b5d tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:29:40.465720 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-2193272f-8e18-4ed6-9d5f-ed96d02e5b5d tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: 29d1ce27-f63b-4523-88be-55f65a6a2529] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:29:40.474193 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-2193272f-8e18-4ed6-9d5f-ed96d02e5b5d tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:40.474704 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-2193272f-8e18-4ed6-9d5f-ed96d02e5b5d tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:40.475588 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-2193272f-8e18-4ed6-9d5f-ed96d02e5b5d tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:40.476104 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-2193272f-8e18-4ed6-9d5f-ed96d02e5b5d tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:40.666599 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-1741d8a3-354d-49ca-bb59-97ddddd2757d tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1daf9a83b1d24033a3d4c0f531a4eb2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5336afdcf4aa4b46b0655432b7a1323c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:29:40.676203 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-1741d8a3-354d-49ca-bb59-97ddddd2757d tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] 10.222.0.78 "GET /compute/v2.1/servers/2fe5b190-5679-4b9d-8d5f-fac1a1c407d9" status: 200 len: 1321 microversion: 2.1 time: 0.270528 Feb 17 04:29:40.677046 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 85/199] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:29:40 2021] GET /compute/v2.1/servers/2fe5b190-5679-4b9d-8d5f-fac1a1c407d9 => generated 1321 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:29:40.736220 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-2193272f-8e18-4ed6-9d5f-ed96d02e5b5d tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2deb449189ba427a9b8fcb0e21f22566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2c8716a46f54187902492f8ce162f58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:29:40.746196 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-2193272f-8e18-4ed6-9d5f-ed96d02e5b5d tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "GET /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529" status: 200 len: 1363 microversion: 2.1 time: 0.286208 Feb 17 04:29:40.746989 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 115/200] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:29:40 2021] GET /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529 => generated 1363 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:29:41.694218 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-cafcafe0-c5a9-4254-abf1-1ba4379a8098 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:29:41.695067 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-cafcafe0-c5a9-4254-abf1-1ba4379a8098 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] [instance: 2fe5b190-5679-4b9d-8d5f-fac1a1c407d9] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:29:41.703797 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-cafcafe0-c5a9-4254-abf1-1ba4379a8098 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:41.704313 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-cafcafe0-c5a9-4254-abf1-1ba4379a8098 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:41.710052 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-cafcafe0-c5a9-4254-abf1-1ba4379a8098 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:41.710052 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-cafcafe0-c5a9-4254-abf1-1ba4379a8098 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:41.765240 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-2220d20f-781b-4863-b8f2-f643391c4840 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:29:41.766118 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-2220d20f-781b-4863-b8f2-f643391c4840 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: 29d1ce27-f63b-4523-88be-55f65a6a2529] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:29:41.778240 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-2220d20f-781b-4863-b8f2-f643391c4840 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:41.779109 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-2220d20f-781b-4863-b8f2-f643391c4840 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:41.781929 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-2220d20f-781b-4863-b8f2-f643391c4840 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:41.782656 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-2220d20f-781b-4863-b8f2-f643391c4840 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:41.990157 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-cafcafe0-c5a9-4254-abf1-1ba4379a8098 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1daf9a83b1d24033a3d4c0f531a4eb2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5336afdcf4aa4b46b0655432b7a1323c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:29:42.002212 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-cafcafe0-c5a9-4254-abf1-1ba4379a8098 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] 10.222.0.78 "GET /compute/v2.1/servers/2fe5b190-5679-4b9d-8d5f-fac1a1c407d9" status: 200 len: 1321 microversion: 2.1 time: 0.312035 Feb 17 04:29:42.003286 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 86/201] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:29:41 2021] GET /compute/v2.1/servers/2fe5b190-5679-4b9d-8d5f-fac1a1c407d9 => generated 1321 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:29:42.046861 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-2220d20f-781b-4863-b8f2-f643391c4840 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2deb449189ba427a9b8fcb0e21f22566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2c8716a46f54187902492f8ce162f58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:29:42.061215 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-2220d20f-781b-4863-b8f2-f643391c4840 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "GET /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529" status: 200 len: 1363 microversion: 2.1 time: 0.299509 Feb 17 04:29:42.061850 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 116/202] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:29:41 2021] GET /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529 => generated 1363 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:29:42.313526 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [req-2ff6072f-0e0c-41e1-bca0-bc05c5c8fa86 req-5289a27e-1394-4636-8322-98616eb1f785 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2fe5b190-5679-4b9d-8d5f-fac1a1c407d9", "name": "network-vif-plugged", "status": "completed", "tag": "c06f3049-4f07-4c51-9968-0a06c58bb377"}]} {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:29:42.316007 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:29:42.316007 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: warnings.warn(msg) Feb 17 04:29:42.326667 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [req-2ff6072f-0e0c-41e1-bca0-bc05c5c8fa86 req-5289a27e-1394-4636-8322-98616eb1f785 service nova] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:42.327321 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [req-2ff6072f-0e0c-41e1-bca0-bc05c5c8fa86 req-5289a27e-1394-4636-8322-98616eb1f785 service nova] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:42.346307 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.compute.server_external_events [req-2ff6072f-0e0c-41e1-bca0-bc05c5c8fa86 req-5289a27e-1394-4636-8322-98616eb1f785 service nova] Creating event network-vif-plugged:c06f3049-4f07-4c51-9968-0a06c58bb377 for instance 2fe5b190-5679-4b9d-8d5f-fac1a1c407d9 on hv-cinder-75998 Feb 17 04:29:42.352213 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [req-2ff6072f-0e0c-41e1-bca0-bc05c5c8fa86 req-5289a27e-1394-4636-8322-98616eb1f785 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042713 Feb 17 04:29:42.352934 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 87/203] 10.222.0.78 () {64 vars in 1308 bytes} [Wed Feb 17 04:29:42 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:29:42.466294 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-29374e59-ce12-4d82-871f-3f5eee18c941 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1720226773", "imageRef": "b005ed36-a85a-4c46-ba22-9fa8c5ec62e5", "flavorRef": "452", "networks": [{"uuid": "b5f1ca89-bbfb-4608-86a7-7b5d61122317"}]}} {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:29:42.549231 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.network.neutron [None req-29374e59-ce12-4d82-871f-3f5eee18c941 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] validate_networks() for [('b5f1ca89-bbfb-4608-86a7-7b5d61122317', None, None, None)] {{(pid=98179) validate_networks /opt/stack/nova/nova/network/neutron.py:2345}} Feb 17 04:29:42.633616 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-406b6f16-0f9c-497c-b88c-bcb162e7e67f tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:29:42.634537 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-406b6f16-0f9c-497c-b88c-bcb162e7e67f tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] [instance: fc3441c6-9dd2-4b3e-8aea-c1ea786a445e] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:29:42.653916 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-406b6f16-0f9c-497c-b88c-bcb162e7e67f tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:42.654767 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-406b6f16-0f9c-497c-b88c-bcb162e7e67f tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:42.655843 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-406b6f16-0f9c-497c-b88c-bcb162e7e67f tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:42.656529 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-406b6f16-0f9c-497c-b88c-bcb162e7e67f tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:42.788505 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-406b6f16-0f9c-497c-b88c-bcb162e7e67f tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] [instance: fc3441c6-9dd2-4b3e-8aea-c1ea786a445e] Going to try to terminate instance {{(pid=98178) delete /opt/stack/nova/nova/compute/api.py:2540}} Feb 17 04:29:43.021729 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-406b6f16-0f9c-497c-b88c-bcb162e7e67f tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] 10.222.0.78 "DELETE /compute/v2.1/servers/fc3441c6-9dd2-4b3e-8aea-c1ea786a445e" status: 204 len: 0 microversion: 2.1 time: 0.391330 Feb 17 04:29:43.021729 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 88/204] 10.222.0.78 () {58 vars in 1229 bytes} [Wed Feb 17 04:29:42 2021] DELETE /compute/v2.1/servers/fc3441c6-9dd2-4b3e-8aea-c1ea786a445e => generated 0 bytes in 393 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 17 04:29:43.030794 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-98a0f038-f410-4047-9e7a-b053371e80db tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:29:43.031724 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-98a0f038-f410-4047-9e7a-b053371e80db tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] [instance: 2fe5b190-5679-4b9d-8d5f-fac1a1c407d9] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:29:43.041354 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-98a0f038-f410-4047-9e7a-b053371e80db tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:43.041953 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-98a0f038-f410-4047-9e7a-b053371e80db tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:43.043086 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-98a0f038-f410-4047-9e7a-b053371e80db tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:43.043694 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-98a0f038-f410-4047-9e7a-b053371e80db tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:43.283616 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.virt.hardware [None req-29374e59-ce12-4d82-871f-3f5eee18c941 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Flavor limits 0:0:0 {{(pid=98179) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 17 04:29:43.284774 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.virt.hardware [None req-29374e59-ce12-4d82-871f-3f5eee18c941 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Image limits 0:0:0 {{(pid=98179) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Feb 17 04:29:43.285625 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.virt.hardware [None req-29374e59-ce12-4d82-871f-3f5eee18c941 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Flavor pref 0:0:0 {{(pid=98179) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 17 04:29:43.286292 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.virt.hardware [None req-29374e59-ce12-4d82-871f-3f5eee18c941 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Image pref 0:0:0 {{(pid=98179) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Feb 17 04:29:43.286976 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.virt.hardware [None req-29374e59-ce12-4d82-871f-3f5eee18c941 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98179) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Feb 17 04:29:43.297696 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-29374e59-ce12-4d82-871f-3f5eee18c941 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:43.298484 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-29374e59-ce12-4d82-871f-3f5eee18c941 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:43.299581 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-29374e59-ce12-4d82-871f-3f5eee18c941 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:43.300314 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-29374e59-ce12-4d82-871f-3f5eee18c941 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:43.306794 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-98a0f038-f410-4047-9e7a-b053371e80db tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1daf9a83b1d24033a3d4c0f531a4eb2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5336afdcf4aa4b46b0655432b7a1323c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:29:43.316949 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-98a0f038-f410-4047-9e7a-b053371e80db tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] 10.222.0.78 "GET /compute/v2.1/servers/2fe5b190-5679-4b9d-8d5f-fac1a1c407d9" status: 200 len: 1321 microversion: 2.1 time: 0.293758 Feb 17 04:29:43.318058 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 89/205] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:29:43 2021] GET /compute/v2.1/servers/2fe5b190-5679-4b9d-8d5f-fac1a1c407d9 => generated 1321 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:29:43.321275 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.quota [None req-29374e59-ce12-4d82-871f-3f5eee18c941 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Getting quotas for project 440d4048a9ad43869a00218c7acb9614. Resources: {'ram', 'cores', 'instances'} {{(pid=98179) _get_quotas /opt/stack/nova/nova/quota.py:388}} Feb 17 04:29:43.326511 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.quota [None req-29374e59-ce12-4d82-871f-3f5eee18c941 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Getting quotas for user 9b4f65f82a97499dbb900d523924e946 and project 440d4048a9ad43869a00218c7acb9614. Resources: {'ram', 'cores', 'instances'} {{(pid=98179) _get_quotas /opt/stack/nova/nova/quota.py:380}} Feb 17 04:29:43.332146 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-d32714c5-9965-4255-8cb0-0f50ea9c0c45 tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:29:43.333030 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-d32714c5-9965-4255-8cb0-0f50ea9c0c45 tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] [instance: fc3441c6-9dd2-4b3e-8aea-c1ea786a445e] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:29:43.340139 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-29374e59-ce12-4d82-871f-3f5eee18c941 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Going to run 1 instances... {{(pid=98179) _provision_instances /opt/stack/nova/nova/compute/api.py:1264}} Feb 17 04:29:43.343108 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-29374e59-ce12-4d82-871f-3f5eee18c941 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] [instance: 8b4ba536-4de5-4f0e-9cb0-cc08d8616e5d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b005ed36-a85a-4c46-ba22-9fa8c5ec62e5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98179) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1666}} Feb 17 04:29:43.345189 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-d32714c5-9965-4255-8cb0-0f50ea9c0c45 tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:43.346197 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-d32714c5-9965-4255-8cb0-0f50ea9c0c45 tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:43.347784 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-d32714c5-9965-4255-8cb0-0f50ea9c0c45 tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:43.348399 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-d32714c5-9965-4255-8cb0-0f50ea9c0c45 tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:43.402509 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-29374e59-ce12-4d82-871f-3f5eee18c941 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.939902 Feb 17 04:29:43.403385 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 117/206] 10.222.0.78 () {60 vars in 1137 bytes} [Wed Feb 17 04:29:42 2021] POST /compute/v2.1/servers => generated 380 bytes in 942 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 17 04:29:43.413825 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-440cc674-5e0d-4a38-9d93-44934dbadae6 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:29:43.415138 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-440cc674-5e0d-4a38-9d93-44934dbadae6 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: 29d1ce27-f63b-4523-88be-55f65a6a2529] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:29:43.428905 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-440cc674-5e0d-4a38-9d93-44934dbadae6 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:43.430208 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-440cc674-5e0d-4a38-9d93-44934dbadae6 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:43.431977 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-440cc674-5e0d-4a38-9d93-44934dbadae6 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:43.432672 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-440cc674-5e0d-4a38-9d93-44934dbadae6 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:43.658133 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-d32714c5-9965-4255-8cb0-0f50ea9c0c45 tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b59e91a6423843459340bbd8d875007e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd156b69e0ec24a8782b15c83a8c4cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:29:43.669388 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-d32714c5-9965-4255-8cb0-0f50ea9c0c45 tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] 10.222.0.78 "GET /compute/v2.1/servers/fc3441c6-9dd2-4b3e-8aea-c1ea786a445e" status: 200 len: 1553 microversion: 2.1 time: 0.350005 Feb 17 04:29:43.669997 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 90/207] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:29:43 2021] GET /compute/v2.1/servers/fc3441c6-9dd2-4b3e-8aea-c1ea786a445e => generated 1553 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:29:43.681010 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-19fa6120-eeef-464b-8216-8f26c5f59819 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:29:43.681977 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-19fa6120-eeef-464b-8216-8f26c5f59819 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] [instance: 8b4ba536-4de5-4f0e-9cb0-cc08d8616e5d] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:29:43.731755 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-440cc674-5e0d-4a38-9d93-44934dbadae6 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2deb449189ba427a9b8fcb0e21f22566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2c8716a46f54187902492f8ce162f58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:29:43.741138 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-440cc674-5e0d-4a38-9d93-44934dbadae6 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "GET /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529" status: 200 len: 1363 microversion: 2.1 time: 0.335744 Feb 17 04:29:43.741757 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 118/208] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:29:43 2021] GET /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529 => generated 1363 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:29:43.781730 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-19fa6120-eeef-464b-8216-8f26c5f59819 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b4f65f82a97499dbb900d523924e946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440d4048a9ad43869a00218c7acb9614', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:29:43.791223 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-19fa6120-eeef-464b-8216-8f26c5f59819 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] 10.222.0.78 "GET /compute/v2.1/servers/8b4ba536-4de5-4f0e-9cb0-cc08d8616e5d" status: 200 len: 1219 microversion: 2.1 time: 0.114044 Feb 17 04:29:43.792097 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 91/209] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:29:43 2021] GET /compute/v2.1/servers/8b4ba536-4de5-4f0e-9cb0-cc08d8616e5d => generated 1219 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:29:44.335341 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-2c2a0743-bf65-4067-8213-07a4784edac8 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:29:44.337616 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-2c2a0743-bf65-4067-8213-07a4784edac8 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] [instance: 2fe5b190-5679-4b9d-8d5f-fac1a1c407d9] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:29:44.346935 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-2c2a0743-bf65-4067-8213-07a4784edac8 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:44.347471 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-2c2a0743-bf65-4067-8213-07a4784edac8 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:44.348512 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-2c2a0743-bf65-4067-8213-07a4784edac8 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:44.348991 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-2c2a0743-bf65-4067-8213-07a4784edac8 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:44.425831 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [req-19960687-c27c-4866-acb8-11d8377f9054 req-a9e03ea2-9685-4d68-a1bc-3169de64fa1b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29d1ce27-f63b-4523-88be-55f65a6a2529", "name": "network-vif-plugged", "status": "completed", "tag": "55e2629a-f0a2-41a8-b1d3-df6b83ba5111"}]} {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:29:44.427856 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:29:44.427856 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: warnings.warn(msg) Feb 17 04:29:44.437465 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [req-19960687-c27c-4866-acb8-11d8377f9054 req-a9e03ea2-9685-4d68-a1bc-3169de64fa1b service nova] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:44.438315 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [req-19960687-c27c-4866-acb8-11d8377f9054 req-a9e03ea2-9685-4d68-a1bc-3169de64fa1b service nova] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:44.459193 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.compute.server_external_events [req-19960687-c27c-4866-acb8-11d8377f9054 req-a9e03ea2-9685-4d68-a1bc-3169de64fa1b service nova] Creating event network-vif-plugged:55e2629a-f0a2-41a8-b1d3-df6b83ba5111 for instance 29d1ce27-f63b-4523-88be-55f65a6a2529 on hv-cinder-75998 Feb 17 04:29:44.465332 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [req-19960687-c27c-4866-acb8-11d8377f9054 req-a9e03ea2-9685-4d68-a1bc-3169de64fa1b service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043388 Feb 17 04:29:44.466516 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 92/210] 10.222.0.78 () {64 vars in 1308 bytes} [Wed Feb 17 04:29:44 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 17 04:29:44.688980 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-dfa0e637-a3b6-4156-996f-dcef9bc807ca tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:29:44.689823 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-dfa0e637-a3b6-4156-996f-dcef9bc807ca tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] [instance: fc3441c6-9dd2-4b3e-8aea-c1ea786a445e] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:29:44.699346 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-dfa0e637-a3b6-4156-996f-dcef9bc807ca tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:44.700085 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-dfa0e637-a3b6-4156-996f-dcef9bc807ca tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:44.701380 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-dfa0e637-a3b6-4156-996f-dcef9bc807ca tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:44.702082 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-dfa0e637-a3b6-4156-996f-dcef9bc807ca tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:44.724945 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-2c2a0743-bf65-4067-8213-07a4784edac8 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1daf9a83b1d24033a3d4c0f531a4eb2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5336afdcf4aa4b46b0655432b7a1323c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:29:44.740234 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-2c2a0743-bf65-4067-8213-07a4784edac8 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] 10.222.0.78 "GET /compute/v2.1/servers/2fe5b190-5679-4b9d-8d5f-fac1a1c407d9" status: 200 len: 1321 microversion: 2.1 time: 0.408759 Feb 17 04:29:44.741108 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 119/211] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:29:44 2021] GET /compute/v2.1/servers/2fe5b190-5679-4b9d-8d5f-fac1a1c407d9 => generated 1321 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:29:44.760112 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-13f2fa2c-7b01-4615-b118-bdf5bec1a2f1 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:29:44.761289 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-13f2fa2c-7b01-4615-b118-bdf5bec1a2f1 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: 29d1ce27-f63b-4523-88be-55f65a6a2529] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:29:44.769782 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-13f2fa2c-7b01-4615-b118-bdf5bec1a2f1 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:44.770293 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-13f2fa2c-7b01-4615-b118-bdf5bec1a2f1 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:44.771656 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-13f2fa2c-7b01-4615-b118-bdf5bec1a2f1 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:44.772157 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-13f2fa2c-7b01-4615-b118-bdf5bec1a2f1 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:45.026669 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-13f2fa2c-7b01-4615-b118-bdf5bec1a2f1 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2deb449189ba427a9b8fcb0e21f22566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2c8716a46f54187902492f8ce162f58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:29:45.036375 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-13f2fa2c-7b01-4615-b118-bdf5bec1a2f1 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "GET /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529" status: 200 len: 1363 microversion: 2.1 time: 0.280993 Feb 17 04:29:45.037326 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 120/212] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:29:44 2021] GET /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529 => generated 1363 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:29:45.060358 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-89ce35d5-5303-412f-bd0c-129ccb65591f tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:29:45.061043 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-89ce35d5-5303-412f-bd0c-129ccb65591f tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] [instance: 8b4ba536-4de5-4f0e-9cb0-cc08d8616e5d] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:29:45.078775 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-89ce35d5-5303-412f-bd0c-129ccb65591f tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:45.079349 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-89ce35d5-5303-412f-bd0c-129ccb65591f tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:45.080552 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-89ce35d5-5303-412f-bd0c-129ccb65591f tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:45.081085 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-89ce35d5-5303-412f-bd0c-129ccb65591f tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:45.241384 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-89ce35d5-5303-412f-bd0c-129ccb65591f tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b4f65f82a97499dbb900d523924e946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440d4048a9ad43869a00218c7acb9614', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:29:45.251925 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-89ce35d5-5303-412f-bd0c-129ccb65591f tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] 10.222.0.78 "GET /compute/v2.1/servers/8b4ba536-4de5-4f0e-9cb0-cc08d8616e5d" status: 200 len: 1271 microversion: 2.1 time: 0.213195 Feb 17 04:29:45.255991 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 121/213] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:29:45 2021] GET /compute/v2.1/servers/8b4ba536-4de5-4f0e-9cb0-cc08d8616e5d => generated 1271 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:29:45.330486 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-dfa0e637-a3b6-4156-996f-dcef9bc807ca tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b59e91a6423843459340bbd8d875007e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd156b69e0ec24a8782b15c83a8c4cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:29:45.342479 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-dfa0e637-a3b6-4156-996f-dcef9bc807ca tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] 10.222.0.78 "GET /compute/v2.1/servers/fc3441c6-9dd2-4b3e-8aea-c1ea786a445e" status: 200 len: 1553 microversion: 2.1 time: 0.657704 Feb 17 04:29:45.355473 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 93/214] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:29:44 2021] GET /compute/v2.1/servers/fc3441c6-9dd2-4b3e-8aea-c1ea786a445e => generated 1553 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:29:45.758730 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-1960403f-13a1-4e65-84c8-c10c5b6b5727 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:29:45.759763 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-1960403f-13a1-4e65-84c8-c10c5b6b5727 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] [instance: 2fe5b190-5679-4b9d-8d5f-fac1a1c407d9] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:29:45.767597 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-1960403f-13a1-4e65-84c8-c10c5b6b5727 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:45.768216 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-1960403f-13a1-4e65-84c8-c10c5b6b5727 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:45.769163 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-1960403f-13a1-4e65-84c8-c10c5b6b5727 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:45.769768 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-1960403f-13a1-4e65-84c8-c10c5b6b5727 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:46.057009 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-1960403f-13a1-4e65-84c8-c10c5b6b5727 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1daf9a83b1d24033a3d4c0f531a4eb2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5336afdcf4aa4b46b0655432b7a1323c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:29:46.061794 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-90f5d88d-6200-497b-a031-f6dd8bd22463 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:29:46.063625 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-90f5d88d-6200-497b-a031-f6dd8bd22463 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: 29d1ce27-f63b-4523-88be-55f65a6a2529] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:29:46.074476 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-90f5d88d-6200-497b-a031-f6dd8bd22463 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:46.078892 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-1960403f-13a1-4e65-84c8-c10c5b6b5727 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] 10.222.0.78 "GET /compute/v2.1/servers/2fe5b190-5679-4b9d-8d5f-fac1a1c407d9" status: 200 len: 1321 microversion: 2.1 time: 0.324758 Feb 17 04:29:46.080137 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 122/215] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:29:45 2021] GET /compute/v2.1/servers/2fe5b190-5679-4b9d-8d5f-fac1a1c407d9 => generated 1321 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:29:46.095672 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-90f5d88d-6200-497b-a031-f6dd8bd22463 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:46.096993 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-90f5d88d-6200-497b-a031-f6dd8bd22463 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:46.097328 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-90f5d88d-6200-497b-a031-f6dd8bd22463 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:46.272797 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-329758c8-8e85-4d04-8785-21a48a421ff0 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:29:46.274821 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-329758c8-8e85-4d04-8785-21a48a421ff0 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] [instance: 8b4ba536-4de5-4f0e-9cb0-cc08d8616e5d] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:29:46.294287 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-329758c8-8e85-4d04-8785-21a48a421ff0 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:46.294818 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-329758c8-8e85-4d04-8785-21a48a421ff0 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:46.301418 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-329758c8-8e85-4d04-8785-21a48a421ff0 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:46.301943 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-329758c8-8e85-4d04-8785-21a48a421ff0 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:46.493204 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-329758c8-8e85-4d04-8785-21a48a421ff0 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b4f65f82a97499dbb900d523924e946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440d4048a9ad43869a00218c7acb9614', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:29:46.509445 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-329758c8-8e85-4d04-8785-21a48a421ff0 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] 10.222.0.78 "GET /compute/v2.1/servers/8b4ba536-4de5-4f0e-9cb0-cc08d8616e5d" status: 200 len: 1289 microversion: 2.1 time: 0.241994 Feb 17 04:29:46.510610 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 123/216] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:29:46 2021] GET /compute/v2.1/servers/8b4ba536-4de5-4f0e-9cb0-cc08d8616e5d => generated 1289 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:29:46.522047 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-75e12d04-e1f3-478f-b4b1-db2b842cfa36 tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:29:46.522646 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-75e12d04-e1f3-478f-b4b1-db2b842cfa36 tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] [instance: fc3441c6-9dd2-4b3e-8aea-c1ea786a445e] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:29:46.531647 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-75e12d04-e1f3-478f-b4b1-db2b842cfa36 tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:46.532153 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-75e12d04-e1f3-478f-b4b1-db2b842cfa36 tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:46.532995 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-75e12d04-e1f3-478f-b4b1-db2b842cfa36 tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:46.533484 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-75e12d04-e1f3-478f-b4b1-db2b842cfa36 tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:46.814524 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-90f5d88d-6200-497b-a031-f6dd8bd22463 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2deb449189ba427a9b8fcb0e21f22566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2c8716a46f54187902492f8ce162f58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:29:46.826827 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-90f5d88d-6200-497b-a031-f6dd8bd22463 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "GET /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529" status: 200 len: 1363 microversion: 2.1 time: 0.774574 Feb 17 04:29:46.831577 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 94/217] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:29:46 2021] GET /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529 => generated 1363 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:29:46.861048 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-75e12d04-e1f3-478f-b4b1-db2b842cfa36 tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b59e91a6423843459340bbd8d875007e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd156b69e0ec24a8782b15c83a8c4cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:29:46.876559 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-75e12d04-e1f3-478f-b4b1-db2b842cfa36 tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] 10.222.0.78 "GET /compute/v2.1/servers/fc3441c6-9dd2-4b3e-8aea-c1ea786a445e" status: 200 len: 1553 microversion: 2.1 time: 0.364556 Feb 17 04:29:46.883312 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 124/218] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:29:46 2021] GET /compute/v2.1/servers/fc3441c6-9dd2-4b3e-8aea-c1ea786a445e => generated 1553 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:29:47.096862 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-c1731010-f1d5-4b62-9c54-96d325839ffd tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:29:47.098445 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-c1731010-f1d5-4b62-9c54-96d325839ffd tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] [instance: 2fe5b190-5679-4b9d-8d5f-fac1a1c407d9] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:29:47.118481 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-c1731010-f1d5-4b62-9c54-96d325839ffd tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:47.119044 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-c1731010-f1d5-4b62-9c54-96d325839ffd tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:47.119984 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-c1731010-f1d5-4b62-9c54-96d325839ffd tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:47.120435 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-c1731010-f1d5-4b62-9c54-96d325839ffd tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:47.529783 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-35198556-e3ba-4ea2-b7d3-c796136e42d3 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:29:47.530575 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-35198556-e3ba-4ea2-b7d3-c796136e42d3 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] [instance: 8b4ba536-4de5-4f0e-9cb0-cc08d8616e5d] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:29:47.564535 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-35198556-e3ba-4ea2-b7d3-c796136e42d3 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:47.566561 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-35198556-e3ba-4ea2-b7d3-c796136e42d3 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:47.568782 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-35198556-e3ba-4ea2-b7d3-c796136e42d3 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:47.570739 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-35198556-e3ba-4ea2-b7d3-c796136e42d3 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:47.608174 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-c1731010-f1d5-4b62-9c54-96d325839ffd tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1daf9a83b1d24033a3d4c0f531a4eb2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5336afdcf4aa4b46b0655432b7a1323c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:29:47.619919 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-c1731010-f1d5-4b62-9c54-96d325839ffd tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] 10.222.0.78 "GET /compute/v2.1/servers/2fe5b190-5679-4b9d-8d5f-fac1a1c407d9" status: 200 len: 1514 microversion: 2.1 time: 0.527421 Feb 17 04:29:47.623796 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 95/219] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:29:47 2021] GET /compute/v2.1/servers/2fe5b190-5679-4b9d-8d5f-fac1a1c407d9 => generated 1514 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:29:47.643149 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-dcc8f02e-f967-4b99-b960-2bcf9d02411e tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:29:47.644590 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-dcc8f02e-f967-4b99-b960-2bcf9d02411e tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] [instance: 2fe5b190-5679-4b9d-8d5f-fac1a1c407d9] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:29:47.653941 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-dcc8f02e-f967-4b99-b960-2bcf9d02411e tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:47.654869 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-dcc8f02e-f967-4b99-b960-2bcf9d02411e tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:47.655918 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-dcc8f02e-f967-4b99-b960-2bcf9d02411e tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:47.656589 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-dcc8f02e-f967-4b99-b960-2bcf9d02411e tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:47.725660 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.objects.instance [None req-dcc8f02e-f967-4b99-b960-2bcf9d02411e tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lazy-loading 'flavor' on Instance uuid 2fe5b190-5679-4b9d-8d5f-fac1a1c407d9 {{(pid=98178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Feb 17 04:29:47.906255 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-dcc8f02e-f967-4b99-b960-2bcf9d02411e tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] 10.222.0.78 "POST /compute/v2.1/servers/2fe5b190-5679-4b9d-8d5f-fac1a1c407d9/action" status: 200 len: 32 microversion: 2.1 time: 0.267641 Feb 17 04:29:47.910943 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 96/220] 10.222.0.78 () {60 vars in 1268 bytes} [Wed Feb 17 04:29:47 2021] POST /compute/v2.1/servers/2fe5b190-5679-4b9d-8d5f-fac1a1c407d9/action => generated 32 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Feb 17 04:29:47.914047 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-b6b90fb2-1898-419a-b61a-0fb990714a7d tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:29:47.914852 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-b6b90fb2-1898-419a-b61a-0fb990714a7d tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: 29d1ce27-f63b-4523-88be-55f65a6a2529] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:29:47.924898 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-b6b90fb2-1898-419a-b61a-0fb990714a7d tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:47.925272 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-b6b90fb2-1898-419a-b61a-0fb990714a7d tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:47.926297 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-b6b90fb2-1898-419a-b61a-0fb990714a7d tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:47.926951 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-b6b90fb2-1898-419a-b61a-0fb990714a7d tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:48.120529 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-35198556-e3ba-4ea2-b7d3-c796136e42d3 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b4f65f82a97499dbb900d523924e946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440d4048a9ad43869a00218c7acb9614', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:29:48.136837 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-35198556-e3ba-4ea2-b7d3-c796136e42d3 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] 10.222.0.78 "GET /compute/v2.1/servers/8b4ba536-4de5-4f0e-9cb0-cc08d8616e5d" status: 200 len: 1277 microversion: 2.1 time: 0.612200 Feb 17 04:29:48.139537 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 125/221] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:29:47 2021] GET /compute/v2.1/servers/8b4ba536-4de5-4f0e-9cb0-cc08d8616e5d => generated 1277 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:29:48.152646 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-4d7c281b-b30c-4538-b0c1-451ad7a5dcd2 tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:29:48.153618 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-4d7c281b-b30c-4538-b0c1-451ad7a5dcd2 tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] [instance: fc3441c6-9dd2-4b3e-8aea-c1ea786a445e] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:29:48.181615 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-4d7c281b-b30c-4538-b0c1-451ad7a5dcd2 tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:48.182457 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-4d7c281b-b30c-4538-b0c1-451ad7a5dcd2 tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:48.183718 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-4d7c281b-b30c-4538-b0c1-451ad7a5dcd2 tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:48.185111 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-4d7c281b-b30c-4538-b0c1-451ad7a5dcd2 tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:48.441331 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-b6b90fb2-1898-419a-b61a-0fb990714a7d tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2deb449189ba427a9b8fcb0e21f22566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2c8716a46f54187902492f8ce162f58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:29:48.454388 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-b6b90fb2-1898-419a-b61a-0fb990714a7d tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "GET /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529" status: 200 len: 1363 microversion: 2.1 time: 0.545866 Feb 17 04:29:48.454994 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 97/222] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:29:47 2021] GET /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529 => generated 1363 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:29:48.469966 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-e2969632-f268-4ecd-a911-2e142e839555 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:29:48.470834 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-e2969632-f268-4ecd-a911-2e142e839555 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] [instance: 2fe5b190-5679-4b9d-8d5f-fac1a1c407d9] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:29:48.489513 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-e2969632-f268-4ecd-a911-2e142e839555 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:48.490032 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-e2969632-f268-4ecd-a911-2e142e839555 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:48.490896 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-e2969632-f268-4ecd-a911-2e142e839555 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:48.491430 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-e2969632-f268-4ecd-a911-2e142e839555 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:48.809765 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-4d7c281b-b30c-4538-b0c1-451ad7a5dcd2 tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b59e91a6423843459340bbd8d875007e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd156b69e0ec24a8782b15c83a8c4cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:29:48.822609 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-4d7c281b-b30c-4538-b0c1-451ad7a5dcd2 tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] 10.222.0.78 "GET /compute/v2.1/servers/fc3441c6-9dd2-4b3e-8aea-c1ea786a445e" status: 200 len: 1553 microversion: 2.1 time: 0.680657 Feb 17 04:29:48.823597 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 126/223] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:29:48 2021] GET /compute/v2.1/servers/fc3441c6-9dd2-4b3e-8aea-c1ea786a445e => generated 1553 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:29:49.160206 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-8bbb97f7-c944-4e95-a17c-ef8ff588138f tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:29:49.160940 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-8bbb97f7-c944-4e95-a17c-ef8ff588138f tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] [instance: 8b4ba536-4de5-4f0e-9cb0-cc08d8616e5d] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:29:49.183655 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-8bbb97f7-c944-4e95-a17c-ef8ff588138f tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:49.184172 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-8bbb97f7-c944-4e95-a17c-ef8ff588138f tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:49.185044 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-8bbb97f7-c944-4e95-a17c-ef8ff588138f tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:49.185538 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-8bbb97f7-c944-4e95-a17c-ef8ff588138f tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:49.780747 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-e2969632-f268-4ecd-a911-2e142e839555 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1daf9a83b1d24033a3d4c0f531a4eb2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5336afdcf4aa4b46b0655432b7a1323c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:29:49.792081 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-e2969632-f268-4ecd-a911-2e142e839555 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] 10.222.0.78 "GET /compute/v2.1/servers/2fe5b190-5679-4b9d-8d5f-fac1a1c407d9" status: 200 len: 1520 microversion: 2.1 time: 1.331820 Feb 17 04:29:49.804263 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 98/224] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:29:48 2021] GET /compute/v2.1/servers/2fe5b190-5679-4b9d-8d5f-fac1a1c407d9 => generated 1520 bytes in 1344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:29:49.811786 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-70e44358-9415-473b-9205-4212c726e15e tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:29:49.812704 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-70e44358-9415-473b-9205-4212c726e15e tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: 29d1ce27-f63b-4523-88be-55f65a6a2529] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:29:49.864059 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-70e44358-9415-473b-9205-4212c726e15e tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:49.864572 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-70e44358-9415-473b-9205-4212c726e15e tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:49.865417 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-70e44358-9415-473b-9205-4212c726e15e tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:49.865908 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-70e44358-9415-473b-9205-4212c726e15e tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:50.458995 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-8bbb97f7-c944-4e95-a17c-ef8ff588138f tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b4f65f82a97499dbb900d523924e946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440d4048a9ad43869a00218c7acb9614', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:29:50.471332 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-8bbb97f7-c944-4e95-a17c-ef8ff588138f tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] 10.222.0.78 "GET /compute/v2.1/servers/8b4ba536-4de5-4f0e-9cb0-cc08d8616e5d" status: 200 len: 1319 microversion: 2.1 time: 1.315404 Feb 17 04:29:50.472869 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 127/225] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:29:49 2021] GET /compute/v2.1/servers/8b4ba536-4de5-4f0e-9cb0-cc08d8616e5d => generated 1319 bytes in 1320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:29:50.478830 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-87104a91-85d5-47d5-88fb-38e9b26cf6c4 tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:29:50.479818 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-87104a91-85d5-47d5-88fb-38e9b26cf6c4 tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] [instance: fc3441c6-9dd2-4b3e-8aea-c1ea786a445e] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:29:50.489573 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-87104a91-85d5-47d5-88fb-38e9b26cf6c4 tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:50.490343 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-87104a91-85d5-47d5-88fb-38e9b26cf6c4 tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:50.491819 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-87104a91-85d5-47d5-88fb-38e9b26cf6c4 tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:50.492953 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-87104a91-85d5-47d5-88fb-38e9b26cf6c4 tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:50.864046 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-87104a91-85d5-47d5-88fb-38e9b26cf6c4 tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b59e91a6423843459340bbd8d875007e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd156b69e0ec24a8782b15c83a8c4cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:29:50.874556 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-87104a91-85d5-47d5-88fb-38e9b26cf6c4 tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] 10.222.0.78 "GET /compute/v2.1/servers/fc3441c6-9dd2-4b3e-8aea-c1ea786a445e" status: 200 len: 1553 microversion: 2.1 time: 0.400302 Feb 17 04:29:50.875187 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 128/226] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:29:50 2021] GET /compute/v2.1/servers/fc3441c6-9dd2-4b3e-8aea-c1ea786a445e => generated 1553 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:29:50.890423 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-70e44358-9415-473b-9205-4212c726e15e tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2deb449189ba427a9b8fcb0e21f22566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2c8716a46f54187902492f8ce162f58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:29:50.896458 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-f733dfc8-c235-42ee-bf07-b0851512a7a8 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-273901100", "imageRef": "b005ed36-a85a-4c46-ba22-9fa8c5ec62e5", "flavorRef": "452", "networks": [{"uuid": "96c670ae-41b0-4a7d-b9a0-1a1a0b99417f"}]}} {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:29:50.905496 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-70e44358-9415-473b-9205-4212c726e15e tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "GET /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529" status: 200 len: 1548 microversion: 2.1 time: 1.099315 Feb 17 04:29:50.906208 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 99/227] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:29:49 2021] GET /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529 => generated 1548 bytes in 1101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:29:50.911481 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [req-a98ed8b8-b24e-43dc-a1b7-ecaa7074dafc req-bee0e6ed-fb09-4589-803d-91f6e93f3bf9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc3441c6-9dd2-4b3e-8aea-c1ea786a445e", "name": "network-vif-unplugged", "status": "completed", "tag": "a3fb43ae-c2fe-478c-b9a6-913bf7c74695"}]} {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:29:50.913163 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:29:50.913163 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: warnings.warn(msg) Feb 17 04:29:50.927375 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [req-a98ed8b8-b24e-43dc-a1b7-ecaa7074dafc req-bee0e6ed-fb09-4589-803d-91f6e93f3bf9 service nova] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:50.928004 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [req-a98ed8b8-b24e-43dc-a1b7-ecaa7074dafc req-bee0e6ed-fb09-4589-803d-91f6e93f3bf9 service nova] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:50.967411 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.compute.server_external_events [req-a98ed8b8-b24e-43dc-a1b7-ecaa7074dafc req-bee0e6ed-fb09-4589-803d-91f6e93f3bf9 service nova] Creating event network-vif-unplugged:a3fb43ae-c2fe-478c-b9a6-913bf7c74695 for instance fc3441c6-9dd2-4b3e-8aea-c1ea786a445e on hv-cinder-75998 Feb 17 04:29:50.972940 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [req-a98ed8b8-b24e-43dc-a1b7-ecaa7074dafc req-bee0e6ed-fb09-4589-803d-91f6e93f3bf9 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.065114 Feb 17 04:29:50.974222 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 100/228] 10.222.0.78 () {64 vars in 1308 bytes} [Wed Feb 17 04:29:50 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:29:50.984472 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.network.neutron [None req-f733dfc8-c235-42ee-bf07-b0851512a7a8 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] validate_networks() for [('96c670ae-41b0-4a7d-b9a0-1a1a0b99417f', None, None, None)] {{(pid=98179) validate_networks /opt/stack/nova/nova/network/neutron.py:2345}} Feb 17 04:29:50.985144 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-9c453d84-b95d-43ce-8ecd-1368e679e299 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:29:50.986620 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-9c453d84-b95d-43ce-8ecd-1368e679e299 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] [instance: 2fe5b190-5679-4b9d-8d5f-fac1a1c407d9] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:29:50.996968 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-9c453d84-b95d-43ce-8ecd-1368e679e299 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:50.997814 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-9c453d84-b95d-43ce-8ecd-1368e679e299 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:50.999003 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-9c453d84-b95d-43ce-8ecd-1368e679e299 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:50.999730 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-9c453d84-b95d-43ce-8ecd-1368e679e299 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:51.587355 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-9c453d84-b95d-43ce-8ecd-1368e679e299 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1daf9a83b1d24033a3d4c0f531a4eb2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5336afdcf4aa4b46b0655432b7a1323c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:29:51.598502 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-9c453d84-b95d-43ce-8ecd-1368e679e299 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] 10.222.0.78 "GET /compute/v2.1/servers/2fe5b190-5679-4b9d-8d5f-fac1a1c407d9" status: 200 len: 1520 microversion: 2.1 time: 0.623241 Feb 17 04:29:51.599423 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 101/229] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:29:50 2021] GET /compute/v2.1/servers/2fe5b190-5679-4b9d-8d5f-fac1a1c407d9 => generated 1520 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:29:51.614104 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-7456f802-c213-4c02-a11f-726613bdb0cc tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:29:51.614892 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-7456f802-c213-4c02-a11f-726613bdb0cc tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: 29d1ce27-f63b-4523-88be-55f65a6a2529] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:29:51.623972 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-7456f802-c213-4c02-a11f-726613bdb0cc tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:51.624736 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-7456f802-c213-4c02-a11f-726613bdb0cc tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:51.625767 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-7456f802-c213-4c02-a11f-726613bdb0cc tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:51.626450 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-7456f802-c213-4c02-a11f-726613bdb0cc tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:52.026397 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-7456f802-c213-4c02-a11f-726613bdb0cc tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "GET /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.424824 Feb 17 04:29:52.033448 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 102/230] 10.222.0.78 () {58 vars in 1265 bytes} [Wed Feb 17 04:29:51 2021] GET /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529/os-interface => generated 284 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:29:52.039310 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-1e6279a3-e9ac-43a5-a2fa-419c08f62362 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:29:52.040192 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-1e6279a3-e9ac-43a5-a2fa-419c08f62362 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] [instance: 8b4ba536-4de5-4f0e-9cb0-cc08d8616e5d] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:29:52.049291 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-1e6279a3-e9ac-43a5-a2fa-419c08f62362 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:52.050055 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-1e6279a3-e9ac-43a5-a2fa-419c08f62362 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:52.051227 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-1e6279a3-e9ac-43a5-a2fa-419c08f62362 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:52.051870 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-1e6279a3-e9ac-43a5-a2fa-419c08f62362 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:52.417077 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.virt.hardware [None req-f733dfc8-c235-42ee-bf07-b0851512a7a8 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Flavor limits 0:0:0 {{(pid=98179) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 17 04:29:52.417835 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.virt.hardware [None req-f733dfc8-c235-42ee-bf07-b0851512a7a8 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Image limits 0:0:0 {{(pid=98179) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Feb 17 04:29:52.418574 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.virt.hardware [None req-f733dfc8-c235-42ee-bf07-b0851512a7a8 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Flavor pref 0:0:0 {{(pid=98179) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 17 04:29:52.419322 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.virt.hardware [None req-f733dfc8-c235-42ee-bf07-b0851512a7a8 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Image pref 0:0:0 {{(pid=98179) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Feb 17 04:29:52.419973 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.virt.hardware [None req-f733dfc8-c235-42ee-bf07-b0851512a7a8 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98179) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Feb 17 04:29:52.434231 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-f733dfc8-c235-42ee-bf07-b0851512a7a8 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:52.434998 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-f733dfc8-c235-42ee-bf07-b0851512a7a8 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:52.438276 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-f733dfc8-c235-42ee-bf07-b0851512a7a8 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:52.438984 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-f733dfc8-c235-42ee-bf07-b0851512a7a8 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:52.488110 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.quota [None req-f733dfc8-c235-42ee-bf07-b0851512a7a8 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Getting quotas for project 2f2a1ca6347d4278899a1cc009d87d33. Resources: {'ram', 'cores', 'instances'} {{(pid=98179) _get_quotas /opt/stack/nova/nova/quota.py:388}} Feb 17 04:29:52.501361 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.quota [None req-f733dfc8-c235-42ee-bf07-b0851512a7a8 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Getting quotas for user 6d68d4a6c12e4331b8df8191cdd7a669 and project 2f2a1ca6347d4278899a1cc009d87d33. Resources: {'ram', 'cores', 'instances'} {{(pid=98179) _get_quotas /opt/stack/nova/nova/quota.py:380}} Feb 17 04:29:52.529475 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-f733dfc8-c235-42ee-bf07-b0851512a7a8 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Going to run 1 instances... {{(pid=98179) _provision_instances /opt/stack/nova/nova/compute/api.py:1264}} Feb 17 04:29:52.535356 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-f733dfc8-c235-42ee-bf07-b0851512a7a8 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] [instance: 555b8368-f196-4c6c-acf7-bc67d324c98a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b005ed36-a85a-4c46-ba22-9fa8c5ec62e5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98179) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1666}} Feb 17 04:29:52.644174 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-f733dfc8-c235-42ee-bf07-b0851512a7a8 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.767252 Feb 17 04:29:52.652344 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 129/231] 10.222.0.78 () {60 vars in 1137 bytes} [Wed Feb 17 04:29:50 2021] POST /compute/v2.1/servers => generated 380 bytes in 1770 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 17 04:29:52.659750 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-90b92547-7878-4ee8-86ad-bb93997eefd8 tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:29:52.660649 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-90b92547-7878-4ee8-86ad-bb93997eefd8 tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] [instance: fc3441c6-9dd2-4b3e-8aea-c1ea786a445e] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:29:52.671312 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-90b92547-7878-4ee8-86ad-bb93997eefd8 tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:52.679927 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-90b92547-7878-4ee8-86ad-bb93997eefd8 tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:52.682144 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-90b92547-7878-4ee8-86ad-bb93997eefd8 tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:52.683526 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-90b92547-7878-4ee8-86ad-bb93997eefd8 tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:52.904186 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-90b92547-7878-4ee8-86ad-bb93997eefd8 tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b59e91a6423843459340bbd8d875007e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd156b69e0ec24a8782b15c83a8c4cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:29:52.915354 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-90b92547-7878-4ee8-86ad-bb93997eefd8 tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] 10.222.0.78 "GET /compute/v2.1/servers/fc3441c6-9dd2-4b3e-8aea-c1ea786a445e" status: 200 len: 1345 microversion: 2.1 time: 0.260064 Feb 17 04:29:52.916459 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 130/232] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:29:52 2021] GET /compute/v2.1/servers/fc3441c6-9dd2-4b3e-8aea-c1ea786a445e => generated 1345 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:29:52.931905 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-7ab97cc1-6cf9-412f-9642-46464f142512 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:29:52.932781 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-7ab97cc1-6cf9-412f-9642-46464f142512 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] [instance: 2fe5b190-5679-4b9d-8d5f-fac1a1c407d9] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:29:52.941645 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-7ab97cc1-6cf9-412f-9642-46464f142512 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:52.942339 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-7ab97cc1-6cf9-412f-9642-46464f142512 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:52.943256 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-7ab97cc1-6cf9-412f-9642-46464f142512 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:52.943853 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-7ab97cc1-6cf9-412f-9642-46464f142512 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:53.241398 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-7ab97cc1-6cf9-412f-9642-46464f142512 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1daf9a83b1d24033a3d4c0f531a4eb2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5336afdcf4aa4b46b0655432b7a1323c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:29:53.251270 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-7ab97cc1-6cf9-412f-9642-46464f142512 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] 10.222.0.78 "GET /compute/v2.1/servers/2fe5b190-5679-4b9d-8d5f-fac1a1c407d9" status: 200 len: 1520 microversion: 2.1 time: 0.323833 Feb 17 04:29:53.251886 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 131/233] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:29:52 2021] GET /compute/v2.1/servers/2fe5b190-5679-4b9d-8d5f-fac1a1c407d9 => generated 1520 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:29:53.257126 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [req-3e783d85-c75a-4b52-ae7b-e64fe55a1bdb req-cf722467-713a-4251-b227-f608e8e199ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc3441c6-9dd2-4b3e-8aea-c1ea786a445e", "name": "network-vif-deleted", "tag": "a3fb43ae-c2fe-478c-b9a6-913bf7c74695"}]} {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:29:53.259089 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:29:53.259089 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: warnings.warn(msg) Feb 17 04:29:53.290044 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [req-3e783d85-c75a-4b52-ae7b-e64fe55a1bdb req-cf722467-713a-4251-b227-f608e8e199ae service nova] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:53.293443 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [req-3e783d85-c75a-4b52-ae7b-e64fe55a1bdb req-cf722467-713a-4251-b227-f608e8e199ae service nova] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:53.330142 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.compute.server_external_events [req-3e783d85-c75a-4b52-ae7b-e64fe55a1bdb req-cf722467-713a-4251-b227-f608e8e199ae service nova] Creating event network-vif-deleted:a3fb43ae-c2fe-478c-b9a6-913bf7c74695 for instance fc3441c6-9dd2-4b3e-8aea-c1ea786a445e on hv-cinder-75998 Feb 17 04:29:53.335285 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [req-3e783d85-c75a-4b52-ae7b-e64fe55a1bdb req-cf722467-713a-4251-b227-f608e8e199ae service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082102 Feb 17 04:29:53.336534 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 132/234] 10.222.0.78 () {64 vars in 1308 bytes} [Wed Feb 17 04:29:53 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:29:53.342832 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-eb1e3377-941e-4131-a7e3-b562fb654791 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:29:53.343911 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-eb1e3377-941e-4131-a7e3-b562fb654791 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] [instance: 555b8368-f196-4c6c-acf7-bc67d324c98a] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:29:53.352965 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-eb1e3377-941e-4131-a7e3-b562fb654791 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:53.354007 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-eb1e3377-941e-4131-a7e3-b562fb654791 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:53.355012 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-eb1e3377-941e-4131-a7e3-b562fb654791 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:53.355701 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-eb1e3377-941e-4131-a7e3-b562fb654791 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:53.526189 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-eb1e3377-941e-4131-a7e3-b562fb654791 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d68d4a6c12e4331b8df8191cdd7a669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2a1ca6347d4278899a1cc009d87d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:29:53.536317 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-eb1e3377-941e-4131-a7e3-b562fb654791 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] 10.222.0.78 "GET /compute/v2.1/servers/555b8368-f196-4c6c-acf7-bc67d324c98a" status: 200 len: 1221 microversion: 2.1 time: 0.198035 Feb 17 04:29:53.537546 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 133/235] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:29:53 2021] GET /compute/v2.1/servers/555b8368-f196-4c6c-acf7-bc67d324c98a => generated 1221 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:29:53.912212 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-1e6279a3-e9ac-43a5-a2fa-419c08f62362 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b4f65f82a97499dbb900d523924e946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440d4048a9ad43869a00218c7acb9614', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:29:53.923082 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-1e6279a3-e9ac-43a5-a2fa-419c08f62362 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] 10.222.0.78 "GET /compute/v2.1/servers/8b4ba536-4de5-4f0e-9cb0-cc08d8616e5d" status: 200 len: 1319 microversion: 2.1 time: 1.888423 Feb 17 04:29:53.924971 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 103/236] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:29:52 2021] GET /compute/v2.1/servers/8b4ba536-4de5-4f0e-9cb0-cc08d8616e5d => generated 1319 bytes in 1891 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:29:53.941832 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-f90590b1-395c-4294-a4bd-81af2b33c9d6 tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:29:53.942100 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-f90590b1-395c-4294-a4bd-81af2b33c9d6 tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] [instance: fc3441c6-9dd2-4b3e-8aea-c1ea786a445e] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:29:53.950530 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-f90590b1-395c-4294-a4bd-81af2b33c9d6 tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:53.951058 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-f90590b1-395c-4294-a4bd-81af2b33c9d6 tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:53.952055 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-f90590b1-395c-4294-a4bd-81af2b33c9d6 tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:53.952558 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-f90590b1-395c-4294-a4bd-81af2b33c9d6 tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:54.033669 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-f90590b1-395c-4294-a4bd-81af2b33c9d6 tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:54.034292 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-f90590b1-395c-4294-a4bd-81af2b33c9d6 tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:54.034897 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.objects.instance [None req-f90590b1-395c-4294-a4bd-81af2b33c9d6 tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] Lazy-loading 'fault' on Instance uuid fc3441c6-9dd2-4b3e-8aea-c1ea786a445e {{(pid=98179) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Feb 17 04:29:54.106357 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-f90590b1-395c-4294-a4bd-81af2b33c9d6 tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b59e91a6423843459340bbd8d875007e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd156b69e0ec24a8782b15c83a8c4cf02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:29:54.119526 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-f90590b1-395c-4294-a4bd-81af2b33c9d6 tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] 10.222.0.78 "GET /compute/v2.1/servers/fc3441c6-9dd2-4b3e-8aea-c1ea786a445e" status: 200 len: 1350 microversion: 2.1 time: 0.182850 Feb 17 04:29:54.130002 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 134/237] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:29:53 2021] GET /compute/v2.1/servers/fc3441c6-9dd2-4b3e-8aea-c1ea786a445e => generated 1350 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:29:54.269688 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-5eb611b0-ef99-45a6-a0d5-f3b66168a430 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:29:54.270333 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-5eb611b0-ef99-45a6-a0d5-f3b66168a430 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] [instance: 2fe5b190-5679-4b9d-8d5f-fac1a1c407d9] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:29:54.291662 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-5eb611b0-ef99-45a6-a0d5-f3b66168a430 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:54.292443 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-5eb611b0-ef99-45a6-a0d5-f3b66168a430 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:54.293885 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-5eb611b0-ef99-45a6-a0d5-f3b66168a430 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:54.298887 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-5eb611b0-ef99-45a6-a0d5-f3b66168a430 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:54.556339 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-2e991aea-58b6-4555-817d-81585b207b6a tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:29:54.557021 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-2e991aea-58b6-4555-817d-81585b207b6a tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] [instance: 555b8368-f196-4c6c-acf7-bc67d324c98a] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:29:54.576315 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-2e991aea-58b6-4555-817d-81585b207b6a tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:54.576315 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-2e991aea-58b6-4555-817d-81585b207b6a tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:54.576315 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-2e991aea-58b6-4555-817d-81585b207b6a tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:54.576315 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-2e991aea-58b6-4555-817d-81585b207b6a tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:54.779838 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-2e991aea-58b6-4555-817d-81585b207b6a tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d68d4a6c12e4331b8df8191cdd7a669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2a1ca6347d4278899a1cc009d87d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:29:54.797256 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-2e991aea-58b6-4555-817d-81585b207b6a tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] 10.222.0.78 "GET /compute/v2.1/servers/555b8368-f196-4c6c-acf7-bc67d324c98a" status: 200 len: 1269 microversion: 2.1 time: 0.244024 Feb 17 04:29:54.798017 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 135/238] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:29:54 2021] GET /compute/v2.1/servers/555b8368-f196-4c6c-acf7-bc67d324c98a => generated 1269 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:29:54.875960 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-00fb6f6f-a145-46ac-a9c4-fa7fac40164a tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-2089866593", "imageRef": "b005ed36-a85a-4c46-ba22-9fa8c5ec62e5", "flavorRef": "452", "networks": [{"uuid": "d46ecdde-60b7-4f1a-a53d-f388f26afd45"}]}} {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:29:54.954097 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.network.neutron [None req-00fb6f6f-a145-46ac-a9c4-fa7fac40164a tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] validate_networks() for [('d46ecdde-60b7-4f1a-a53d-f388f26afd45', None, None, None)] {{(pid=98179) validate_networks /opt/stack/nova/nova/network/neutron.py:2345}} Feb 17 04:29:55.203294 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-5eb611b0-ef99-45a6-a0d5-f3b66168a430 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1daf9a83b1d24033a3d4c0f531a4eb2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5336afdcf4aa4b46b0655432b7a1323c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:29:55.220969 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-5eb611b0-ef99-45a6-a0d5-f3b66168a430 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] 10.222.0.78 "GET /compute/v2.1/servers/2fe5b190-5679-4b9d-8d5f-fac1a1c407d9" status: 200 len: 1520 microversion: 2.1 time: 0.955371 Feb 17 04:29:55.221936 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 104/239] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:29:54 2021] GET /compute/v2.1/servers/2fe5b190-5679-4b9d-8d5f-fac1a1c407d9 => generated 1520 bytes in 958 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:29:55.237161 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-6c9f5a79-1c6b-40b3-8c94-10e9447ad987 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:29:55.238696 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-6c9f5a79-1c6b-40b3-8c94-10e9447ad987 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] [instance: 8b4ba536-4de5-4f0e-9cb0-cc08d8616e5d] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:29:55.251552 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-6c9f5a79-1c6b-40b3-8c94-10e9447ad987 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:55.252094 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-6c9f5a79-1c6b-40b3-8c94-10e9447ad987 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:55.252948 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-6c9f5a79-1c6b-40b3-8c94-10e9447ad987 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:55.253807 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-6c9f5a79-1c6b-40b3-8c94-10e9447ad987 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:55.929389 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-6c9f5a79-1c6b-40b3-8c94-10e9447ad987 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b4f65f82a97499dbb900d523924e946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440d4048a9ad43869a00218c7acb9614', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:29:55.947462 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-6c9f5a79-1c6b-40b3-8c94-10e9447ad987 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] 10.222.0.78 "GET /compute/v2.1/servers/8b4ba536-4de5-4f0e-9cb0-cc08d8616e5d" status: 200 len: 1319 microversion: 2.1 time: 0.721617 Feb 17 04:29:55.957543 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 105/240] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:29:55 2021] GET /compute/v2.1/servers/8b4ba536-4de5-4f0e-9cb0-cc08d8616e5d => generated 1319 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:29:55.969676 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [req-8e76bdf4-997b-4459-8c53-132e813d405d req-cc9c89cd-7241-4613-b564-43f86c0b29de service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8b4ba536-4de5-4f0e-9cb0-cc08d8616e5d", "tag": "e9253754-0efa-4648-94ae-780814a11e89"}]} {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:29:55.969676 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:29:55.969676 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: warnings.warn(msg) Feb 17 04:29:55.979661 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [req-8e76bdf4-997b-4459-8c53-132e813d405d req-cc9c89cd-7241-4613-b564-43f86c0b29de service nova] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:55.980171 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [req-8e76bdf4-997b-4459-8c53-132e813d405d req-cc9c89cd-7241-4613-b564-43f86c0b29de service nova] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:55.998452 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.compute.server_external_events [req-8e76bdf4-997b-4459-8c53-132e813d405d req-cc9c89cd-7241-4613-b564-43f86c0b29de service nova] Creating event network-changed:e9253754-0efa-4648-94ae-780814a11e89 for instance 8b4ba536-4de5-4f0e-9cb0-cc08d8616e5d on hv-cinder-75998 Feb 17 04:29:56.004345 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [req-8e76bdf4-997b-4459-8c53-132e813d405d req-cc9c89cd-7241-4613-b564-43f86c0b29de service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054709 Feb 17 04:29:56.005236 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 106/241] 10.222.0.78 () {64 vars in 1308 bytes} [Wed Feb 17 04:29:55 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:29:56.011500 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-e87a58e5-a8e4-4040-81a7-9caf0b5fc944 tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:29:56.012268 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-e87a58e5-a8e4-4040-81a7-9caf0b5fc944 tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] [instance: fc3441c6-9dd2-4b3e-8aea-c1ea786a445e] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:29:56.020507 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-e87a58e5-a8e4-4040-81a7-9caf0b5fc944 tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:56.021018 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-e87a58e5-a8e4-4040-81a7-9caf0b5fc944 tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:56.021874 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-e87a58e5-a8e4-4040-81a7-9caf0b5fc944 tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:56.022473 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-e87a58e5-a8e4-4040-81a7-9caf0b5fc944 tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:56.081278 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.wsgi [None req-e87a58e5-a8e4-4040-81a7-9caf0b5fc944 tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] HTTP exception thrown: Instance fc3441c6-9dd2-4b3e-8aea-c1ea786a445e could not be found. Feb 17 04:29:56.082120 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-e87a58e5-a8e4-4040-81a7-9caf0b5fc944 tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] Returning 404 to user: Instance fc3441c6-9dd2-4b3e-8aea-c1ea786a445e could not be found. {{(pid=98178) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 17 04:29:56.083240 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-e87a58e5-a8e4-4040-81a7-9caf0b5fc944 tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] 10.222.0.78 "GET /compute/v2.1/servers/fc3441c6-9dd2-4b3e-8aea-c1ea786a445e" status: 404 len: 111 microversion: 2.1 time: 0.077009 Feb 17 04:29:56.084114 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 107/242] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:29:56 2021] GET /compute/v2.1/servers/fc3441c6-9dd2-4b3e-8aea-c1ea786a445e => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 17 04:29:56.088858 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-0635cee7-d686-4ffe-8d21-c4b5985ec00b tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:29:56.089532 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-0635cee7-d686-4ffe-8d21-c4b5985ec00b tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] [instance: 555b8368-f196-4c6c-acf7-bc67d324c98a] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:29:56.097576 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-0635cee7-d686-4ffe-8d21-c4b5985ec00b tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:56.098158 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-0635cee7-d686-4ffe-8d21-c4b5985ec00b tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:56.099514 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-0635cee7-d686-4ffe-8d21-c4b5985ec00b tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:56.100405 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-0635cee7-d686-4ffe-8d21-c4b5985ec00b tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:56.469115 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-0635cee7-d686-4ffe-8d21-c4b5985ec00b tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d68d4a6c12e4331b8df8191cdd7a669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2a1ca6347d4278899a1cc009d87d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:29:56.480410 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-0635cee7-d686-4ffe-8d21-c4b5985ec00b tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] 10.222.0.78 "GET /compute/v2.1/servers/555b8368-f196-4c6c-acf7-bc67d324c98a" status: 200 len: 1275 microversion: 2.1 time: 0.394855 Feb 17 04:29:56.481317 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 108/243] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:29:56 2021] GET /compute/v2.1/servers/555b8368-f196-4c6c-acf7-bc67d324c98a => generated 1275 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:29:56.488768 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-1baf6c88-9c41-4ebb-9f7b-eece0e838a05 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:29:56.490777 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-1baf6c88-9c41-4ebb-9f7b-eece0e838a05 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] [instance: 2fe5b190-5679-4b9d-8d5f-fac1a1c407d9] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:29:56.504092 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-1baf6c88-9c41-4ebb-9f7b-eece0e838a05 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:56.504805 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-1baf6c88-9c41-4ebb-9f7b-eece0e838a05 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:56.506328 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-1baf6c88-9c41-4ebb-9f7b-eece0e838a05 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:56.507015 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-1baf6c88-9c41-4ebb-9f7b-eece0e838a05 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:56.524618 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.virt.hardware [None req-00fb6f6f-a145-46ac-a9c4-fa7fac40164a tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Flavor limits 0:0:0 {{(pid=98179) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 17 04:29:56.525696 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.virt.hardware [None req-00fb6f6f-a145-46ac-a9c4-fa7fac40164a tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Image limits 0:0:0 {{(pid=98179) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Feb 17 04:29:56.526478 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.virt.hardware [None req-00fb6f6f-a145-46ac-a9c4-fa7fac40164a tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Flavor pref 0:0:0 {{(pid=98179) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 17 04:29:56.527326 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.virt.hardware [None req-00fb6f6f-a145-46ac-a9c4-fa7fac40164a tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Image pref 0:0:0 {{(pid=98179) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Feb 17 04:29:56.528112 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.virt.hardware [None req-00fb6f6f-a145-46ac-a9c4-fa7fac40164a tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98179) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Feb 17 04:29:56.539969 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-00fb6f6f-a145-46ac-a9c4-fa7fac40164a tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:56.540815 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-00fb6f6f-a145-46ac-a9c4-fa7fac40164a tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:56.541904 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-00fb6f6f-a145-46ac-a9c4-fa7fac40164a tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:56.542599 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-00fb6f6f-a145-46ac-a9c4-fa7fac40164a tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:56.574574 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.quota [None req-00fb6f6f-a145-46ac-a9c4-fa7fac40164a tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Getting quotas for project b0608d586fdf4ba4b2b7f7137d49389a. Resources: {'ram', 'cores', 'instances'} {{(pid=98179) _get_quotas /opt/stack/nova/nova/quota.py:388}} Feb 17 04:29:56.579872 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.quota [None req-00fb6f6f-a145-46ac-a9c4-fa7fac40164a tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Getting quotas for user 88eaaf0dd96340229d9f519b3489cf63 and project b0608d586fdf4ba4b2b7f7137d49389a. Resources: {'ram', 'cores', 'instances'} {{(pid=98179) _get_quotas /opt/stack/nova/nova/quota.py:380}} Feb 17 04:29:56.592143 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-00fb6f6f-a145-46ac-a9c4-fa7fac40164a tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Going to run 1 instances... {{(pid=98179) _provision_instances /opt/stack/nova/nova/compute/api.py:1264}} Feb 17 04:29:56.595357 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-00fb6f6f-a145-46ac-a9c4-fa7fac40164a tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] [instance: 133aedc5-dbda-4b17-93fa-1a41c505a3f5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b005ed36-a85a-4c46-ba22-9fa8c5ec62e5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98179) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1666}} Feb 17 04:29:56.703348 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-00fb6f6f-a145-46ac-a9c4-fa7fac40164a tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.833061 Feb 17 04:29:56.704843 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 136/244] 10.222.0.78 () {60 vars in 1137 bytes} [Wed Feb 17 04:29:54 2021] POST /compute/v2.1/servers => generated 380 bytes in 1835 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Feb 17 04:29:56.720668 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-0f9301c3-fcf6-401c-ae87-3254e0fa35bc tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:29:56.722127 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-0f9301c3-fcf6-401c-ae87-3254e0fa35bc tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] [instance: 133aedc5-dbda-4b17-93fa-1a41c505a3f5] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:29:56.861595 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-0f9301c3-fcf6-401c-ae87-3254e0fa35bc tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88eaaf0dd96340229d9f519b3489cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0608d586fdf4ba4b2b7f7137d49389a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:29:56.876330 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-0f9301c3-fcf6-401c-ae87-3254e0fa35bc tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] 10.222.0.78 "GET /compute/v2.1/servers/133aedc5-dbda-4b17-93fa-1a41c505a3f5" status: 200 len: 1214 microversion: 2.1 time: 0.163890 Feb 17 04:29:56.877244 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 137/245] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:29:56 2021] GET /compute/v2.1/servers/133aedc5-dbda-4b17-93fa-1a41c505a3f5 => generated 1214 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:29:56.966878 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-ba29d2bd-183e-48d5-83d0-69a8249accb4 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:29:56.968795 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-ba29d2bd-183e-48d5-83d0-69a8249accb4 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] [instance: 8b4ba536-4de5-4f0e-9cb0-cc08d8616e5d] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:29:56.993658 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-ba29d2bd-183e-48d5-83d0-69a8249accb4 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:56.996294 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-ba29d2bd-183e-48d5-83d0-69a8249accb4 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:56.997431 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-ba29d2bd-183e-48d5-83d0-69a8249accb4 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:56.999741 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-ba29d2bd-183e-48d5-83d0-69a8249accb4 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:57.602620 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-1baf6c88-9c41-4ebb-9f7b-eece0e838a05 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1daf9a83b1d24033a3d4c0f531a4eb2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5336afdcf4aa4b46b0655432b7a1323c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:29:57.613527 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-1baf6c88-9c41-4ebb-9f7b-eece0e838a05 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] 10.222.0.78 "GET /compute/v2.1/servers/2fe5b190-5679-4b9d-8d5f-fac1a1c407d9" status: 200 len: 1520 microversion: 2.1 time: 1.130836 Feb 17 04:29:57.629257 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 109/246] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:29:56 2021] GET /compute/v2.1/servers/2fe5b190-5679-4b9d-8d5f-fac1a1c407d9 => generated 1520 bytes in 1147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:29:57.634815 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-6dda0a73-dcda-4796-bf57-6f8e98be4d70 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:29:57.640312 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-6dda0a73-dcda-4796-bf57-6f8e98be4d70 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: 29d1ce27-f63b-4523-88be-55f65a6a2529] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:29:57.655522 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-6dda0a73-dcda-4796-bf57-6f8e98be4d70 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:57.660050 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-6dda0a73-dcda-4796-bf57-6f8e98be4d70 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:57.661126 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-6dda0a73-dcda-4796-bf57-6f8e98be4d70 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:57.663710 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-6dda0a73-dcda-4796-bf57-6f8e98be4d70 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:57.957289 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-6dda0a73-dcda-4796-bf57-6f8e98be4d70 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "POST /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529/action" status: 200 len: 14 microversion: 2.1 time: 0.326342 Feb 17 04:29:57.958244 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 110/247] 10.222.0.78 () {60 vars in 1268 bytes} [Wed Feb 17 04:29:57 2021] POST /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529/action => generated 14 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 17 04:29:57.967984 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-7998cf2f-9d7a-4a04-9dea-45270a5636de tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:29:57.968762 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-7998cf2f-9d7a-4a04-9dea-45270a5636de tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] [instance: 555b8368-f196-4c6c-acf7-bc67d324c98a] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:29:57.991572 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-7998cf2f-9d7a-4a04-9dea-45270a5636de tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:57.992714 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-7998cf2f-9d7a-4a04-9dea-45270a5636de tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:57.997277 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-7998cf2f-9d7a-4a04-9dea-45270a5636de tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:57.997853 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-7998cf2f-9d7a-4a04-9dea-45270a5636de tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:58.004586 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-ba29d2bd-183e-48d5-83d0-69a8249accb4 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b4f65f82a97499dbb900d523924e946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440d4048a9ad43869a00218c7acb9614', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:29:58.019208 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-ba29d2bd-183e-48d5-83d0-69a8249accb4 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] 10.222.0.78 "GET /compute/v2.1/servers/8b4ba536-4de5-4f0e-9cb0-cc08d8616e5d" status: 200 len: 1319 microversion: 2.1 time: 1.056837 Feb 17 04:29:58.020586 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 138/248] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:29:56 2021] GET /compute/v2.1/servers/8b4ba536-4de5-4f0e-9cb0-cc08d8616e5d => generated 1319 bytes in 1060 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:29:58.026876 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-7f7fa151-f6ba-42a8-bf1a-c339f6d0f90e tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:29:58.028209 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-7f7fa151-f6ba-42a8-bf1a-c339f6d0f90e tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] [instance: fc3441c6-9dd2-4b3e-8aea-c1ea786a445e] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:29:58.039484 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-7f7fa151-f6ba-42a8-bf1a-c339f6d0f90e tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:58.039982 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-7f7fa151-f6ba-42a8-bf1a-c339f6d0f90e tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:58.041086 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-7f7fa151-f6ba-42a8-bf1a-c339f6d0f90e tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:58.041930 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-7f7fa151-f6ba-42a8-bf1a-c339f6d0f90e tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:58.109166 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.wsgi [None req-7f7fa151-f6ba-42a8-bf1a-c339f6d0f90e tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] HTTP exception thrown: Instance fc3441c6-9dd2-4b3e-8aea-c1ea786a445e could not be found. Feb 17 04:29:58.109849 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-7f7fa151-f6ba-42a8-bf1a-c339f6d0f90e tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] Returning 404 to user: Instance fc3441c6-9dd2-4b3e-8aea-c1ea786a445e could not be found. {{(pid=98179) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 17 04:29:58.110759 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-7f7fa151-f6ba-42a8-bf1a-c339f6d0f90e tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] 10.222.0.78 "DELETE /compute/v2.1/servers/fc3441c6-9dd2-4b3e-8aea-c1ea786a445e" status: 404 len: 111 microversion: 2.1 time: 0.088315 Feb 17 04:29:58.114716 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 139/249] 10.222.0.78 () {58 vars in 1229 bytes} [Wed Feb 17 04:29:58 2021] DELETE /compute/v2.1/servers/fc3441c6-9dd2-4b3e-8aea-c1ea786a445e => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 17 04:29:58.116984 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-15524495-8470-4b74-a5a0-aaad9503a941 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:29:58.117812 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-15524495-8470-4b74-a5a0-aaad9503a941 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] [instance: 133aedc5-dbda-4b17-93fa-1a41c505a3f5] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:29:58.128943 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-15524495-8470-4b74-a5a0-aaad9503a941 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:58.130169 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-15524495-8470-4b74-a5a0-aaad9503a941 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:58.131570 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-15524495-8470-4b74-a5a0-aaad9503a941 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:58.132281 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-15524495-8470-4b74-a5a0-aaad9503a941 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:58.309029 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-15524495-8470-4b74-a5a0-aaad9503a941 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88eaaf0dd96340229d9f519b3489cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0608d586fdf4ba4b2b7f7137d49389a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:29:58.321037 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-15524495-8470-4b74-a5a0-aaad9503a941 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] 10.222.0.78 "GET /compute/v2.1/servers/133aedc5-dbda-4b17-93fa-1a41c505a3f5" status: 200 len: 1266 microversion: 2.1 time: 0.206667 Feb 17 04:29:58.321904 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 140/250] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:29:58 2021] GET /compute/v2.1/servers/133aedc5-dbda-4b17-93fa-1a41c505a3f5 => generated 1266 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:29:58.340748 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [req-494b7e8d-70ef-412a-b743-d15a01247382 req-6a9b2588-225e-40db-b9db-320d51bb8470 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "29d1ce27-f63b-4523-88be-55f65a6a2529", "tag": "55e2629a-f0a2-41a8-b1d3-df6b83ba5111"}]} {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:29:58.345340 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:29:58.345340 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: warnings.warn(msg) Feb 17 04:29:58.373751 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [req-494b7e8d-70ef-412a-b743-d15a01247382 req-6a9b2588-225e-40db-b9db-320d51bb8470 service nova] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:58.374401 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [req-494b7e8d-70ef-412a-b743-d15a01247382 req-6a9b2588-225e-40db-b9db-320d51bb8470 service nova] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:58.398978 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.compute.server_external_events [req-494b7e8d-70ef-412a-b743-d15a01247382 req-6a9b2588-225e-40db-b9db-320d51bb8470 service nova] Creating event network-changed:55e2629a-f0a2-41a8-b1d3-df6b83ba5111 for instance 29d1ce27-f63b-4523-88be-55f65a6a2529 on hv-cinder-75998 Feb 17 04:29:58.411752 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [req-494b7e8d-70ef-412a-b743-d15a01247382 req-6a9b2588-225e-40db-b9db-320d51bb8470 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077119 Feb 17 04:29:58.412582 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 141/251] 10.222.0.78 () {64 vars in 1308 bytes} [Wed Feb 17 04:29:58 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:29:58.418627 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-f6d86019-10ab-4406-825e-398945295eea tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:29:58.419437 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-f6d86019-10ab-4406-825e-398945295eea tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] [instance: fc3441c6-9dd2-4b3e-8aea-c1ea786a445e] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:29:58.427642 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-f6d86019-10ab-4406-825e-398945295eea tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:58.428205 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-f6d86019-10ab-4406-825e-398945295eea tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:58.428992 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-f6d86019-10ab-4406-825e-398945295eea tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:58.430033 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-f6d86019-10ab-4406-825e-398945295eea tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:58.456276 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-7998cf2f-9d7a-4a04-9dea-45270a5636de tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d68d4a6c12e4331b8df8191cdd7a669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2a1ca6347d4278899a1cc009d87d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:29:58.468022 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-7998cf2f-9d7a-4a04-9dea-45270a5636de tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] 10.222.0.78 "GET /compute/v2.1/servers/555b8368-f196-4c6c-acf7-bc67d324c98a" status: 200 len: 1317 microversion: 2.1 time: 0.504207 Feb 17 04:29:58.471087 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 111/252] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:29:57 2021] GET /compute/v2.1/servers/555b8368-f196-4c6c-acf7-bc67d324c98a => generated 1317 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:29:58.486044 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.wsgi [None req-f6d86019-10ab-4406-825e-398945295eea tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] HTTP exception thrown: Instance fc3441c6-9dd2-4b3e-8aea-c1ea786a445e could not be found. Feb 17 04:29:58.486723 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-f6d86019-10ab-4406-825e-398945295eea tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] Returning 404 to user: Instance fc3441c6-9dd2-4b3e-8aea-c1ea786a445e could not be found. {{(pid=98179) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 17 04:29:58.487926 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-f6d86019-10ab-4406-825e-398945295eea tempest-DeleteServersTestJSON-1548007793 tempest-DeleteServersTestJSON-1548007793-project] 10.222.0.78 "GET /compute/v2.1/servers/fc3441c6-9dd2-4b3e-8aea-c1ea786a445e" status: 404 len: 111 microversion: 2.1 time: 0.074000 Feb 17 04:29:58.488558 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 142/253] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:29:58 2021] GET /compute/v2.1/servers/fc3441c6-9dd2-4b3e-8aea-c1ea786a445e => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 17 04:29:58.638767 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-afe7f769-f582-4fb3-aa81-acb33e1710f0 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:29:58.639886 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-afe7f769-f582-4fb3-aa81-acb33e1710f0 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] [instance: 2fe5b190-5679-4b9d-8d5f-fac1a1c407d9] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:29:58.654818 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-afe7f769-f582-4fb3-aa81-acb33e1710f0 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:58.656533 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-afe7f769-f582-4fb3-aa81-acb33e1710f0 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:58.657621 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-afe7f769-f582-4fb3-aa81-acb33e1710f0 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:58.658440 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-afe7f769-f582-4fb3-aa81-acb33e1710f0 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:58.970083 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-52370652-a710-4f69-ad82-79265461e17a tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:29:58.972323 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-52370652-a710-4f69-ad82-79265461e17a tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: 29d1ce27-f63b-4523-88be-55f65a6a2529] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:29:58.996754 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-52370652-a710-4f69-ad82-79265461e17a tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:58.997157 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-52370652-a710-4f69-ad82-79265461e17a tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:58.998189 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-52370652-a710-4f69-ad82-79265461e17a tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:58.998849 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-52370652-a710-4f69-ad82-79265461e17a tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:59.126076 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-afe7f769-f582-4fb3-aa81-acb33e1710f0 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1daf9a83b1d24033a3d4c0f531a4eb2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5336afdcf4aa4b46b0655432b7a1323c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:29:59.154729 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-afe7f769-f582-4fb3-aa81-acb33e1710f0 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] 10.222.0.78 "GET /compute/v2.1/servers/2fe5b190-5679-4b9d-8d5f-fac1a1c407d9" status: 200 len: 1520 microversion: 2.1 time: 0.521924 Feb 17 04:29:59.157760 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 112/254] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:29:58 2021] GET /compute/v2.1/servers/2fe5b190-5679-4b9d-8d5f-fac1a1c407d9 => generated 1520 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:29:59.174664 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-56ae1e6c-ae13-4c19-99b1-2c8fb9cdf9ec tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:29:59.175385 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-56ae1e6c-ae13-4c19-99b1-2c8fb9cdf9ec tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] [instance: 8b4ba536-4de5-4f0e-9cb0-cc08d8616e5d] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:29:59.191630 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-56ae1e6c-ae13-4c19-99b1-2c8fb9cdf9ec tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:59.192147 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-56ae1e6c-ae13-4c19-99b1-2c8fb9cdf9ec tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:59.193014 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-56ae1e6c-ae13-4c19-99b1-2c8fb9cdf9ec tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:59.193515 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-56ae1e6c-ae13-4c19-99b1-2c8fb9cdf9ec tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:59.659978 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-56ae1e6c-ae13-4c19-99b1-2c8fb9cdf9ec tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b4f65f82a97499dbb900d523924e946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440d4048a9ad43869a00218c7acb9614', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:29:59.673777 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-56ae1e6c-ae13-4c19-99b1-2c8fb9cdf9ec tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] 10.222.0.78 "GET /compute/v2.1/servers/8b4ba536-4de5-4f0e-9cb0-cc08d8616e5d" status: 200 len: 1319 microversion: 2.1 time: 0.514630 Feb 17 04:29:59.674736 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 113/255] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:29:59 2021] GET /compute/v2.1/servers/8b4ba536-4de5-4f0e-9cb0-cc08d8616e5d => generated 1319 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:29:59.688755 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-a52ed4a1-f97c-4994-bacd-c2a032eea621 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:29:59.689742 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-a52ed4a1-f97c-4994-bacd-c2a032eea621 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] [instance: 133aedc5-dbda-4b17-93fa-1a41c505a3f5] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:29:59.700255 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-a52ed4a1-f97c-4994-bacd-c2a032eea621 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:59.700255 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-a52ed4a1-f97c-4994-bacd-c2a032eea621 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:59.706928 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-a52ed4a1-f97c-4994-bacd-c2a032eea621 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:59.707493 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-a52ed4a1-f97c-4994-bacd-c2a032eea621 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:59.906648 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-a52ed4a1-f97c-4994-bacd-c2a032eea621 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88eaaf0dd96340229d9f519b3489cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0608d586fdf4ba4b2b7f7137d49389a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:29:59.916954 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-a52ed4a1-f97c-4994-bacd-c2a032eea621 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] 10.222.0.78 "GET /compute/v2.1/servers/133aedc5-dbda-4b17-93fa-1a41c505a3f5" status: 200 len: 1266 microversion: 2.1 time: 0.240915 Feb 17 04:29:59.927212 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 114/256] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:29:59 2021] GET /compute/v2.1/servers/133aedc5-dbda-4b17-93fa-1a41c505a3f5 => generated 1266 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:29:59.927212 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-41de6f61-4b4d-469b-a3b2-4d5f8e464167 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:29:59.927212 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-41de6f61-4b4d-469b-a3b2-4d5f8e464167 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] [instance: 555b8368-f196-4c6c-acf7-bc67d324c98a] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:29:59.931993 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-41de6f61-4b4d-469b-a3b2-4d5f8e464167 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:59.932511 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-41de6f61-4b4d-469b-a3b2-4d5f8e464167 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:29:59.933366 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-41de6f61-4b4d-469b-a3b2-4d5f8e464167 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:29:59.933869 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-41de6f61-4b4d-469b-a3b2-4d5f8e464167 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:00.552766 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-41de6f61-4b4d-469b-a3b2-4d5f8e464167 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d68d4a6c12e4331b8df8191cdd7a669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2a1ca6347d4278899a1cc009d87d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:30:00.562489 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-41de6f61-4b4d-469b-a3b2-4d5f8e464167 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] 10.222.0.78 "GET /compute/v2.1/servers/555b8368-f196-4c6c-acf7-bc67d324c98a" status: 200 len: 1317 microversion: 2.1 time: 0.643859 Feb 17 04:30:00.563219 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 115/257] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:29:59 2021] GET /compute/v2.1/servers/555b8368-f196-4c6c-acf7-bc67d324c98a => generated 1317 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:30:00.568109 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [req-16f1a255-8b71-4783-8957-3bd684d23c7b req-b0253eec-1dcf-41e3-a90a-49a2e84878be service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "555b8368-f196-4c6c-acf7-bc67d324c98a", "tag": "65a369ca-8446-46ba-9c26-57d2b73c304a"}]} {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:30:00.569883 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:30:00.569883 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: warnings.warn(msg) Feb 17 04:30:00.579148 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [req-16f1a255-8b71-4783-8957-3bd684d23c7b req-b0253eec-1dcf-41e3-a90a-49a2e84878be service nova] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:00.579652 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [req-16f1a255-8b71-4783-8957-3bd684d23c7b req-b0253eec-1dcf-41e3-a90a-49a2e84878be service nova] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:00.598296 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.compute.server_external_events [req-16f1a255-8b71-4783-8957-3bd684d23c7b req-b0253eec-1dcf-41e3-a90a-49a2e84878be service nova] Creating event network-changed:65a369ca-8446-46ba-9c26-57d2b73c304a for instance 555b8368-f196-4c6c-acf7-bc67d324c98a on hv-cinder-75998 Feb 17 04:30:00.603859 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [req-16f1a255-8b71-4783-8957-3bd684d23c7b req-b0253eec-1dcf-41e3-a90a-49a2e84878be service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039522 Feb 17 04:30:00.604508 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 116/258] 10.222.0.78 () {64 vars in 1308 bytes} [Wed Feb 17 04:30:00 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:30:00.609732 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-3745ecb4-0318-476c-9c46-6dc984ced1f2 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:30:00.610488 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-3745ecb4-0318-476c-9c46-6dc984ced1f2 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] [instance: 2fe5b190-5679-4b9d-8d5f-fac1a1c407d9] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:30:00.618874 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-3745ecb4-0318-476c-9c46-6dc984ced1f2 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:00.619428 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-3745ecb4-0318-476c-9c46-6dc984ced1f2 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:00.620266 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-3745ecb4-0318-476c-9c46-6dc984ced1f2 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:00.620738 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-3745ecb4-0318-476c-9c46-6dc984ced1f2 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:00.949473 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-3745ecb4-0318-476c-9c46-6dc984ced1f2 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1daf9a83b1d24033a3d4c0f531a4eb2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5336afdcf4aa4b46b0655432b7a1323c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:30:00.958608 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-3745ecb4-0318-476c-9c46-6dc984ced1f2 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] 10.222.0.78 "GET /compute/v2.1/servers/2fe5b190-5679-4b9d-8d5f-fac1a1c407d9" status: 200 len: 1520 microversion: 2.1 time: 0.352905 Feb 17 04:30:00.959240 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 117/259] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:30:00 2021] GET /compute/v2.1/servers/2fe5b190-5679-4b9d-8d5f-fac1a1c407d9 => generated 1520 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:30:00.966289 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-33ad7b60-3df5-4bce-bba3-2c00e5b0856a tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:30:00.967296 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-33ad7b60-3df5-4bce-bba3-2c00e5b0856a tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] [instance: 8b4ba536-4de5-4f0e-9cb0-cc08d8616e5d] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:30:00.977713 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-33ad7b60-3df5-4bce-bba3-2c00e5b0856a tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:00.978504 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-33ad7b60-3df5-4bce-bba3-2c00e5b0856a tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:00.979524 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-33ad7b60-3df5-4bce-bba3-2c00e5b0856a tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:00.980135 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-33ad7b60-3df5-4bce-bba3-2c00e5b0856a tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:01.216707 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-33ad7b60-3df5-4bce-bba3-2c00e5b0856a tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b4f65f82a97499dbb900d523924e946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440d4048a9ad43869a00218c7acb9614', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:30:01.230241 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-33ad7b60-3df5-4bce-bba3-2c00e5b0856a tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] 10.222.0.78 "GET /compute/v2.1/servers/8b4ba536-4de5-4f0e-9cb0-cc08d8616e5d" status: 200 len: 1319 microversion: 2.1 time: 0.269475 Feb 17 04:30:01.231064 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 118/260] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:30:00 2021] GET /compute/v2.1/servers/8b4ba536-4de5-4f0e-9cb0-cc08d8616e5d => generated 1319 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:30:01.235780 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-ab145931-aa9b-4b32-b8cf-052b18bb040e tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:30:01.236639 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-ab145931-aa9b-4b32-b8cf-052b18bb040e tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] [instance: 133aedc5-dbda-4b17-93fa-1a41c505a3f5] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:30:01.245749 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-ab145931-aa9b-4b32-b8cf-052b18bb040e tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:01.246351 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-ab145931-aa9b-4b32-b8cf-052b18bb040e tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:01.247347 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-ab145931-aa9b-4b32-b8cf-052b18bb040e tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:01.247922 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-ab145931-aa9b-4b32-b8cf-052b18bb040e tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:01.390992 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-ab145931-aa9b-4b32-b8cf-052b18bb040e tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88eaaf0dd96340229d9f519b3489cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0608d586fdf4ba4b2b7f7137d49389a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:30:01.401510 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-ab145931-aa9b-4b32-b8cf-052b18bb040e tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] 10.222.0.78 "GET /compute/v2.1/servers/133aedc5-dbda-4b17-93fa-1a41c505a3f5" status: 200 len: 1274 microversion: 2.1 time: 0.169318 Feb 17 04:30:01.402301 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 119/261] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:30:01 2021] GET /compute/v2.1/servers/133aedc5-dbda-4b17-93fa-1a41c505a3f5 => generated 1274 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:30:01.581930 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-7ddb50e6-da63-49ff-83f6-f72c488a9367 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:30:01.582882 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-7ddb50e6-da63-49ff-83f6-f72c488a9367 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] [instance: 555b8368-f196-4c6c-acf7-bc67d324c98a] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:30:01.591681 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-7ddb50e6-da63-49ff-83f6-f72c488a9367 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:01.592196 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-7ddb50e6-da63-49ff-83f6-f72c488a9367 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:01.593050 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-7ddb50e6-da63-49ff-83f6-f72c488a9367 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:01.593551 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-7ddb50e6-da63-49ff-83f6-f72c488a9367 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:01.861006 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-7ddb50e6-da63-49ff-83f6-f72c488a9367 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d68d4a6c12e4331b8df8191cdd7a669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2a1ca6347d4278899a1cc009d87d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:30:01.870746 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-7ddb50e6-da63-49ff-83f6-f72c488a9367 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] 10.222.0.78 "GET /compute/v2.1/servers/555b8368-f196-4c6c-acf7-bc67d324c98a" status: 200 len: 1317 microversion: 2.1 time: 0.293636 Feb 17 04:30:01.871832 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 120/262] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:30:01 2021] GET /compute/v2.1/servers/555b8368-f196-4c6c-acf7-bc67d324c98a => generated 1317 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:30:01.978992 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-c4ca5ed5-8c42-48e5-84bb-0052fce7cd30 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:30:01.979695 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-c4ca5ed5-8c42-48e5-84bb-0052fce7cd30 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] [instance: 2fe5b190-5679-4b9d-8d5f-fac1a1c407d9] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:30:01.988075 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-c4ca5ed5-8c42-48e5-84bb-0052fce7cd30 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:01.988607 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-c4ca5ed5-8c42-48e5-84bb-0052fce7cd30 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:01.989520 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-c4ca5ed5-8c42-48e5-84bb-0052fce7cd30 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:01.989813 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-c4ca5ed5-8c42-48e5-84bb-0052fce7cd30 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:02.265136 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-c4ca5ed5-8c42-48e5-84bb-0052fce7cd30 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1daf9a83b1d24033a3d4c0f531a4eb2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5336afdcf4aa4b46b0655432b7a1323c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:30:02.275110 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-c4ca5ed5-8c42-48e5-84bb-0052fce7cd30 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] 10.222.0.78 "GET /compute/v2.1/servers/2fe5b190-5679-4b9d-8d5f-fac1a1c407d9" status: 200 len: 1520 microversion: 2.1 time: 0.300912 Feb 17 04:30:02.275880 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 121/263] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:30:01 2021] GET /compute/v2.1/servers/2fe5b190-5679-4b9d-8d5f-fac1a1c407d9 => generated 1520 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:30:02.280542 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-92626db4-3fb9-4001-8d07-b11d70d5936b tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:30:02.281220 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-92626db4-3fb9-4001-8d07-b11d70d5936b tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] [instance: 8b4ba536-4de5-4f0e-9cb0-cc08d8616e5d] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:30:02.289005 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-92626db4-3fb9-4001-8d07-b11d70d5936b tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:02.289520 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-92626db4-3fb9-4001-8d07-b11d70d5936b tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:02.290373 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-92626db4-3fb9-4001-8d07-b11d70d5936b tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:02.290875 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-92626db4-3fb9-4001-8d07-b11d70d5936b tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:02.526490 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-92626db4-3fb9-4001-8d07-b11d70d5936b tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b4f65f82a97499dbb900d523924e946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440d4048a9ad43869a00218c7acb9614', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:30:02.536147 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-92626db4-3fb9-4001-8d07-b11d70d5936b tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] 10.222.0.78 "GET /compute/v2.1/servers/8b4ba536-4de5-4f0e-9cb0-cc08d8616e5d" status: 200 len: 1319 microversion: 2.1 time: 0.259203 Feb 17 04:30:02.536930 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 122/264] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:30:02 2021] GET /compute/v2.1/servers/8b4ba536-4de5-4f0e-9cb0-cc08d8616e5d => generated 1319 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:30:02.551948 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-a3d5d6b4-9877-4698-82fe-742b6ffba4fb tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:30:02.552640 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-a3d5d6b4-9877-4698-82fe-742b6ffba4fb tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] [instance: 133aedc5-dbda-4b17-93fa-1a41c505a3f5] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:30:02.564389 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-a3d5d6b4-9877-4698-82fe-742b6ffba4fb tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:02.565087 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-a3d5d6b4-9877-4698-82fe-742b6ffba4fb tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:02.565955 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-a3d5d6b4-9877-4698-82fe-742b6ffba4fb tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:02.566974 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-a3d5d6b4-9877-4698-82fe-742b6ffba4fb tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:02.702305 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-a3d5d6b4-9877-4698-82fe-742b6ffba4fb tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88eaaf0dd96340229d9f519b3489cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0608d586fdf4ba4b2b7f7137d49389a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:30:02.711393 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-a3d5d6b4-9877-4698-82fe-742b6ffba4fb tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] 10.222.0.78 "GET /compute/v2.1/servers/133aedc5-dbda-4b17-93fa-1a41c505a3f5" status: 200 len: 1274 microversion: 2.1 time: 0.164730 Feb 17 04:30:02.711986 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 123/265] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:30:02 2021] GET /compute/v2.1/servers/133aedc5-dbda-4b17-93fa-1a41c505a3f5 => generated 1274 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:30:02.892388 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-28aca754-aef2-4e3c-8324-cb702346260c tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:30:02.893433 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-28aca754-aef2-4e3c-8324-cb702346260c tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] [instance: 555b8368-f196-4c6c-acf7-bc67d324c98a] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:30:02.905071 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-28aca754-aef2-4e3c-8324-cb702346260c tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:02.907734 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-28aca754-aef2-4e3c-8324-cb702346260c tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:02.908901 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-28aca754-aef2-4e3c-8324-cb702346260c tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:02.909488 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-28aca754-aef2-4e3c-8324-cb702346260c tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:02.978631 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-52370652-a710-4f69-ad82-79265461e17a tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "POST /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529/action" status: 200 len: 14 microversion: 2.1 time: 4.012359 Feb 17 04:30:02.980028 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 143/266] 10.222.0.78 () {60 vars in 1268 bytes} [Wed Feb 17 04:29:58 2021] POST /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529/action => generated 14 bytes in 4015 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 17 04:30:03.294630 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-a3d7cdd7-7248-4aff-9cd6-053ba9c362d5 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:30:03.295591 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-a3d7cdd7-7248-4aff-9cd6-053ba9c362d5 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] [instance: 2fe5b190-5679-4b9d-8d5f-fac1a1c407d9] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:30:03.314082 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-a3d7cdd7-7248-4aff-9cd6-053ba9c362d5 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:03.314596 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-a3d7cdd7-7248-4aff-9cd6-053ba9c362d5 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:03.315523 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-a3d7cdd7-7248-4aff-9cd6-053ba9c362d5 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:03.316028 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-a3d7cdd7-7248-4aff-9cd6-053ba9c362d5 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:04.029800 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-a3d7cdd7-7248-4aff-9cd6-053ba9c362d5 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1daf9a83b1d24033a3d4c0f531a4eb2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5336afdcf4aa4b46b0655432b7a1323c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:30:04.042887 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-a3d7cdd7-7248-4aff-9cd6-053ba9c362d5 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] 10.222.0.78 "GET /compute/v2.1/servers/2fe5b190-5679-4b9d-8d5f-fac1a1c407d9" status: 200 len: 1520 microversion: 2.1 time: 0.752680 Feb 17 04:30:04.043541 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 144/267] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:30:03 2021] GET /compute/v2.1/servers/2fe5b190-5679-4b9d-8d5f-fac1a1c407d9 => generated 1520 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:30:04.050756 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-3e8aa05c-06e4-41f7-b2a7-87e43ec495df tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:30:04.051439 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-3e8aa05c-06e4-41f7-b2a7-87e43ec495df tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] [instance: 8b4ba536-4de5-4f0e-9cb0-cc08d8616e5d] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:30:04.059714 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-3e8aa05c-06e4-41f7-b2a7-87e43ec495df tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:04.060215 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-3e8aa05c-06e4-41f7-b2a7-87e43ec495df tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:04.061053 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-3e8aa05c-06e4-41f7-b2a7-87e43ec495df tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:04.061538 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-3e8aa05c-06e4-41f7-b2a7-87e43ec495df tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:04.288031 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-28aca754-aef2-4e3c-8324-cb702346260c tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d68d4a6c12e4331b8df8191cdd7a669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2a1ca6347d4278899a1cc009d87d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:30:04.297993 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-28aca754-aef2-4e3c-8324-cb702346260c tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] 10.222.0.78 "GET /compute/v2.1/servers/555b8368-f196-4c6c-acf7-bc67d324c98a" status: 200 len: 1317 microversion: 2.1 time: 1.411187 Feb 17 04:30:04.300823 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-3e8aa05c-06e4-41f7-b2a7-87e43ec495df tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b4f65f82a97499dbb900d523924e946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440d4048a9ad43869a00218c7acb9614', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:30:04.309165 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 124/268] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:30:02 2021] GET /compute/v2.1/servers/555b8368-f196-4c6c-acf7-bc67d324c98a => generated 1317 bytes in 1423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:30:04.310469 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-3e8aa05c-06e4-41f7-b2a7-87e43ec495df tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] 10.222.0.78 "GET /compute/v2.1/servers/8b4ba536-4de5-4f0e-9cb0-cc08d8616e5d" status: 200 len: 1319 microversion: 2.1 time: 0.263256 Feb 17 04:30:04.311079 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 145/269] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:30:04 2021] GET /compute/v2.1/servers/8b4ba536-4de5-4f0e-9cb0-cc08d8616e5d => generated 1319 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:30:04.314887 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-434580cd-3648-47c6-9d58-09441d018ce0 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:30:04.315670 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-434580cd-3648-47c6-9d58-09441d018ce0 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] [instance: 133aedc5-dbda-4b17-93fa-1a41c505a3f5] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:30:04.324012 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-434580cd-3648-47c6-9d58-09441d018ce0 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:04.324889 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-434580cd-3648-47c6-9d58-09441d018ce0 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:04.325003 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-97b601e9-fcf1-44cd-83eb-695984bfd5ef tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:30:04.326101 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-434580cd-3648-47c6-9d58-09441d018ce0 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:04.326213 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-97b601e9-fcf1-44cd-83eb-695984bfd5ef tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: 29d1ce27-f63b-4523-88be-55f65a6a2529] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:30:04.326891 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-434580cd-3648-47c6-9d58-09441d018ce0 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:04.338233 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-97b601e9-fcf1-44cd-83eb-695984bfd5ef tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:04.339530 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-97b601e9-fcf1-44cd-83eb-695984bfd5ef tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:04.340406 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-97b601e9-fcf1-44cd-83eb-695984bfd5ef tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:04.340914 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-97b601e9-fcf1-44cd-83eb-695984bfd5ef tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:04.582983 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-434580cd-3648-47c6-9d58-09441d018ce0 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88eaaf0dd96340229d9f519b3489cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0608d586fdf4ba4b2b7f7137d49389a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:30:04.596213 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-434580cd-3648-47c6-9d58-09441d018ce0 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] 10.222.0.78 "GET /compute/v2.1/servers/133aedc5-dbda-4b17-93fa-1a41c505a3f5" status: 200 len: 1272 microversion: 2.1 time: 0.284996 Feb 17 04:30:04.597079 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 125/270] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:30:04 2021] GET /compute/v2.1/servers/133aedc5-dbda-4b17-93fa-1a41c505a3f5 => generated 1272 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:30:05.061002 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-8b92a5ac-1b01-4eff-96fc-a95cbc6c1f5f tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:30:05.062776 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-8b92a5ac-1b01-4eff-96fc-a95cbc6c1f5f tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] [instance: 2fe5b190-5679-4b9d-8d5f-fac1a1c407d9] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:30:05.077313 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-8b92a5ac-1b01-4eff-96fc-a95cbc6c1f5f tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:05.079485 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-8b92a5ac-1b01-4eff-96fc-a95cbc6c1f5f tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:05.080575 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-8b92a5ac-1b01-4eff-96fc-a95cbc6c1f5f tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:05.081137 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-8b92a5ac-1b01-4eff-96fc-a95cbc6c1f5f tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:05.123953 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-97b601e9-fcf1-44cd-83eb-695984bfd5ef tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "POST /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529/action" status: 200 len: 14 microversion: 2.1 time: 0.811321 Feb 17 04:30:05.127627 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 146/271] 10.222.0.78 () {60 vars in 1268 bytes} [Wed Feb 17 04:30:04 2021] POST /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529/action => generated 14 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 17 04:30:05.321445 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-e40d203e-7a22-4888-8307-f95082c3e610 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:30:05.322418 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-e40d203e-7a22-4888-8307-f95082c3e610 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] [instance: 555b8368-f196-4c6c-acf7-bc67d324c98a] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:30:05.332897 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-e40d203e-7a22-4888-8307-f95082c3e610 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:05.333691 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-e40d203e-7a22-4888-8307-f95082c3e610 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:05.334940 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-e40d203e-7a22-4888-8307-f95082c3e610 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:05.336449 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-e40d203e-7a22-4888-8307-f95082c3e610 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:05.498948 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-8b92a5ac-1b01-4eff-96fc-a95cbc6c1f5f tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1daf9a83b1d24033a3d4c0f531a4eb2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5336afdcf4aa4b46b0655432b7a1323c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:30:05.511908 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-8b92a5ac-1b01-4eff-96fc-a95cbc6c1f5f tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] 10.222.0.78 "GET /compute/v2.1/servers/2fe5b190-5679-4b9d-8d5f-fac1a1c407d9" status: 200 len: 1520 microversion: 2.1 time: 0.454982 Feb 17 04:30:05.513885 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 126/272] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:30:05 2021] GET /compute/v2.1/servers/2fe5b190-5679-4b9d-8d5f-fac1a1c407d9 => generated 1520 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:30:05.519220 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-b5a21e92-b92d-499d-a32b-70fe5342b6e1 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:30:05.520453 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-b5a21e92-b92d-499d-a32b-70fe5342b6e1 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] [instance: 8b4ba536-4de5-4f0e-9cb0-cc08d8616e5d] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:30:05.531612 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-b5a21e92-b92d-499d-a32b-70fe5342b6e1 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:05.532437 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-b5a21e92-b92d-499d-a32b-70fe5342b6e1 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:05.533796 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-b5a21e92-b92d-499d-a32b-70fe5342b6e1 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:05.534487 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-b5a21e92-b92d-499d-a32b-70fe5342b6e1 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:05.658149 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-e40d203e-7a22-4888-8307-f95082c3e610 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d68d4a6c12e4331b8df8191cdd7a669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2a1ca6347d4278899a1cc009d87d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:30:05.669565 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-e40d203e-7a22-4888-8307-f95082c3e610 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] 10.222.0.78 "GET /compute/v2.1/servers/555b8368-f196-4c6c-acf7-bc67d324c98a" status: 200 len: 1317 microversion: 2.1 time: 0.356344 Feb 17 04:30:05.671388 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 147/273] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:30:05 2021] GET /compute/v2.1/servers/555b8368-f196-4c6c-acf7-bc67d324c98a => generated 1317 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:30:05.676449 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-af980e42-bce4-4e93-87b9-9033e7d60735 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:30:05.677287 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-af980e42-bce4-4e93-87b9-9033e7d60735 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] [instance: 133aedc5-dbda-4b17-93fa-1a41c505a3f5] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:30:05.686594 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-af980e42-bce4-4e93-87b9-9033e7d60735 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:05.687353 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-af980e42-bce4-4e93-87b9-9033e7d60735 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:05.688361 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-af980e42-bce4-4e93-87b9-9033e7d60735 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:05.689172 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-af980e42-bce4-4e93-87b9-9033e7d60735 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:05.976832 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-af980e42-bce4-4e93-87b9-9033e7d60735 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88eaaf0dd96340229d9f519b3489cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0608d586fdf4ba4b2b7f7137d49389a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:30:05.986644 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-af980e42-bce4-4e93-87b9-9033e7d60735 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] 10.222.0.78 "GET /compute/v2.1/servers/133aedc5-dbda-4b17-93fa-1a41c505a3f5" status: 200 len: 1314 microversion: 2.1 time: 0.313881 Feb 17 04:30:05.987545 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 148/274] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:30:05 2021] GET /compute/v2.1/servers/133aedc5-dbda-4b17-93fa-1a41c505a3f5 => generated 1314 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:30:06.148717 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-376cfc45-a68e-4450-b8bc-7e9e8c9e2192 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:30:06.158137 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-376cfc45-a68e-4450-b8bc-7e9e8c9e2192 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: 29d1ce27-f63b-4523-88be-55f65a6a2529] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:30:06.190351 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-376cfc45-a68e-4450-b8bc-7e9e8c9e2192 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:06.190859 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-376cfc45-a68e-4450-b8bc-7e9e8c9e2192 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:06.191763 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-376cfc45-a68e-4450-b8bc-7e9e8c9e2192 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:06.192264 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-376cfc45-a68e-4450-b8bc-7e9e8c9e2192 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:06.222960 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-b5a21e92-b92d-499d-a32b-70fe5342b6e1 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b4f65f82a97499dbb900d523924e946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440d4048a9ad43869a00218c7acb9614', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:30:06.234069 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-b5a21e92-b92d-499d-a32b-70fe5342b6e1 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] 10.222.0.78 "GET /compute/v2.1/servers/8b4ba536-4de5-4f0e-9cb0-cc08d8616e5d" status: 200 len: 1319 microversion: 2.1 time: 0.718855 Feb 17 04:30:06.243768 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 127/275] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:30:05 2021] GET /compute/v2.1/servers/8b4ba536-4de5-4f0e-9cb0-cc08d8616e5d => generated 1319 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:30:06.531750 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-bf2ca8ef-7513-4ebb-8e66-45042ae3fa62 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:30:06.532444 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-bf2ca8ef-7513-4ebb-8e66-45042ae3fa62 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] [instance: 2fe5b190-5679-4b9d-8d5f-fac1a1c407d9] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:30:06.540795 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-bf2ca8ef-7513-4ebb-8e66-45042ae3fa62 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:06.541302 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-bf2ca8ef-7513-4ebb-8e66-45042ae3fa62 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:06.542146 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-bf2ca8ef-7513-4ebb-8e66-45042ae3fa62 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:06.542639 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-bf2ca8ef-7513-4ebb-8e66-45042ae3fa62 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:06.759126 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-bf2ca8ef-7513-4ebb-8e66-45042ae3fa62 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1daf9a83b1d24033a3d4c0f531a4eb2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5336afdcf4aa4b46b0655432b7a1323c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:30:06.767883 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-bf2ca8ef-7513-4ebb-8e66-45042ae3fa62 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] 10.222.0.78 "GET /compute/v2.1/servers/2fe5b190-5679-4b9d-8d5f-fac1a1c407d9" status: 200 len: 1520 microversion: 2.1 time: 0.240100 Feb 17 04:30:06.768488 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 128/276] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:30:06 2021] GET /compute/v2.1/servers/2fe5b190-5679-4b9d-8d5f-fac1a1c407d9 => generated 1520 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:30:06.773460 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-d6918a62-6232-4eea-8fa7-869dc1325216 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:30:06.773887 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-d6918a62-6232-4eea-8fa7-869dc1325216 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] [instance: 555b8368-f196-4c6c-acf7-bc67d324c98a] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:30:06.781228 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-d6918a62-6232-4eea-8fa7-869dc1325216 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:06.781737 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-d6918a62-6232-4eea-8fa7-869dc1325216 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:06.782575 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-d6918a62-6232-4eea-8fa7-869dc1325216 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:06.783109 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-d6918a62-6232-4eea-8fa7-869dc1325216 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:06.997701 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-d6918a62-6232-4eea-8fa7-869dc1325216 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d68d4a6c12e4331b8df8191cdd7a669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2a1ca6347d4278899a1cc009d87d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:30:07.008383 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-d6918a62-6232-4eea-8fa7-869dc1325216 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] 10.222.0.78 "GET /compute/v2.1/servers/555b8368-f196-4c6c-acf7-bc67d324c98a" status: 200 len: 1317 microversion: 2.1 time: 0.238703 Feb 17 04:30:07.009026 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 129/277] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:30:06 2021] GET /compute/v2.1/servers/555b8368-f196-4c6c-acf7-bc67d324c98a => generated 1317 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:30:07.014034 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-b177137d-cc29-4a39-9e5b-f9e4e03a8f93 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:30:07.014705 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-b177137d-cc29-4a39-9e5b-f9e4e03a8f93 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] [instance: 133aedc5-dbda-4b17-93fa-1a41c505a3f5] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:30:07.022627 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-b177137d-cc29-4a39-9e5b-f9e4e03a8f93 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:07.023828 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-b177137d-cc29-4a39-9e5b-f9e4e03a8f93 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:07.024671 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-b177137d-cc29-4a39-9e5b-f9e4e03a8f93 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:07.025166 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-b177137d-cc29-4a39-9e5b-f9e4e03a8f93 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:07.259376 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-b177137d-cc29-4a39-9e5b-f9e4e03a8f93 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88eaaf0dd96340229d9f519b3489cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0608d586fdf4ba4b2b7f7137d49389a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:30:07.268317 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-b177137d-cc29-4a39-9e5b-f9e4e03a8f93 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] 10.222.0.78 "GET /compute/v2.1/servers/133aedc5-dbda-4b17-93fa-1a41c505a3f5" status: 200 len: 1314 microversion: 2.1 time: 0.258255 Feb 17 04:30:07.268974 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 130/278] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:30:07 2021] GET /compute/v2.1/servers/133aedc5-dbda-4b17-93fa-1a41c505a3f5 => generated 1314 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:30:07.274383 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-57c54a2e-af30-4166-ac47-bc348015469a tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:30:07.275063 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-57c54a2e-af30-4166-ac47-bc348015469a tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] [instance: 8b4ba536-4de5-4f0e-9cb0-cc08d8616e5d] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:30:07.282506 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-57c54a2e-af30-4166-ac47-bc348015469a tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:07.283024 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-57c54a2e-af30-4166-ac47-bc348015469a tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:07.283905 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-57c54a2e-af30-4166-ac47-bc348015469a tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:07.284407 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-57c54a2e-af30-4166-ac47-bc348015469a tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:07.496203 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-57c54a2e-af30-4166-ac47-bc348015469a tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b4f65f82a97499dbb900d523924e946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440d4048a9ad43869a00218c7acb9614', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:30:07.504868 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-57c54a2e-af30-4166-ac47-bc348015469a tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] 10.222.0.78 "GET /compute/v2.1/servers/8b4ba536-4de5-4f0e-9cb0-cc08d8616e5d" status: 200 len: 1319 microversion: 2.1 time: 0.234880 Feb 17 04:30:07.505463 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 131/279] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:30:07 2021] GET /compute/v2.1/servers/8b4ba536-4de5-4f0e-9cb0-cc08d8616e5d => generated 1319 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:30:07.785826 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-6c38cb5c-cc01-4774-ae72-db0343d62435 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:30:07.786501 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-6c38cb5c-cc01-4774-ae72-db0343d62435 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] [instance: 2fe5b190-5679-4b9d-8d5f-fac1a1c407d9] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:30:07.795539 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-6c38cb5c-cc01-4774-ae72-db0343d62435 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:07.796050 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-6c38cb5c-cc01-4774-ae72-db0343d62435 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:07.796892 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-6c38cb5c-cc01-4774-ae72-db0343d62435 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:07.797386 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-6c38cb5c-cc01-4774-ae72-db0343d62435 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:08.014649 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-6c38cb5c-cc01-4774-ae72-db0343d62435 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1daf9a83b1d24033a3d4c0f531a4eb2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5336afdcf4aa4b46b0655432b7a1323c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:30:08.024570 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-6c38cb5c-cc01-4774-ae72-db0343d62435 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] 10.222.0.78 "GET /compute/v2.1/servers/2fe5b190-5679-4b9d-8d5f-fac1a1c407d9" status: 200 len: 1520 microversion: 2.1 time: 0.242737 Feb 17 04:30:08.025172 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 132/280] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:30:07 2021] GET /compute/v2.1/servers/2fe5b190-5679-4b9d-8d5f-fac1a1c407d9 => generated 1520 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:30:08.029759 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-b7c959d4-239b-4dc3-bf3f-c2b1901d1c7a tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:30:08.030419 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-b7c959d4-239b-4dc3-bf3f-c2b1901d1c7a tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] [instance: 555b8368-f196-4c6c-acf7-bc67d324c98a] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:30:08.037892 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-b7c959d4-239b-4dc3-bf3f-c2b1901d1c7a tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:08.038369 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-b7c959d4-239b-4dc3-bf3f-c2b1901d1c7a tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:08.040013 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-b7c959d4-239b-4dc3-bf3f-c2b1901d1c7a tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:08.040631 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-b7c959d4-239b-4dc3-bf3f-c2b1901d1c7a tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:08.260815 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-b7c959d4-239b-4dc3-bf3f-c2b1901d1c7a tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d68d4a6c12e4331b8df8191cdd7a669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2a1ca6347d4278899a1cc009d87d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:30:08.269594 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-b7c959d4-239b-4dc3-bf3f-c2b1901d1c7a tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] 10.222.0.78 "GET /compute/v2.1/servers/555b8368-f196-4c6c-acf7-bc67d324c98a" status: 200 len: 1317 microversion: 2.1 time: 0.243398 Feb 17 04:30:08.270234 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 133/281] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:30:08 2021] GET /compute/v2.1/servers/555b8368-f196-4c6c-acf7-bc67d324c98a => generated 1317 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:30:08.285624 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-b3abc157-5dce-4721-b049-3e21c4f4762c tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:30:08.286300 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-b3abc157-5dce-4721-b049-3e21c4f4762c tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] [instance: 133aedc5-dbda-4b17-93fa-1a41c505a3f5] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:30:08.294746 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-b3abc157-5dce-4721-b049-3e21c4f4762c tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:08.295232 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-b3abc157-5dce-4721-b049-3e21c4f4762c tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:08.296076 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-b3abc157-5dce-4721-b049-3e21c4f4762c tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:08.296569 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-b3abc157-5dce-4721-b049-3e21c4f4762c tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:08.507888 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-b3abc157-5dce-4721-b049-3e21c4f4762c tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88eaaf0dd96340229d9f519b3489cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0608d586fdf4ba4b2b7f7137d49389a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:30:08.516648 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-b3abc157-5dce-4721-b049-3e21c4f4762c tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] 10.222.0.78 "GET /compute/v2.1/servers/133aedc5-dbda-4b17-93fa-1a41c505a3f5" status: 200 len: 1314 microversion: 2.1 time: 0.234807 Feb 17 04:30:08.517246 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 134/282] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:30:08 2021] GET /compute/v2.1/servers/133aedc5-dbda-4b17-93fa-1a41c505a3f5 => generated 1314 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:30:08.522490 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-d0c40be3-4db2-401e-a92e-798521ca9180 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:30:08.524372 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-d0c40be3-4db2-401e-a92e-798521ca9180 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] [instance: 8b4ba536-4de5-4f0e-9cb0-cc08d8616e5d] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:30:08.532039 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-d0c40be3-4db2-401e-a92e-798521ca9180 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:08.532548 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-d0c40be3-4db2-401e-a92e-798521ca9180 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:08.533384 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-d0c40be3-4db2-401e-a92e-798521ca9180 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:08.533874 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-d0c40be3-4db2-401e-a92e-798521ca9180 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:08.749632 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-d0c40be3-4db2-401e-a92e-798521ca9180 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b4f65f82a97499dbb900d523924e946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440d4048a9ad43869a00218c7acb9614', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:30:08.759221 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-d0c40be3-4db2-401e-a92e-798521ca9180 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] 10.222.0.78 "GET /compute/v2.1/servers/8b4ba536-4de5-4f0e-9cb0-cc08d8616e5d" status: 200 len: 1319 microversion: 2.1 time: 0.240329 Feb 17 04:30:08.759825 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 135/283] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:30:08 2021] GET /compute/v2.1/servers/8b4ba536-4de5-4f0e-9cb0-cc08d8616e5d => generated 1319 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:30:09.043221 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-b0cfd4a5-6ef8-48f6-88e9-f5c0a57a7f62 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:30:09.043904 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-b0cfd4a5-6ef8-48f6-88e9-f5c0a57a7f62 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] [instance: 2fe5b190-5679-4b9d-8d5f-fac1a1c407d9] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:30:09.051810 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-b0cfd4a5-6ef8-48f6-88e9-f5c0a57a7f62 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:09.052330 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-b0cfd4a5-6ef8-48f6-88e9-f5c0a57a7f62 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:09.053176 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-b0cfd4a5-6ef8-48f6-88e9-f5c0a57a7f62 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:09.053677 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-b0cfd4a5-6ef8-48f6-88e9-f5c0a57a7f62 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:09.269969 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-b0cfd4a5-6ef8-48f6-88e9-f5c0a57a7f62 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1daf9a83b1d24033a3d4c0f531a4eb2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5336afdcf4aa4b46b0655432b7a1323c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:30:09.279016 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-b0cfd4a5-6ef8-48f6-88e9-f5c0a57a7f62 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] 10.222.0.78 "GET /compute/v2.1/servers/2fe5b190-5679-4b9d-8d5f-fac1a1c407d9" status: 200 len: 1520 microversion: 2.1 time: 0.240447 Feb 17 04:30:09.279643 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 136/284] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:30:09 2021] GET /compute/v2.1/servers/2fe5b190-5679-4b9d-8d5f-fac1a1c407d9 => generated 1520 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:30:09.289134 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-e0f5fa43-7cd6-4eb6-b4c4-121f06af38cb tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:30:09.289875 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-e0f5fa43-7cd6-4eb6-b4c4-121f06af38cb tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] [instance: 555b8368-f196-4c6c-acf7-bc67d324c98a] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:30:09.297775 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-e0f5fa43-7cd6-4eb6-b4c4-121f06af38cb tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:09.298236 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-e0f5fa43-7cd6-4eb6-b4c4-121f06af38cb tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:09.299113 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-e0f5fa43-7cd6-4eb6-b4c4-121f06af38cb tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:09.299612 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-e0f5fa43-7cd6-4eb6-b4c4-121f06af38cb tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:09.513069 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-e0f5fa43-7cd6-4eb6-b4c4-121f06af38cb tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d68d4a6c12e4331b8df8191cdd7a669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2a1ca6347d4278899a1cc009d87d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:30:09.521947 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-e0f5fa43-7cd6-4eb6-b4c4-121f06af38cb tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] 10.222.0.78 "GET /compute/v2.1/servers/555b8368-f196-4c6c-acf7-bc67d324c98a" status: 200 len: 1317 microversion: 2.1 time: 0.237024 Feb 17 04:30:09.522555 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 137/285] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:30:09 2021] GET /compute/v2.1/servers/555b8368-f196-4c6c-acf7-bc67d324c98a => generated 1317 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:30:09.536561 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-b751f3f1-6ca7-4a1d-82d1-4de695396e71 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:30:09.537236 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-b751f3f1-6ca7-4a1d-82d1-4de695396e71 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] [instance: 133aedc5-dbda-4b17-93fa-1a41c505a3f5] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:30:09.545770 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-b751f3f1-6ca7-4a1d-82d1-4de695396e71 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:09.546278 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-b751f3f1-6ca7-4a1d-82d1-4de695396e71 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:09.547178 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-b751f3f1-6ca7-4a1d-82d1-4de695396e71 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:09.547680 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-b751f3f1-6ca7-4a1d-82d1-4de695396e71 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:09.848189 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-376cfc45-a68e-4450-b8bc-7e9e8c9e2192 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "POST /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529/action" status: 200 len: 18155 microversion: 2.1 time: 3.715893 Feb 17 04:30:09.852601 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 149/286] 10.222.0.78 () {60 vars in 1268 bytes} [Wed Feb 17 04:30:06 2021] POST /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529/action => generated 18155 bytes in 3718 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 04:30:09.855899 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-61bad08d-dc96-4813-aafa-d84e353a04d6 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:30:09.856678 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-61bad08d-dc96-4813-aafa-d84e353a04d6 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] [instance: 8b4ba536-4de5-4f0e-9cb0-cc08d8616e5d] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:30:09.865076 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-61bad08d-dc96-4813-aafa-d84e353a04d6 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:09.865586 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-61bad08d-dc96-4813-aafa-d84e353a04d6 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:09.866425 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-61bad08d-dc96-4813-aafa-d84e353a04d6 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:09.867544 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-61bad08d-dc96-4813-aafa-d84e353a04d6 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:10.005968 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-b751f3f1-6ca7-4a1d-82d1-4de695396e71 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88eaaf0dd96340229d9f519b3489cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0608d586fdf4ba4b2b7f7137d49389a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:30:10.015919 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-b751f3f1-6ca7-4a1d-82d1-4de695396e71 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] 10.222.0.78 "GET /compute/v2.1/servers/133aedc5-dbda-4b17-93fa-1a41c505a3f5" status: 200 len: 1314 microversion: 2.1 time: 0.484432 Feb 17 04:30:10.016751 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 138/287] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:30:09 2021] GET /compute/v2.1/servers/133aedc5-dbda-4b17-93fa-1a41c505a3f5 => generated 1314 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:30:10.090366 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-61bad08d-dc96-4813-aafa-d84e353a04d6 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b4f65f82a97499dbb900d523924e946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440d4048a9ad43869a00218c7acb9614', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:30:10.099511 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-61bad08d-dc96-4813-aafa-d84e353a04d6 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] 10.222.0.78 "GET /compute/v2.1/servers/8b4ba536-4de5-4f0e-9cb0-cc08d8616e5d" status: 200 len: 1319 microversion: 2.1 time: 0.249434 Feb 17 04:30:10.100121 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 150/288] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:30:09 2021] GET /compute/v2.1/servers/8b4ba536-4de5-4f0e-9cb0-cc08d8616e5d => generated 1319 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:30:10.298681 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-823e7176-b055-4bb9-9296-0da434113567 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:30:10.299461 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-823e7176-b055-4bb9-9296-0da434113567 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] [instance: 2fe5b190-5679-4b9d-8d5f-fac1a1c407d9] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:30:10.308041 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-823e7176-b055-4bb9-9296-0da434113567 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:10.308555 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-823e7176-b055-4bb9-9296-0da434113567 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:10.309408 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-823e7176-b055-4bb9-9296-0da434113567 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:10.309904 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-823e7176-b055-4bb9-9296-0da434113567 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:10.541543 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-44236f4a-7aeb-4dde-8e0a-b8c741bf41f7 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:30:10.542217 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-44236f4a-7aeb-4dde-8e0a-b8c741bf41f7 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] [instance: 555b8368-f196-4c6c-acf7-bc67d324c98a] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:30:10.550239 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-44236f4a-7aeb-4dde-8e0a-b8c741bf41f7 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:10.550753 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-44236f4a-7aeb-4dde-8e0a-b8c741bf41f7 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:10.551650 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-44236f4a-7aeb-4dde-8e0a-b8c741bf41f7 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:10.552149 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-44236f4a-7aeb-4dde-8e0a-b8c741bf41f7 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:10.741042 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-823e7176-b055-4bb9-9296-0da434113567 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1daf9a83b1d24033a3d4c0f531a4eb2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5336afdcf4aa4b46b0655432b7a1323c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:30:10.750168 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-823e7176-b055-4bb9-9296-0da434113567 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] 10.222.0.78 "GET /compute/v2.1/servers/2fe5b190-5679-4b9d-8d5f-fac1a1c407d9" status: 200 len: 1520 microversion: 2.1 time: 0.455592 Feb 17 04:30:10.752104 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 139/289] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:30:10 2021] GET /compute/v2.1/servers/2fe5b190-5679-4b9d-8d5f-fac1a1c407d9 => generated 1520 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:30:10.777794 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-44236f4a-7aeb-4dde-8e0a-b8c741bf41f7 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d68d4a6c12e4331b8df8191cdd7a669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2a1ca6347d4278899a1cc009d87d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:30:10.786958 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-44236f4a-7aeb-4dde-8e0a-b8c741bf41f7 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] 10.222.0.78 "GET /compute/v2.1/servers/555b8368-f196-4c6c-acf7-bc67d324c98a" status: 200 len: 1317 microversion: 2.1 time: 0.250139 Feb 17 04:30:10.787658 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 151/290] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:30:10 2021] GET /compute/v2.1/servers/555b8368-f196-4c6c-acf7-bc67d324c98a => generated 1317 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:30:10.860731 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-7138a570-f48c-416b-9c5c-180ba38bbd63 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:30:10.861930 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-7138a570-f48c-416b-9c5c-180ba38bbd63 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: 29d1ce27-f63b-4523-88be-55f65a6a2529] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:30:10.870925 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-7138a570-f48c-416b-9c5c-180ba38bbd63 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:10.871555 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-7138a570-f48c-416b-9c5c-180ba38bbd63 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:10.872463 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-7138a570-f48c-416b-9c5c-180ba38bbd63 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:10.873002 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-7138a570-f48c-416b-9c5c-180ba38bbd63 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:11.034583 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-5b7b0bbd-99d4-47e9-bf60-fc718c11223a tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:30:11.035390 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-5b7b0bbd-99d4-47e9-bf60-fc718c11223a tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] [instance: 133aedc5-dbda-4b17-93fa-1a41c505a3f5] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:30:11.045766 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-5b7b0bbd-99d4-47e9-bf60-fc718c11223a tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:11.046460 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-5b7b0bbd-99d4-47e9-bf60-fc718c11223a tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:11.047504 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-5b7b0bbd-99d4-47e9-bf60-fc718c11223a tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:11.048003 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-5b7b0bbd-99d4-47e9-bf60-fc718c11223a tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:11.287235 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-7138a570-f48c-416b-9c5c-180ba38bbd63 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "POST /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529/action" status: 200 len: 20991 microversion: 2.1 time: 0.430235 Feb 17 04:30:11.289104 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 140/291] 10.222.0.78 () {60 vars in 1268 bytes} [Wed Feb 17 04:30:10 2021] POST /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529/action => generated 20991 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 04:30:11.297448 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-e2971409-5e0a-4056-a3db-8a0e68491051 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:30:11.298307 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-e2971409-5e0a-4056-a3db-8a0e68491051 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] [instance: 8b4ba536-4de5-4f0e-9cb0-cc08d8616e5d] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:30:11.299141 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-5b7b0bbd-99d4-47e9-bf60-fc718c11223a tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88eaaf0dd96340229d9f519b3489cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0608d586fdf4ba4b2b7f7137d49389a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:30:11.311782 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-e2971409-5e0a-4056-a3db-8a0e68491051 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:11.311782 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-e2971409-5e0a-4056-a3db-8a0e68491051 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:11.311782 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-e2971409-5e0a-4056-a3db-8a0e68491051 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:11.311782 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-e2971409-5e0a-4056-a3db-8a0e68491051 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:11.317479 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-5b7b0bbd-99d4-47e9-bf60-fc718c11223a tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] 10.222.0.78 "GET /compute/v2.1/servers/133aedc5-dbda-4b17-93fa-1a41c505a3f5" status: 200 len: 1314 microversion: 2.1 time: 0.286967 Feb 17 04:30:11.318285 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 152/292] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:30:11 2021] GET /compute/v2.1/servers/133aedc5-dbda-4b17-93fa-1a41c505a3f5 => generated 1314 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:30:11.645613 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-e2971409-5e0a-4056-a3db-8a0e68491051 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b4f65f82a97499dbb900d523924e946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440d4048a9ad43869a00218c7acb9614', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:30:11.655253 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-e2971409-5e0a-4056-a3db-8a0e68491051 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] 10.222.0.78 "GET /compute/v2.1/servers/8b4ba536-4de5-4f0e-9cb0-cc08d8616e5d" status: 200 len: 1319 microversion: 2.1 time: 0.363576 Feb 17 04:30:11.655974 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 141/293] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:30:11 2021] GET /compute/v2.1/servers/8b4ba536-4de5-4f0e-9cb0-cc08d8616e5d => generated 1319 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:30:11.768760 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-1ef9389a-9d22-43b0-b264-7bfba0caab76 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:30:11.769434 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-1ef9389a-9d22-43b0-b264-7bfba0caab76 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] [instance: 2fe5b190-5679-4b9d-8d5f-fac1a1c407d9] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:30:11.778517 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-1ef9389a-9d22-43b0-b264-7bfba0caab76 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:11.779069 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-1ef9389a-9d22-43b0-b264-7bfba0caab76 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:11.779850 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-1ef9389a-9d22-43b0-b264-7bfba0caab76 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:11.780347 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-1ef9389a-9d22-43b0-b264-7bfba0caab76 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:11.806371 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-0278f1c7-2524-47ba-a501-d2ae9d7d2fbc tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:30:11.807324 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-0278f1c7-2524-47ba-a501-d2ae9d7d2fbc tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] [instance: 555b8368-f196-4c6c-acf7-bc67d324c98a] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:30:11.816293 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-0278f1c7-2524-47ba-a501-d2ae9d7d2fbc tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:11.817099 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-0278f1c7-2524-47ba-a501-d2ae9d7d2fbc tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:11.818156 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-0278f1c7-2524-47ba-a501-d2ae9d7d2fbc tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:11.818837 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-0278f1c7-2524-47ba-a501-d2ae9d7d2fbc tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:12.009507 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-1ef9389a-9d22-43b0-b264-7bfba0caab76 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1daf9a83b1d24033a3d4c0f531a4eb2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5336afdcf4aa4b46b0655432b7a1323c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:30:12.019315 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-1ef9389a-9d22-43b0-b264-7bfba0caab76 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] 10.222.0.78 "GET /compute/v2.1/servers/2fe5b190-5679-4b9d-8d5f-fac1a1c407d9" status: 200 len: 1520 microversion: 2.1 time: 0.254297 Feb 17 04:30:12.022370 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 153/294] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:30:11 2021] GET /compute/v2.1/servers/2fe5b190-5679-4b9d-8d5f-fac1a1c407d9 => generated 1520 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:30:12.027260 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [req-80639764-c09c-46fe-ba55-db99c96408e2 req-99ddf720-b491-4782-b4c2-a796927b89ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "133aedc5-dbda-4b17-93fa-1a41c505a3f5", "tag": "a9ee15ee-16f6-407c-a5d4-b6cf1d15152f"}]} {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:30:12.029017 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:30:12.029017 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: warnings.warn(msg) Feb 17 04:30:12.039270 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [req-80639764-c09c-46fe-ba55-db99c96408e2 req-99ddf720-b491-4782-b4c2-a796927b89ee service nova] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:12.040008 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [req-80639764-c09c-46fe-ba55-db99c96408e2 req-99ddf720-b491-4782-b4c2-a796927b89ee service nova] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:12.058482 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.compute.server_external_events [req-80639764-c09c-46fe-ba55-db99c96408e2 req-99ddf720-b491-4782-b4c2-a796927b89ee service nova] Creating event network-changed:a9ee15ee-16f6-407c-a5d4-b6cf1d15152f for instance 133aedc5-dbda-4b17-93fa-1a41c505a3f5 on hv-cinder-75998 Feb 17 04:30:12.063391 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [req-80639764-c09c-46fe-ba55-db99c96408e2 req-99ddf720-b491-4782-b4c2-a796927b89ee service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042236 Feb 17 04:30:12.064217 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 154/295] 10.222.0.78 () {64 vars in 1308 bytes} [Wed Feb 17 04:30:12 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:30:12.205986 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-0278f1c7-2524-47ba-a501-d2ae9d7d2fbc tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d68d4a6c12e4331b8df8191cdd7a669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2a1ca6347d4278899a1cc009d87d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:30:12.219072 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-0278f1c7-2524-47ba-a501-d2ae9d7d2fbc tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] 10.222.0.78 "GET /compute/v2.1/servers/555b8368-f196-4c6c-acf7-bc67d324c98a" status: 200 len: 1317 microversion: 2.1 time: 0.413382 Feb 17 04:30:12.219742 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 142/296] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:30:11 2021] GET /compute/v2.1/servers/555b8368-f196-4c6c-acf7-bc67d324c98a => generated 1317 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:30:12.301354 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-89e00c7b-add6-4747-801b-e1a83ec264f3 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:30:12.302588 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-89e00c7b-add6-4747-801b-e1a83ec264f3 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: 29d1ce27-f63b-4523-88be-55f65a6a2529] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:30:12.311159 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-89e00c7b-add6-4747-801b-e1a83ec264f3 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:12.311970 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-89e00c7b-add6-4747-801b-e1a83ec264f3 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:12.314107 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-89e00c7b-add6-4747-801b-e1a83ec264f3 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:12.314107 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-89e00c7b-add6-4747-801b-e1a83ec264f3 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:12.336094 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-b713f5a7-1be9-4b68-a760-0ced5883d672 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:30:12.336779 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-b713f5a7-1be9-4b68-a760-0ced5883d672 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] [instance: 133aedc5-dbda-4b17-93fa-1a41c505a3f5] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:30:12.353604 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-b713f5a7-1be9-4b68-a760-0ced5883d672 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:12.354314 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-b713f5a7-1be9-4b68-a760-0ced5883d672 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:12.355360 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-b713f5a7-1be9-4b68-a760-0ced5883d672 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:12.355953 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-b713f5a7-1be9-4b68-a760-0ced5883d672 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:12.573277 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-89e00c7b-add6-4747-801b-e1a83ec264f3 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "POST /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529/action" status: 200 len: 22717 microversion: 2.1 time: 0.275374 Feb 17 04:30:12.579159 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 155/297] 10.222.0.78 () {60 vars in 1268 bytes} [Wed Feb 17 04:30:12 2021] POST /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529/action => generated 22717 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 04:30:12.677690 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-f0251520-6f57-410e-8601-05bfc4ffd26b tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:30:12.678654 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-f0251520-6f57-410e-8601-05bfc4ffd26b tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] [instance: 8b4ba536-4de5-4f0e-9cb0-cc08d8616e5d] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:30:12.711303 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-f0251520-6f57-410e-8601-05bfc4ffd26b tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:12.711303 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-f0251520-6f57-410e-8601-05bfc4ffd26b tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:12.711303 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-f0251520-6f57-410e-8601-05bfc4ffd26b tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:12.711303 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-f0251520-6f57-410e-8601-05bfc4ffd26b tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:12.785609 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-b713f5a7-1be9-4b68-a760-0ced5883d672 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88eaaf0dd96340229d9f519b3489cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0608d586fdf4ba4b2b7f7137d49389a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:30:12.798537 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-b713f5a7-1be9-4b68-a760-0ced5883d672 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] 10.222.0.78 "GET /compute/v2.1/servers/133aedc5-dbda-4b17-93fa-1a41c505a3f5" status: 200 len: 1314 microversion: 2.1 time: 0.466964 Feb 17 04:30:12.799473 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 143/298] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:30:12 2021] GET /compute/v2.1/servers/133aedc5-dbda-4b17-93fa-1a41c505a3f5 => generated 1314 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:30:12.944415 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-f0251520-6f57-410e-8601-05bfc4ffd26b tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b4f65f82a97499dbb900d523924e946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440d4048a9ad43869a00218c7acb9614', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:30:12.958811 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-f0251520-6f57-410e-8601-05bfc4ffd26b tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] 10.222.0.78 "GET /compute/v2.1/servers/8b4ba536-4de5-4f0e-9cb0-cc08d8616e5d" status: 200 len: 1319 microversion: 2.1 time: 0.287207 Feb 17 04:30:12.959606 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 156/299] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:30:12 2021] GET /compute/v2.1/servers/8b4ba536-4de5-4f0e-9cb0-cc08d8616e5d => generated 1319 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:30:13.037757 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-3c17acea-6e24-4619-95e2-c100358beeaf tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:30:13.038489 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-3c17acea-6e24-4619-95e2-c100358beeaf tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] [instance: 2fe5b190-5679-4b9d-8d5f-fac1a1c407d9] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:30:13.046237 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-3c17acea-6e24-4619-95e2-c100358beeaf tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:13.046760 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-3c17acea-6e24-4619-95e2-c100358beeaf tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:13.047636 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-3c17acea-6e24-4619-95e2-c100358beeaf tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:13.048136 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-3c17acea-6e24-4619-95e2-c100358beeaf tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:13.238375 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-819f2259-0dd6-4669-bd8f-29ca81beea00 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:30:13.239066 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-819f2259-0dd6-4669-bd8f-29ca81beea00 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] [instance: 555b8368-f196-4c6c-acf7-bc67d324c98a] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:30:13.246998 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-819f2259-0dd6-4669-bd8f-29ca81beea00 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:13.247552 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-819f2259-0dd6-4669-bd8f-29ca81beea00 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:13.248400 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-819f2259-0dd6-4669-bd8f-29ca81beea00 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:13.248896 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-819f2259-0dd6-4669-bd8f-29ca81beea00 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:13.470005 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-819f2259-0dd6-4669-bd8f-29ca81beea00 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d68d4a6c12e4331b8df8191cdd7a669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2a1ca6347d4278899a1cc009d87d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:30:13.479228 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-819f2259-0dd6-4669-bd8f-29ca81beea00 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] 10.222.0.78 "GET /compute/v2.1/servers/555b8368-f196-4c6c-acf7-bc67d324c98a" status: 200 len: 1317 microversion: 2.1 time: 0.245107 Feb 17 04:30:13.480086 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 157/300] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:30:13 2021] GET /compute/v2.1/servers/555b8368-f196-4c6c-acf7-bc67d324c98a => generated 1317 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:30:13.480286 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-3c17acea-6e24-4619-95e2-c100358beeaf tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1daf9a83b1d24033a3d4c0f531a4eb2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5336afdcf4aa4b46b0655432b7a1323c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:30:13.489546 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-3c17acea-6e24-4619-95e2-c100358beeaf tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] 10.222.0.78 "GET /compute/v2.1/servers/2fe5b190-5679-4b9d-8d5f-fac1a1c407d9" status: 200 len: 1520 microversion: 2.1 time: 0.455718 Feb 17 04:30:13.490140 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 144/301] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:30:13 2021] GET /compute/v2.1/servers/2fe5b190-5679-4b9d-8d5f-fac1a1c407d9 => generated 1520 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:30:13.586162 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-8feecfce-df7e-4961-9dc3-07eb1378b441 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:30:13.587311 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-8feecfce-df7e-4961-9dc3-07eb1378b441 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: 29d1ce27-f63b-4523-88be-55f65a6a2529] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:30:13.595466 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-8feecfce-df7e-4961-9dc3-07eb1378b441 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:13.595981 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-8feecfce-df7e-4961-9dc3-07eb1378b441 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:13.596834 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-8feecfce-df7e-4961-9dc3-07eb1378b441 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:13.597332 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-8feecfce-df7e-4961-9dc3-07eb1378b441 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:13.817027 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-0ade8ea8-b1ad-45f8-bd89-853d11047e5b tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:30:13.817713 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-0ade8ea8-b1ad-45f8-bd89-853d11047e5b tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] [instance: 133aedc5-dbda-4b17-93fa-1a41c505a3f5] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:30:13.826272 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-0ade8ea8-b1ad-45f8-bd89-853d11047e5b tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:13.826786 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-0ade8ea8-b1ad-45f8-bd89-853d11047e5b tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:13.827653 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-0ade8ea8-b1ad-45f8-bd89-853d11047e5b tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:13.828148 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-0ade8ea8-b1ad-45f8-bd89-853d11047e5b tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:13.919396 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-8feecfce-df7e-4961-9dc3-07eb1378b441 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "POST /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529/action" status: 200 len: 23880 microversion: 2.1 time: 0.337243 Feb 17 04:30:13.923420 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 158/302] 10.222.0.78 () {60 vars in 1268 bytes} [Wed Feb 17 04:30:13 2021] POST /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529/action => generated 23880 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 04:30:13.978144 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-35015ce5-959f-45dd-ad46-f13662a12bbc tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:30:13.978873 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-35015ce5-959f-45dd-ad46-f13662a12bbc tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] [instance: 8b4ba536-4de5-4f0e-9cb0-cc08d8616e5d] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:30:13.987479 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-35015ce5-959f-45dd-ad46-f13662a12bbc tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:13.989491 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-35015ce5-959f-45dd-ad46-f13662a12bbc tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:13.990333 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-35015ce5-959f-45dd-ad46-f13662a12bbc tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:13.990837 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-35015ce5-959f-45dd-ad46-f13662a12bbc tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:14.044864 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-0ade8ea8-b1ad-45f8-bd89-853d11047e5b tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88eaaf0dd96340229d9f519b3489cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0608d586fdf4ba4b2b7f7137d49389a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:30:14.053766 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-0ade8ea8-b1ad-45f8-bd89-853d11047e5b tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] 10.222.0.78 "GET /compute/v2.1/servers/133aedc5-dbda-4b17-93fa-1a41c505a3f5" status: 200 len: 1314 microversion: 2.1 time: 0.240664 Feb 17 04:30:14.055219 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 145/303] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:30:13 2021] GET /compute/v2.1/servers/133aedc5-dbda-4b17-93fa-1a41c505a3f5 => generated 1314 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:30:14.215416 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-35015ce5-959f-45dd-ad46-f13662a12bbc tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b4f65f82a97499dbb900d523924e946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440d4048a9ad43869a00218c7acb9614', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:30:14.224166 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-35015ce5-959f-45dd-ad46-f13662a12bbc tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] 10.222.0.78 "GET /compute/v2.1/servers/8b4ba536-4de5-4f0e-9cb0-cc08d8616e5d" status: 200 len: 1319 microversion: 2.1 time: 0.250656 Feb 17 04:30:14.224750 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 159/304] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:30:13 2021] GET /compute/v2.1/servers/8b4ba536-4de5-4f0e-9cb0-cc08d8616e5d => generated 1319 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:30:14.498840 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-2130bcd0-0a67-4f56-8907-264018522c36 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:30:14.499282 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-2130bcd0-0a67-4f56-8907-264018522c36 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] [instance: 555b8368-f196-4c6c-acf7-bc67d324c98a] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:30:14.507723 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-2130bcd0-0a67-4f56-8907-264018522c36 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:14.507876 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-879718f9-c079-40f3-aa87-e6c8272c6f7e tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:30:14.508227 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-2130bcd0-0a67-4f56-8907-264018522c36 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:14.508539 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-879718f9-c079-40f3-aa87-e6c8272c6f7e tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] [instance: 2fe5b190-5679-4b9d-8d5f-fac1a1c407d9] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:30:14.509080 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-2130bcd0-0a67-4f56-8907-264018522c36 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:14.509581 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-2130bcd0-0a67-4f56-8907-264018522c36 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:14.516440 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-879718f9-c079-40f3-aa87-e6c8272c6f7e tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:14.516951 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-879718f9-c079-40f3-aa87-e6c8272c6f7e tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:14.517790 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-879718f9-c079-40f3-aa87-e6c8272c6f7e tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:14.518283 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-879718f9-c079-40f3-aa87-e6c8272c6f7e tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:14.734647 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-2130bcd0-0a67-4f56-8907-264018522c36 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d68d4a6c12e4331b8df8191cdd7a669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2a1ca6347d4278899a1cc009d87d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:30:14.739528 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-879718f9-c079-40f3-aa87-e6c8272c6f7e tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1daf9a83b1d24033a3d4c0f531a4eb2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5336afdcf4aa4b46b0655432b7a1323c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:30:14.744763 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-2130bcd0-0a67-4f56-8907-264018522c36 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] 10.222.0.78 "GET /compute/v2.1/servers/555b8368-f196-4c6c-acf7-bc67d324c98a" status: 200 len: 1317 microversion: 2.1 time: 0.250482 Feb 17 04:30:14.745373 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 146/305] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:30:14 2021] GET /compute/v2.1/servers/555b8368-f196-4c6c-acf7-bc67d324c98a => generated 1317 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:30:14.749559 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-879718f9-c079-40f3-aa87-e6c8272c6f7e tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] 10.222.0.78 "GET /compute/v2.1/servers/2fe5b190-5679-4b9d-8d5f-fac1a1c407d9" status: 200 len: 1520 microversion: 2.1 time: 0.245546 Feb 17 04:30:14.750236 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 160/306] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:30:14 2021] GET /compute/v2.1/servers/2fe5b190-5679-4b9d-8d5f-fac1a1c407d9 => generated 1520 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:30:14.930894 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-d3f065c1-10ef-42c3-953b-6b2711d0ec99 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:30:14.932057 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-d3f065c1-10ef-42c3-953b-6b2711d0ec99 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: 29d1ce27-f63b-4523-88be-55f65a6a2529] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:30:14.940294 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-d3f065c1-10ef-42c3-953b-6b2711d0ec99 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:14.940815 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-d3f065c1-10ef-42c3-953b-6b2711d0ec99 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:14.941668 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-d3f065c1-10ef-42c3-953b-6b2711d0ec99 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:14.942168 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-d3f065c1-10ef-42c3-953b-6b2711d0ec99 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:15.071554 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-eb42740a-8b37-43e3-a93b-134ca0096a7e tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:30:15.072448 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-eb42740a-8b37-43e3-a93b-134ca0096a7e tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] [instance: 133aedc5-dbda-4b17-93fa-1a41c505a3f5] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:30:15.080955 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-eb42740a-8b37-43e3-a93b-134ca0096a7e tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:15.081473 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-eb42740a-8b37-43e3-a93b-134ca0096a7e tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:15.082378 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-eb42740a-8b37-43e3-a93b-134ca0096a7e tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:15.082814 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-eb42740a-8b37-43e3-a93b-134ca0096a7e tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:15.301097 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-eb42740a-8b37-43e3-a93b-134ca0096a7e tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88eaaf0dd96340229d9f519b3489cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0608d586fdf4ba4b2b7f7137d49389a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:30:15.309932 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-eb42740a-8b37-43e3-a93b-134ca0096a7e tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] 10.222.0.78 "GET /compute/v2.1/servers/133aedc5-dbda-4b17-93fa-1a41c505a3f5" status: 200 len: 1314 microversion: 2.1 time: 0.242522 Feb 17 04:30:15.310523 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 161/307] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:30:15 2021] GET /compute/v2.1/servers/133aedc5-dbda-4b17-93fa-1a41c505a3f5 => generated 1314 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:30:15.315159 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-2233f48c-3b3f-4f07-bac0-15e5add9a917 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:30:15.315815 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-2233f48c-3b3f-4f07-bac0-15e5add9a917 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] [instance: 8b4ba536-4de5-4f0e-9cb0-cc08d8616e5d] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:30:15.323884 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-2233f48c-3b3f-4f07-bac0-15e5add9a917 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:15.324383 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-2233f48c-3b3f-4f07-bac0-15e5add9a917 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:15.325203 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-2233f48c-3b3f-4f07-bac0-15e5add9a917 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:15.325690 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-2233f48c-3b3f-4f07-bac0-15e5add9a917 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:15.544707 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-2233f48c-3b3f-4f07-bac0-15e5add9a917 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b4f65f82a97499dbb900d523924e946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440d4048a9ad43869a00218c7acb9614', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:30:15.553441 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-2233f48c-3b3f-4f07-bac0-15e5add9a917 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] 10.222.0.78 "GET /compute/v2.1/servers/8b4ba536-4de5-4f0e-9cb0-cc08d8616e5d" status: 200 len: 1319 microversion: 2.1 time: 0.241824 Feb 17 04:30:15.554983 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 162/308] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:30:15 2021] GET /compute/v2.1/servers/8b4ba536-4de5-4f0e-9cb0-cc08d8616e5d => generated 1319 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:30:15.763460 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-03506e15-d882-452d-b366-2dcbd7fac18a tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:30:15.764130 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-03506e15-d882-452d-b366-2dcbd7fac18a tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] [instance: 555b8368-f196-4c6c-acf7-bc67d324c98a] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:30:15.771934 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-03506e15-d882-452d-b366-2dcbd7fac18a tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:15.772445 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-03506e15-d882-452d-b366-2dcbd7fac18a tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:15.773694 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-03506e15-d882-452d-b366-2dcbd7fac18a tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:15.774184 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-03506e15-d882-452d-b366-2dcbd7fac18a tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:15.986403 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-03506e15-d882-452d-b366-2dcbd7fac18a tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d68d4a6c12e4331b8df8191cdd7a669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2a1ca6347d4278899a1cc009d87d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:30:15.996034 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-03506e15-d882-452d-b366-2dcbd7fac18a tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] 10.222.0.78 "GET /compute/v2.1/servers/555b8368-f196-4c6c-acf7-bc67d324c98a" status: 200 len: 1317 microversion: 2.1 time: 0.236588 Feb 17 04:30:15.996635 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 163/309] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:30:15 2021] GET /compute/v2.1/servers/555b8368-f196-4c6c-acf7-bc67d324c98a => generated 1317 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:30:16.001233 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-7a390563-2d23-42f3-8237-0b3a66349db1 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:30:16.001899 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-7a390563-2d23-42f3-8237-0b3a66349db1 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] [instance: 2fe5b190-5679-4b9d-8d5f-fac1a1c407d9] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:30:16.009546 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-7a390563-2d23-42f3-8237-0b3a66349db1 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:16.010056 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-7a390563-2d23-42f3-8237-0b3a66349db1 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:16.010939 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-7a390563-2d23-42f3-8237-0b3a66349db1 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:16.011463 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-7a390563-2d23-42f3-8237-0b3a66349db1 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:16.227232 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-7a390563-2d23-42f3-8237-0b3a66349db1 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1daf9a83b1d24033a3d4c0f531a4eb2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5336afdcf4aa4b46b0655432b7a1323c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:30:16.236070 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-7a390563-2d23-42f3-8237-0b3a66349db1 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] 10.222.0.78 "GET /compute/v2.1/servers/2fe5b190-5679-4b9d-8d5f-fac1a1c407d9" status: 200 len: 1520 microversion: 2.1 time: 0.238413 Feb 17 04:30:16.236886 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 164/310] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:30:15 2021] GET /compute/v2.1/servers/2fe5b190-5679-4b9d-8d5f-fac1a1c407d9 => generated 1520 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:30:16.328894 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-f47a4ea6-e491-46ed-9bf4-88024909f67c tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:30:16.329784 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-f47a4ea6-e491-46ed-9bf4-88024909f67c tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] [instance: 133aedc5-dbda-4b17-93fa-1a41c505a3f5] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:30:16.339299 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-f47a4ea6-e491-46ed-9bf4-88024909f67c tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:16.339796 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-f47a4ea6-e491-46ed-9bf4-88024909f67c tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:16.340627 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-f47a4ea6-e491-46ed-9bf4-88024909f67c tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:16.341110 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-f47a4ea6-e491-46ed-9bf4-88024909f67c tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:16.559983 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-f47a4ea6-e491-46ed-9bf4-88024909f67c tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88eaaf0dd96340229d9f519b3489cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0608d586fdf4ba4b2b7f7137d49389a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:30:16.568787 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-f47a4ea6-e491-46ed-9bf4-88024909f67c tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] 10.222.0.78 "GET /compute/v2.1/servers/133aedc5-dbda-4b17-93fa-1a41c505a3f5" status: 200 len: 1314 microversion: 2.1 time: 0.244418 Feb 17 04:30:16.569409 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 165/311] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:30:16 2021] GET /compute/v2.1/servers/133aedc5-dbda-4b17-93fa-1a41c505a3f5 => generated 1314 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:30:16.574657 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-b3779634-29eb-4f73-a6ab-2749cb177b53 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:30:16.575382 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-b3779634-29eb-4f73-a6ab-2749cb177b53 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] [instance: 8b4ba536-4de5-4f0e-9cb0-cc08d8616e5d] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:30:16.582771 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-b3779634-29eb-4f73-a6ab-2749cb177b53 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:16.583350 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-b3779634-29eb-4f73-a6ab-2749cb177b53 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:16.584189 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-b3779634-29eb-4f73-a6ab-2749cb177b53 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:16.584690 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-b3779634-29eb-4f73-a6ab-2749cb177b53 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:16.800484 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-b3779634-29eb-4f73-a6ab-2749cb177b53 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b4f65f82a97499dbb900d523924e946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440d4048a9ad43869a00218c7acb9614', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:30:16.810276 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-b3779634-29eb-4f73-a6ab-2749cb177b53 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] 10.222.0.78 "GET /compute/v2.1/servers/8b4ba536-4de5-4f0e-9cb0-cc08d8616e5d" status: 200 len: 1319 microversion: 2.1 time: 0.239178 Feb 17 04:30:16.810891 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 166/312] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:30:16 2021] GET /compute/v2.1/servers/8b4ba536-4de5-4f0e-9cb0-cc08d8616e5d => generated 1319 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:30:17.014374 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-9b587070-3614-4338-ba3e-dcf6a8026955 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:30:17.014986 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-9b587070-3614-4338-ba3e-dcf6a8026955 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] [instance: 555b8368-f196-4c6c-acf7-bc67d324c98a] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:30:17.023547 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-9b587070-3614-4338-ba3e-dcf6a8026955 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:17.024065 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-9b587070-3614-4338-ba3e-dcf6a8026955 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:17.024905 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-9b587070-3614-4338-ba3e-dcf6a8026955 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:17.025402 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-9b587070-3614-4338-ba3e-dcf6a8026955 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:17.245175 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-9b587070-3614-4338-ba3e-dcf6a8026955 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d68d4a6c12e4331b8df8191cdd7a669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2a1ca6347d4278899a1cc009d87d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:30:17.253984 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-9b587070-3614-4338-ba3e-dcf6a8026955 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] 10.222.0.78 "GET /compute/v2.1/servers/555b8368-f196-4c6c-acf7-bc67d324c98a" status: 200 len: 1317 microversion: 2.1 time: 0.243683 Feb 17 04:30:17.254575 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 167/313] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:30:17 2021] GET /compute/v2.1/servers/555b8368-f196-4c6c-acf7-bc67d324c98a => generated 1317 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:30:17.259771 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-5922295a-b4a7-4f42-8d23-6a0806400135 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:30:17.260526 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-5922295a-b4a7-4f42-8d23-6a0806400135 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] [instance: 2fe5b190-5679-4b9d-8d5f-fac1a1c407d9] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:30:17.267992 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-5922295a-b4a7-4f42-8d23-6a0806400135 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:17.268446 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-5922295a-b4a7-4f42-8d23-6a0806400135 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:17.269266 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-5922295a-b4a7-4f42-8d23-6a0806400135 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:17.269755 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-5922295a-b4a7-4f42-8d23-6a0806400135 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:17.489900 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-5922295a-b4a7-4f42-8d23-6a0806400135 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1daf9a83b1d24033a3d4c0f531a4eb2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5336afdcf4aa4b46b0655432b7a1323c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:30:17.499426 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-5922295a-b4a7-4f42-8d23-6a0806400135 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] 10.222.0.78 "GET /compute/v2.1/servers/2fe5b190-5679-4b9d-8d5f-fac1a1c407d9" status: 200 len: 1520 microversion: 2.1 time: 0.243780 Feb 17 04:30:17.500044 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 168/314] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:30:17 2021] GET /compute/v2.1/servers/2fe5b190-5679-4b9d-8d5f-fac1a1c407d9 => generated 1520 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:30:17.587980 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-883b771c-0749-4dce-8744-494dda8b301d tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:30:17.588633 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-883b771c-0749-4dce-8744-494dda8b301d tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] [instance: 133aedc5-dbda-4b17-93fa-1a41c505a3f5] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:30:17.596482 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-883b771c-0749-4dce-8744-494dda8b301d tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:17.596995 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-883b771c-0749-4dce-8744-494dda8b301d tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:17.597829 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-883b771c-0749-4dce-8744-494dda8b301d tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:17.598325 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-883b771c-0749-4dce-8744-494dda8b301d tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:17.808840 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-883b771c-0749-4dce-8744-494dda8b301d tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88eaaf0dd96340229d9f519b3489cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0608d586fdf4ba4b2b7f7137d49389a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:30:17.817608 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-883b771c-0749-4dce-8744-494dda8b301d tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] 10.222.0.78 "GET /compute/v2.1/servers/133aedc5-dbda-4b17-93fa-1a41c505a3f5" status: 200 len: 1314 microversion: 2.1 time: 0.234506 Feb 17 04:30:17.818210 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 169/315] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:30:17 2021] GET /compute/v2.1/servers/133aedc5-dbda-4b17-93fa-1a41c505a3f5 => generated 1314 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:30:17.828656 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-1b7640d3-b70d-4b30-af25-8e6b8b54437b tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:30:17.829324 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-1b7640d3-b70d-4b30-af25-8e6b8b54437b tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] [instance: 8b4ba536-4de5-4f0e-9cb0-cc08d8616e5d] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:30:17.837143 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-1b7640d3-b70d-4b30-af25-8e6b8b54437b tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:17.837690 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-1b7640d3-b70d-4b30-af25-8e6b8b54437b tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:17.838569 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-1b7640d3-b70d-4b30-af25-8e6b8b54437b tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:17.839015 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-1b7640d3-b70d-4b30-af25-8e6b8b54437b tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:18.050984 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-1b7640d3-b70d-4b30-af25-8e6b8b54437b tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b4f65f82a97499dbb900d523924e946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440d4048a9ad43869a00218c7acb9614', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:30:18.059764 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-1b7640d3-b70d-4b30-af25-8e6b8b54437b tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] 10.222.0.78 "GET /compute/v2.1/servers/8b4ba536-4de5-4f0e-9cb0-cc08d8616e5d" status: 200 len: 1319 microversion: 2.1 time: 0.234944 Feb 17 04:30:18.060367 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 170/316] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:30:17 2021] GET /compute/v2.1/servers/8b4ba536-4de5-4f0e-9cb0-cc08d8616e5d => generated 1319 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:30:18.272954 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-0f4267d2-6f1d-45aa-b54d-2e94d36239e3 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:30:18.273628 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-0f4267d2-6f1d-45aa-b54d-2e94d36239e3 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] [instance: 555b8368-f196-4c6c-acf7-bc67d324c98a] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:30:18.281522 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-0f4267d2-6f1d-45aa-b54d-2e94d36239e3 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:18.282035 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-0f4267d2-6f1d-45aa-b54d-2e94d36239e3 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:18.282872 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-0f4267d2-6f1d-45aa-b54d-2e94d36239e3 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:18.283396 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-0f4267d2-6f1d-45aa-b54d-2e94d36239e3 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:18.501309 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-0f4267d2-6f1d-45aa-b54d-2e94d36239e3 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d68d4a6c12e4331b8df8191cdd7a669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2a1ca6347d4278899a1cc009d87d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:30:18.510748 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-0f4267d2-6f1d-45aa-b54d-2e94d36239e3 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] 10.222.0.78 "GET /compute/v2.1/servers/555b8368-f196-4c6c-acf7-bc67d324c98a" status: 200 len: 1317 microversion: 2.1 time: 0.241935 Feb 17 04:30:18.511383 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 171/317] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:30:18 2021] GET /compute/v2.1/servers/555b8368-f196-4c6c-acf7-bc67d324c98a => generated 1317 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:30:18.517178 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-c484266c-0464-4b40-b955-d07134dde1de tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:30:18.517849 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-c484266c-0464-4b40-b955-d07134dde1de tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] [instance: 2fe5b190-5679-4b9d-8d5f-fac1a1c407d9] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:30:18.526125 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-c484266c-0464-4b40-b955-d07134dde1de tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:18.526652 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-c484266c-0464-4b40-b955-d07134dde1de tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:18.527488 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-c484266c-0464-4b40-b955-d07134dde1de tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:18.527980 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-c484266c-0464-4b40-b955-d07134dde1de tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:18.740232 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-c484266c-0464-4b40-b955-d07134dde1de tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1daf9a83b1d24033a3d4c0f531a4eb2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5336afdcf4aa4b46b0655432b7a1323c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:30:18.749690 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-c484266c-0464-4b40-b955-d07134dde1de tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] 10.222.0.78 "GET /compute/v2.1/servers/2fe5b190-5679-4b9d-8d5f-fac1a1c407d9" status: 200 len: 1520 microversion: 2.1 time: 0.236246 Feb 17 04:30:18.750284 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 172/318] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:30:18 2021] GET /compute/v2.1/servers/2fe5b190-5679-4b9d-8d5f-fac1a1c407d9 => generated 1520 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:30:18.835515 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-03640a29-792a-408c-9bbb-cb150c8ab79c tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:30:18.836432 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-03640a29-792a-408c-9bbb-cb150c8ab79c tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] [instance: 133aedc5-dbda-4b17-93fa-1a41c505a3f5] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:30:18.844086 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-03640a29-792a-408c-9bbb-cb150c8ab79c tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:18.844589 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-03640a29-792a-408c-9bbb-cb150c8ab79c tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:18.845411 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-03640a29-792a-408c-9bbb-cb150c8ab79c tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:18.845898 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-03640a29-792a-408c-9bbb-cb150c8ab79c tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:19.064583 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-03640a29-792a-408c-9bbb-cb150c8ab79c tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88eaaf0dd96340229d9f519b3489cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0608d586fdf4ba4b2b7f7137d49389a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:30:19.074098 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-03640a29-792a-408c-9bbb-cb150c8ab79c tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] 10.222.0.78 "GET /compute/v2.1/servers/133aedc5-dbda-4b17-93fa-1a41c505a3f5" status: 200 len: 1314 microversion: 2.1 time: 0.242876 Feb 17 04:30:19.074692 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 173/319] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:30:18 2021] GET /compute/v2.1/servers/133aedc5-dbda-4b17-93fa-1a41c505a3f5 => generated 1314 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:30:19.079303 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-f2bb28c4-8f16-4252-8c9c-5f3258631e05 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:30:19.079957 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-f2bb28c4-8f16-4252-8c9c-5f3258631e05 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] [instance: 8b4ba536-4de5-4f0e-9cb0-cc08d8616e5d] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:30:19.088712 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-f2bb28c4-8f16-4252-8c9c-5f3258631e05 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:19.089216 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-f2bb28c4-8f16-4252-8c9c-5f3258631e05 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:19.090046 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-f2bb28c4-8f16-4252-8c9c-5f3258631e05 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:19.090533 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-f2bb28c4-8f16-4252-8c9c-5f3258631e05 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:19.312623 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-f2bb28c4-8f16-4252-8c9c-5f3258631e05 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b4f65f82a97499dbb900d523924e946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440d4048a9ad43869a00218c7acb9614', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:30:19.318187 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-d3f065c1-10ef-42c3-953b-6b2711d0ec99 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "POST /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529/action" status: 200 len: 27764 microversion: 2.1 time: 4.391009 Feb 17 04:30:19.318903 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 147/320] 10.222.0.78 () {60 vars in 1268 bytes} [Wed Feb 17 04:30:14 2021] POST /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529/action => generated 27764 bytes in 4393 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 04:30:19.323517 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-f2bb28c4-8f16-4252-8c9c-5f3258631e05 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] 10.222.0.78 "GET /compute/v2.1/servers/8b4ba536-4de5-4f0e-9cb0-cc08d8616e5d" status: 200 len: 1319 microversion: 2.1 time: 0.247677 Feb 17 04:30:19.324119 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 174/321] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:30:19 2021] GET /compute/v2.1/servers/8b4ba536-4de5-4f0e-9cb0-cc08d8616e5d => generated 1319 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:30:19.529976 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-6182cde9-85cd-4b37-8c26-e6855d4d904f tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:30:19.530886 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-6182cde9-85cd-4b37-8c26-e6855d4d904f tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] [instance: 555b8368-f196-4c6c-acf7-bc67d324c98a] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:30:19.539822 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-6182cde9-85cd-4b37-8c26-e6855d4d904f tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:19.540341 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-6182cde9-85cd-4b37-8c26-e6855d4d904f tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:19.541329 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-6182cde9-85cd-4b37-8c26-e6855d4d904f tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:19.541835 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-6182cde9-85cd-4b37-8c26-e6855d4d904f tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:19.758579 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-6182cde9-85cd-4b37-8c26-e6855d4d904f tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d68d4a6c12e4331b8df8191cdd7a669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2a1ca6347d4278899a1cc009d87d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:30:19.768359 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-6182cde9-85cd-4b37-8c26-e6855d4d904f tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] 10.222.0.78 "GET /compute/v2.1/servers/555b8368-f196-4c6c-acf7-bc67d324c98a" status: 200 len: 1317 microversion: 2.1 time: 0.242908 Feb 17 04:30:19.768656 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-2ce80bdf-6630-411b-b4e2-977ee2281cd0 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:30:19.769158 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 148/322] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:30:19 2021] GET /compute/v2.1/servers/555b8368-f196-4c6c-acf7-bc67d324c98a => generated 1317 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:30:19.769555 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-2ce80bdf-6630-411b-b4e2-977ee2281cd0 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] [instance: 2fe5b190-5679-4b9d-8d5f-fac1a1c407d9] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:30:19.778344 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-2ce80bdf-6630-411b-b4e2-977ee2281cd0 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:19.778851 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-2ce80bdf-6630-411b-b4e2-977ee2281cd0 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:19.779694 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-2ce80bdf-6630-411b-b4e2-977ee2281cd0 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:19.780234 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-2ce80bdf-6630-411b-b4e2-977ee2281cd0 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:20.001603 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-2ce80bdf-6630-411b-b4e2-977ee2281cd0 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1daf9a83b1d24033a3d4c0f531a4eb2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5336afdcf4aa4b46b0655432b7a1323c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:30:20.011207 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-2ce80bdf-6630-411b-b4e2-977ee2281cd0 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] 10.222.0.78 "GET /compute/v2.1/servers/2fe5b190-5679-4b9d-8d5f-fac1a1c407d9" status: 200 len: 1520 microversion: 2.1 time: 0.246541 Feb 17 04:30:20.011802 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 175/323] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:30:19 2021] GET /compute/v2.1/servers/2fe5b190-5679-4b9d-8d5f-fac1a1c407d9 => generated 1520 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:30:20.092029 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-12524bfe-426d-4c26-bfda-50d90d9702f0 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:30:20.092712 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-12524bfe-426d-4c26-bfda-50d90d9702f0 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] [instance: 133aedc5-dbda-4b17-93fa-1a41c505a3f5] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:30:20.100659 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-12524bfe-426d-4c26-bfda-50d90d9702f0 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:20.101233 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-12524bfe-426d-4c26-bfda-50d90d9702f0 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:20.102177 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-12524bfe-426d-4c26-bfda-50d90d9702f0 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:20.102680 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-12524bfe-426d-4c26-bfda-50d90d9702f0 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:20.331807 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-70501b7d-d1e0-45e2-9870-3b698e1cfa1b tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:30:20.333020 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-70501b7d-d1e0-45e2-9870-3b698e1cfa1b tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: 29d1ce27-f63b-4523-88be-55f65a6a2529] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:30:20.343641 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-70501b7d-d1e0-45e2-9870-3b698e1cfa1b tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:20.344464 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-70501b7d-d1e0-45e2-9870-3b698e1cfa1b tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:20.344591 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-12524bfe-426d-4c26-bfda-50d90d9702f0 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88eaaf0dd96340229d9f519b3489cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0608d586fdf4ba4b2b7f7137d49389a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:30:20.345582 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-70501b7d-d1e0-45e2-9870-3b698e1cfa1b tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:20.346225 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-70501b7d-d1e0-45e2-9870-3b698e1cfa1b tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:20.354149 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-12524bfe-426d-4c26-bfda-50d90d9702f0 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] 10.222.0.78 "GET /compute/v2.1/servers/133aedc5-dbda-4b17-93fa-1a41c505a3f5" status: 200 len: 1314 microversion: 2.1 time: 0.266042 Feb 17 04:30:20.354781 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 149/324] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:30:20 2021] GET /compute/v2.1/servers/133aedc5-dbda-4b17-93fa-1a41c505a3f5 => generated 1314 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:30:20.370712 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-2ca016d9-8c40-4318-b0ba-dc070cdd4b93 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:30:20.371424 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-2ca016d9-8c40-4318-b0ba-dc070cdd4b93 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] [instance: 8b4ba536-4de5-4f0e-9cb0-cc08d8616e5d] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:30:20.379604 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-2ca016d9-8c40-4318-b0ba-dc070cdd4b93 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:20.380093 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-2ca016d9-8c40-4318-b0ba-dc070cdd4b93 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:20.380957 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-2ca016d9-8c40-4318-b0ba-dc070cdd4b93 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:20.381454 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-2ca016d9-8c40-4318-b0ba-dc070cdd4b93 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:20.621900 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-2ca016d9-8c40-4318-b0ba-dc070cdd4b93 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b4f65f82a97499dbb900d523924e946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440d4048a9ad43869a00218c7acb9614', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:30:20.631548 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-2ca016d9-8c40-4318-b0ba-dc070cdd4b93 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] 10.222.0.78 "GET /compute/v2.1/servers/8b4ba536-4de5-4f0e-9cb0-cc08d8616e5d" status: 200 len: 1319 microversion: 2.1 time: 0.265388 Feb 17 04:30:20.633111 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 150/325] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:30:20 2021] GET /compute/v2.1/servers/8b4ba536-4de5-4f0e-9cb0-cc08d8616e5d => generated 1319 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:30:20.698048 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-70501b7d-d1e0-45e2-9870-3b698e1cfa1b tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "POST /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529/action" status: 200 len: 27830 microversion: 2.1 time: 0.370577 Feb 17 04:30:20.699197 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 176/326] 10.222.0.78 () {60 vars in 1268 bytes} [Wed Feb 17 04:30:20 2021] POST /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529/action => generated 27830 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 04:30:20.787588 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-3a31535e-d3db-4c42-8a02-e502541d3596 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:30:20.788657 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-3a31535e-d3db-4c42-8a02-e502541d3596 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] [instance: 555b8368-f196-4c6c-acf7-bc67d324c98a] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:30:20.797741 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-3a31535e-d3db-4c42-8a02-e502541d3596 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:20.798371 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-3a31535e-d3db-4c42-8a02-e502541d3596 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:20.800679 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-3a31535e-d3db-4c42-8a02-e502541d3596 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:20.801501 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-3a31535e-d3db-4c42-8a02-e502541d3596 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:21.032222 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-c5bc2ebf-7c62-4ef9-bbf5-8c20cbe819d0 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:30:21.033159 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-c5bc2ebf-7c62-4ef9-bbf5-8c20cbe819d0 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] [instance: 2fe5b190-5679-4b9d-8d5f-fac1a1c407d9] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:30:21.042734 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-c5bc2ebf-7c62-4ef9-bbf5-8c20cbe819d0 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:21.043541 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-c5bc2ebf-7c62-4ef9-bbf5-8c20cbe819d0 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:21.044609 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-c5bc2ebf-7c62-4ef9-bbf5-8c20cbe819d0 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:21.045763 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-c5bc2ebf-7c62-4ef9-bbf5-8c20cbe819d0 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:21.160345 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-3a31535e-d3db-4c42-8a02-e502541d3596 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d68d4a6c12e4331b8df8191cdd7a669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2a1ca6347d4278899a1cc009d87d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:30:21.170219 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-3a31535e-d3db-4c42-8a02-e502541d3596 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] 10.222.0.78 "GET /compute/v2.1/servers/555b8368-f196-4c6c-acf7-bc67d324c98a" status: 200 len: 1317 microversion: 2.1 time: 0.386953 Feb 17 04:30:21.171196 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 151/327] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:30:20 2021] GET /compute/v2.1/servers/555b8368-f196-4c6c-acf7-bc67d324c98a => generated 1317 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:30:21.175971 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [req-b93cef37-76e1-4793-b793-a490ff61fcc9 req-b6a52aa3-389d-4f9d-9b63-e3290c31e397 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b4ba536-4de5-4f0e-9cb0-cc08d8616e5d", "name": "network-vif-plugged", "status": "completed", "tag": "e9253754-0efa-4648-94ae-780814a11e89"}]} {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:30:21.177860 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:30:21.177860 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: warnings.warn(msg) Feb 17 04:30:21.197264 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [req-b93cef37-76e1-4793-b793-a490ff61fcc9 req-b6a52aa3-389d-4f9d-9b63-e3290c31e397 service nova] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:21.197771 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [req-b93cef37-76e1-4793-b793-a490ff61fcc9 req-b6a52aa3-389d-4f9d-9b63-e3290c31e397 service nova] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:21.230667 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.compute.server_external_events [req-b93cef37-76e1-4793-b793-a490ff61fcc9 req-b6a52aa3-389d-4f9d-9b63-e3290c31e397 service nova] Creating event network-vif-plugged:e9253754-0efa-4648-94ae-780814a11e89 for instance 8b4ba536-4de5-4f0e-9cb0-cc08d8616e5d on hv-cinder-75998 Feb 17 04:30:21.236715 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [req-b93cef37-76e1-4793-b793-a490ff61fcc9 req-b6a52aa3-389d-4f9d-9b63-e3290c31e397 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064157 Feb 17 04:30:21.237390 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 152/328] 10.222.0.78 () {64 vars in 1308 bytes} [Wed Feb 17 04:30:21 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:30:21.302212 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-c5bc2ebf-7c62-4ef9-bbf5-8c20cbe819d0 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1daf9a83b1d24033a3d4c0f531a4eb2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5336afdcf4aa4b46b0655432b7a1323c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:30:21.312051 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-c5bc2ebf-7c62-4ef9-bbf5-8c20cbe819d0 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] 10.222.0.78 "GET /compute/v2.1/servers/2fe5b190-5679-4b9d-8d5f-fac1a1c407d9" status: 200 len: 1520 microversion: 2.1 time: 0.285693 Feb 17 04:30:21.312969 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 177/329] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:30:21 2021] GET /compute/v2.1/servers/2fe5b190-5679-4b9d-8d5f-fac1a1c407d9 => generated 1520 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:30:21.372968 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-48c01b07-a4cf-4b76-88c0-3c2b9ebce7c4 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:30:21.373726 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-48c01b07-a4cf-4b76-88c0-3c2b9ebce7c4 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] [instance: 133aedc5-dbda-4b17-93fa-1a41c505a3f5] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:30:21.383447 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-48c01b07-a4cf-4b76-88c0-3c2b9ebce7c4 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:21.384015 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-48c01b07-a4cf-4b76-88c0-3c2b9ebce7c4 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:21.401596 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-48c01b07-a4cf-4b76-88c0-3c2b9ebce7c4 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:21.402486 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-48c01b07-a4cf-4b76-88c0-3c2b9ebce7c4 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:21.658338 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-56361aa4-bb7b-4d70-9919-3b3cf8353a3c tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:30:21.659602 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-56361aa4-bb7b-4d70-9919-3b3cf8353a3c tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] [instance: 8b4ba536-4de5-4f0e-9cb0-cc08d8616e5d] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:30:21.668437 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-56361aa4-bb7b-4d70-9919-3b3cf8353a3c tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:21.668956 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-56361aa4-bb7b-4d70-9919-3b3cf8353a3c tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:21.669869 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-56361aa4-bb7b-4d70-9919-3b3cf8353a3c tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:21.670370 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-56361aa4-bb7b-4d70-9919-3b3cf8353a3c tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:21.918840 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-56361aa4-bb7b-4d70-9919-3b3cf8353a3c tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b4f65f82a97499dbb900d523924e946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440d4048a9ad43869a00218c7acb9614', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:30:21.928262 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-56361aa4-bb7b-4d70-9919-3b3cf8353a3c tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] 10.222.0.78 "GET /compute/v2.1/servers/8b4ba536-4de5-4f0e-9cb0-cc08d8616e5d" status: 200 len: 1319 microversion: 2.1 time: 0.274212 Feb 17 04:30:21.929176 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 178/330] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:30:21 2021] GET /compute/v2.1/servers/8b4ba536-4de5-4f0e-9cb0-cc08d8616e5d => generated 1319 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:30:21.934087 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-3641e0c3-4ea9-4e82-88ad-5c633d660bb6 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:30:21.935368 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-3641e0c3-4ea9-4e82-88ad-5c633d660bb6 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: 29d1ce27-f63b-4523-88be-55f65a6a2529] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:30:21.943268 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-3641e0c3-4ea9-4e82-88ad-5c633d660bb6 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:21.943706 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-3641e0c3-4ea9-4e82-88ad-5c633d660bb6 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:21.945344 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-3641e0c3-4ea9-4e82-88ad-5c633d660bb6 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:21.945958 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-3641e0c3-4ea9-4e82-88ad-5c633d660bb6 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:22.094948 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-3641e0c3-4ea9-4e82-88ad-5c633d660bb6 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "POST /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529/action" status: 200 len: 27830 microversion: 2.1 time: 0.163829 Feb 17 04:30:22.097208 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 179/331] 10.222.0.78 () {60 vars in 1268 bytes} [Wed Feb 17 04:30:21 2021] POST /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529/action => generated 27830 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 04:30:22.127949 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-48c01b07-a4cf-4b76-88c0-3c2b9ebce7c4 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88eaaf0dd96340229d9f519b3489cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0608d586fdf4ba4b2b7f7137d49389a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:30:22.153200 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-48c01b07-a4cf-4b76-88c0-3c2b9ebce7c4 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] 10.222.0.78 "GET /compute/v2.1/servers/133aedc5-dbda-4b17-93fa-1a41c505a3f5" status: 200 len: 1314 microversion: 2.1 time: 0.784612 Feb 17 04:30:22.159618 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 153/332] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:30:21 2021] GET /compute/v2.1/servers/133aedc5-dbda-4b17-93fa-1a41c505a3f5 => generated 1314 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:30:22.189158 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-fac4bacb-bfca-4834-b9f5-ea195c1824be tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:30:22.193601 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-fac4bacb-bfca-4834-b9f5-ea195c1824be tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] [instance: 555b8368-f196-4c6c-acf7-bc67d324c98a] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:30:22.199579 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-fac4bacb-bfca-4834-b9f5-ea195c1824be tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:22.200120 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-fac4bacb-bfca-4834-b9f5-ea195c1824be tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:22.201024 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-fac4bacb-bfca-4834-b9f5-ea195c1824be tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:22.201513 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-fac4bacb-bfca-4834-b9f5-ea195c1824be tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:22.331586 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-17e0985f-4239-4540-9fce-86cd93ec4997 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:30:22.332258 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-17e0985f-4239-4540-9fce-86cd93ec4997 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] [instance: 2fe5b190-5679-4b9d-8d5f-fac1a1c407d9] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:30:22.340943 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-17e0985f-4239-4540-9fce-86cd93ec4997 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:22.341450 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-17e0985f-4239-4540-9fce-86cd93ec4997 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:22.342279 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-17e0985f-4239-4540-9fce-86cd93ec4997 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:22.342773 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-17e0985f-4239-4540-9fce-86cd93ec4997 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:22.426795 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-fac4bacb-bfca-4834-b9f5-ea195c1824be tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d68d4a6c12e4331b8df8191cdd7a669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2a1ca6347d4278899a1cc009d87d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:30:22.436497 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-fac4bacb-bfca-4834-b9f5-ea195c1824be tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] 10.222.0.78 "GET /compute/v2.1/servers/555b8368-f196-4c6c-acf7-bc67d324c98a" status: 200 len: 1317 microversion: 2.1 time: 0.251813 Feb 17 04:30:22.437152 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 180/333] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:30:22 2021] GET /compute/v2.1/servers/555b8368-f196-4c6c-acf7-bc67d324c98a => generated 1317 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:30:22.705613 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-17e0985f-4239-4540-9fce-86cd93ec4997 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1daf9a83b1d24033a3d4c0f531a4eb2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5336afdcf4aa4b46b0655432b7a1323c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:30:22.714708 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-17e0985f-4239-4540-9fce-86cd93ec4997 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] 10.222.0.78 "GET /compute/v2.1/servers/2fe5b190-5679-4b9d-8d5f-fac1a1c407d9" status: 200 len: 1520 microversion: 2.1 time: 0.387274 Feb 17 04:30:22.715346 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 154/334] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:30:22 2021] GET /compute/v2.1/servers/2fe5b190-5679-4b9d-8d5f-fac1a1c407d9 => generated 1520 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:30:22.946422 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-fef2bd6e-af10-4294-aabd-bad86d7be954 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:30:22.947082 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-fef2bd6e-af10-4294-aabd-bad86d7be954 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] [instance: 8b4ba536-4de5-4f0e-9cb0-cc08d8616e5d] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:30:22.955065 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-fef2bd6e-af10-4294-aabd-bad86d7be954 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:22.955585 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-fef2bd6e-af10-4294-aabd-bad86d7be954 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:22.956430 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-fef2bd6e-af10-4294-aabd-bad86d7be954 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:22.956926 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-fef2bd6e-af10-4294-aabd-bad86d7be954 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:23.107241 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-68327d8a-33b8-45b7-85a4-cceb38cae676 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:30:23.108518 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-68327d8a-33b8-45b7-85a4-cceb38cae676 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: 29d1ce27-f63b-4523-88be-55f65a6a2529] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:30:23.120972 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-68327d8a-33b8-45b7-85a4-cceb38cae676 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:23.122260 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-68327d8a-33b8-45b7-85a4-cceb38cae676 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:23.123687 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-68327d8a-33b8-45b7-85a4-cceb38cae676 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:23.124482 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-68327d8a-33b8-45b7-85a4-cceb38cae676 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:23.204861 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-fef2bd6e-af10-4294-aabd-bad86d7be954 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b4f65f82a97499dbb900d523924e946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440d4048a9ad43869a00218c7acb9614', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:30:23.214292 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-fef2bd6e-af10-4294-aabd-bad86d7be954 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] 10.222.0.78 "GET /compute/v2.1/servers/8b4ba536-4de5-4f0e-9cb0-cc08d8616e5d" status: 200 len: 1319 microversion: 2.1 time: 0.272356 Feb 17 04:30:23.218657 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 181/335] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:30:22 2021] GET /compute/v2.1/servers/8b4ba536-4de5-4f0e-9cb0-cc08d8616e5d => generated 1319 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:30:23.235971 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-edff610d-94af-4f49-bdc9-63036036f957 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:30:23.236772 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-edff610d-94af-4f49-bdc9-63036036f957 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] [instance: 133aedc5-dbda-4b17-93fa-1a41c505a3f5] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:30:23.245919 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-edff610d-94af-4f49-bdc9-63036036f957 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:23.246780 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-edff610d-94af-4f49-bdc9-63036036f957 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:23.247806 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-edff610d-94af-4f49-bdc9-63036036f957 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:23.248525 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-edff610d-94af-4f49-bdc9-63036036f957 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:23.463604 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-edff610d-94af-4f49-bdc9-63036036f957 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88eaaf0dd96340229d9f519b3489cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0608d586fdf4ba4b2b7f7137d49389a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:30:23.472601 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-edff610d-94af-4f49-bdc9-63036036f957 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] 10.222.0.78 "GET /compute/v2.1/servers/133aedc5-dbda-4b17-93fa-1a41c505a3f5" status: 200 len: 1314 microversion: 2.1 time: 0.251282 Feb 17 04:30:23.473182 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 182/336] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:30:23 2021] GET /compute/v2.1/servers/133aedc5-dbda-4b17-93fa-1a41c505a3f5 => generated 1314 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:30:23.478823 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-ffaf63f4-2cc6-4377-929c-8fb277b4f5f2 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:30:23.479728 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-ffaf63f4-2cc6-4377-929c-8fb277b4f5f2 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] [instance: 555b8368-f196-4c6c-acf7-bc67d324c98a] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:30:23.488072 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-ffaf63f4-2cc6-4377-929c-8fb277b4f5f2 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:23.488638 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-ffaf63f4-2cc6-4377-929c-8fb277b4f5f2 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:23.489741 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-ffaf63f4-2cc6-4377-929c-8fb277b4f5f2 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:23.490308 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-ffaf63f4-2cc6-4377-929c-8fb277b4f5f2 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:23.711522 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-ffaf63f4-2cc6-4377-929c-8fb277b4f5f2 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d68d4a6c12e4331b8df8191cdd7a669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2a1ca6347d4278899a1cc009d87d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:30:23.720231 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-ffaf63f4-2cc6-4377-929c-8fb277b4f5f2 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] 10.222.0.78 "GET /compute/v2.1/servers/555b8368-f196-4c6c-acf7-bc67d324c98a" status: 200 len: 1317 microversion: 2.1 time: 0.245500 Feb 17 04:30:23.720828 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 183/337] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:30:23 2021] GET /compute/v2.1/servers/555b8368-f196-4c6c-acf7-bc67d324c98a => generated 1317 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:30:23.732576 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-a7d8eb91-05a7-41de-8598-142a84b292e0 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:30:23.733241 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-a7d8eb91-05a7-41de-8598-142a84b292e0 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] [instance: 2fe5b190-5679-4b9d-8d5f-fac1a1c407d9] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:30:23.741515 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-a7d8eb91-05a7-41de-8598-142a84b292e0 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:23.742193 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-a7d8eb91-05a7-41de-8598-142a84b292e0 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:23.743073 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-a7d8eb91-05a7-41de-8598-142a84b292e0 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:23.743699 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-a7d8eb91-05a7-41de-8598-142a84b292e0 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:23.958847 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-a7d8eb91-05a7-41de-8598-142a84b292e0 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1daf9a83b1d24033a3d4c0f531a4eb2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5336afdcf4aa4b46b0655432b7a1323c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:30:23.967787 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-a7d8eb91-05a7-41de-8598-142a84b292e0 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] 10.222.0.78 "GET /compute/v2.1/servers/2fe5b190-5679-4b9d-8d5f-fac1a1c407d9" status: 200 len: 1520 microversion: 2.1 time: 0.238941 Feb 17 04:30:23.968387 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 184/338] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:30:23 2021] GET /compute/v2.1/servers/2fe5b190-5679-4b9d-8d5f-fac1a1c407d9 => generated 1520 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:30:24.236851 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-d059834d-c6e2-4c7f-b8a0-7aa46e04d1e3 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:30:24.237960 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-d059834d-c6e2-4c7f-b8a0-7aa46e04d1e3 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] [instance: 8b4ba536-4de5-4f0e-9cb0-cc08d8616e5d] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:30:24.246234 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-d059834d-c6e2-4c7f-b8a0-7aa46e04d1e3 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:24.246751 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-d059834d-c6e2-4c7f-b8a0-7aa46e04d1e3 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:24.247671 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-d059834d-c6e2-4c7f-b8a0-7aa46e04d1e3 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:24.248174 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-d059834d-c6e2-4c7f-b8a0-7aa46e04d1e3 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:24.458697 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-d059834d-c6e2-4c7f-b8a0-7aa46e04d1e3 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b4f65f82a97499dbb900d523924e946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440d4048a9ad43869a00218c7acb9614', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:30:24.468016 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-d059834d-c6e2-4c7f-b8a0-7aa46e04d1e3 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] 10.222.0.78 "GET /compute/v2.1/servers/8b4ba536-4de5-4f0e-9cb0-cc08d8616e5d" status: 200 len: 1319 microversion: 2.1 time: 0.235652 Feb 17 04:30:24.468630 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 185/339] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:30:24 2021] GET /compute/v2.1/servers/8b4ba536-4de5-4f0e-9cb0-cc08d8616e5d => generated 1319 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:30:24.490760 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-49dbfef9-fca1-40e7-972d-6df744069fdb tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:30:24.491622 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-49dbfef9-fca1-40e7-972d-6df744069fdb tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] [instance: 133aedc5-dbda-4b17-93fa-1a41c505a3f5] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:30:24.499155 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-49dbfef9-fca1-40e7-972d-6df744069fdb tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:24.499666 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-49dbfef9-fca1-40e7-972d-6df744069fdb tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:24.500512 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-49dbfef9-fca1-40e7-972d-6df744069fdb tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:24.501006 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-49dbfef9-fca1-40e7-972d-6df744069fdb tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:24.719083 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-49dbfef9-fca1-40e7-972d-6df744069fdb tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88eaaf0dd96340229d9f519b3489cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0608d586fdf4ba4b2b7f7137d49389a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:30:24.729146 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-49dbfef9-fca1-40e7-972d-6df744069fdb tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] 10.222.0.78 "GET /compute/v2.1/servers/133aedc5-dbda-4b17-93fa-1a41c505a3f5" status: 200 len: 1314 microversion: 2.1 time: 0.242365 Feb 17 04:30:24.729851 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 186/340] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:30:24 2021] GET /compute/v2.1/servers/133aedc5-dbda-4b17-93fa-1a41c505a3f5 => generated 1314 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:30:24.739982 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-39b1aba1-f2f1-4a0c-a4cb-031ed44c2754 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:30:24.740655 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-39b1aba1-f2f1-4a0c-a4cb-031ed44c2754 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] [instance: 555b8368-f196-4c6c-acf7-bc67d324c98a] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:30:24.748476 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-39b1aba1-f2f1-4a0c-a4cb-031ed44c2754 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:24.748923 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-39b1aba1-f2f1-4a0c-a4cb-031ed44c2754 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:24.749755 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-39b1aba1-f2f1-4a0c-a4cb-031ed44c2754 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:24.750242 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-39b1aba1-f2f1-4a0c-a4cb-031ed44c2754 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:24.960548 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-39b1aba1-f2f1-4a0c-a4cb-031ed44c2754 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d68d4a6c12e4331b8df8191cdd7a669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2a1ca6347d4278899a1cc009d87d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:30:24.969243 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-39b1aba1-f2f1-4a0c-a4cb-031ed44c2754 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] 10.222.0.78 "GET /compute/v2.1/servers/555b8368-f196-4c6c-acf7-bc67d324c98a" status: 200 len: 1317 microversion: 2.1 time: 0.233351 Feb 17 04:30:24.969854 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 187/341] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:30:24 2021] GET /compute/v2.1/servers/555b8368-f196-4c6c-acf7-bc67d324c98a => generated 1317 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:30:24.985364 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-d5513d63-2962-4efd-b4f7-ea8b3eee268d tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:30:24.986048 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-d5513d63-2962-4efd-b4f7-ea8b3eee268d tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] [instance: 2fe5b190-5679-4b9d-8d5f-fac1a1c407d9] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:30:24.994860 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-d5513d63-2962-4efd-b4f7-ea8b3eee268d tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:24.995398 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-d5513d63-2962-4efd-b4f7-ea8b3eee268d tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:24.996228 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-d5513d63-2962-4efd-b4f7-ea8b3eee268d tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:24.996720 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-d5513d63-2962-4efd-b4f7-ea8b3eee268d tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:25.212860 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-d5513d63-2962-4efd-b4f7-ea8b3eee268d tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1daf9a83b1d24033a3d4c0f531a4eb2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5336afdcf4aa4b46b0655432b7a1323c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:30:25.221737 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-d5513d63-2962-4efd-b4f7-ea8b3eee268d tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] 10.222.0.78 "GET /compute/v2.1/servers/2fe5b190-5679-4b9d-8d5f-fac1a1c407d9" status: 200 len: 1520 microversion: 2.1 time: 0.240003 Feb 17 04:30:25.222340 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 188/342] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:30:24 2021] GET /compute/v2.1/servers/2fe5b190-5679-4b9d-8d5f-fac1a1c407d9 => generated 1520 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:30:25.489195 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-298a7ffa-3db9-4fbb-a2b7-b8cab764fdbb tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:30:25.489195 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-298a7ffa-3db9-4fbb-a2b7-b8cab764fdbb tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] [instance: 8b4ba536-4de5-4f0e-9cb0-cc08d8616e5d] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:30:25.494479 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-298a7ffa-3db9-4fbb-a2b7-b8cab764fdbb tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:25.494973 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-298a7ffa-3db9-4fbb-a2b7-b8cab764fdbb tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:25.495825 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-298a7ffa-3db9-4fbb-a2b7-b8cab764fdbb tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:25.496313 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-298a7ffa-3db9-4fbb-a2b7-b8cab764fdbb tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:25.710384 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-298a7ffa-3db9-4fbb-a2b7-b8cab764fdbb tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b4f65f82a97499dbb900d523924e946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440d4048a9ad43869a00218c7acb9614', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:30:25.719133 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-298a7ffa-3db9-4fbb-a2b7-b8cab764fdbb tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] 10.222.0.78 "GET /compute/v2.1/servers/8b4ba536-4de5-4f0e-9cb0-cc08d8616e5d" status: 200 len: 1319 microversion: 2.1 time: 0.237173 Feb 17 04:30:25.719733 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 189/343] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:30:25 2021] GET /compute/v2.1/servers/8b4ba536-4de5-4f0e-9cb0-cc08d8616e5d => generated 1319 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:30:25.747619 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-b4839961-753a-4a9e-a0a0-c8d4fb218564 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:30:25.748291 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-b4839961-753a-4a9e-a0a0-c8d4fb218564 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] [instance: 133aedc5-dbda-4b17-93fa-1a41c505a3f5] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:30:25.755989 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-b4839961-753a-4a9e-a0a0-c8d4fb218564 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:25.756502 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-b4839961-753a-4a9e-a0a0-c8d4fb218564 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:25.757466 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-b4839961-753a-4a9e-a0a0-c8d4fb218564 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:25.757955 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-b4839961-753a-4a9e-a0a0-c8d4fb218564 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:26.098814 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-b4839961-753a-4a9e-a0a0-c8d4fb218564 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88eaaf0dd96340229d9f519b3489cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0608d586fdf4ba4b2b7f7137d49389a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:30:26.108104 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-b4839961-753a-4a9e-a0a0-c8d4fb218564 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] 10.222.0.78 "GET /compute/v2.1/servers/133aedc5-dbda-4b17-93fa-1a41c505a3f5" status: 200 len: 1314 microversion: 2.1 time: 0.364159 Feb 17 04:30:26.108702 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 190/344] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:30:25 2021] GET /compute/v2.1/servers/133aedc5-dbda-4b17-93fa-1a41c505a3f5 => generated 1314 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:30:26.113558 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-0a513f6c-9bba-4f26-9443-8c0158b86e5b tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:30:26.114222 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-0a513f6c-9bba-4f26-9443-8c0158b86e5b tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] [instance: 555b8368-f196-4c6c-acf7-bc67d324c98a] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:30:26.122221 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-0a513f6c-9bba-4f26-9443-8c0158b86e5b tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:26.122729 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-0a513f6c-9bba-4f26-9443-8c0158b86e5b tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:26.123593 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-0a513f6c-9bba-4f26-9443-8c0158b86e5b tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:26.124090 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-0a513f6c-9bba-4f26-9443-8c0158b86e5b tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:26.337419 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-0a513f6c-9bba-4f26-9443-8c0158b86e5b tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d68d4a6c12e4331b8df8191cdd7a669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2a1ca6347d4278899a1cc009d87d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:30:26.346236 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-0a513f6c-9bba-4f26-9443-8c0158b86e5b tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] 10.222.0.78 "GET /compute/v2.1/servers/555b8368-f196-4c6c-acf7-bc67d324c98a" status: 200 len: 1317 microversion: 2.1 time: 0.236519 Feb 17 04:30:26.346834 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 191/345] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:30:26 2021] GET /compute/v2.1/servers/555b8368-f196-4c6c-acf7-bc67d324c98a => generated 1317 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:30:26.352023 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-9d65f5bc-a31a-473e-818b-569c2630e525 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:30:26.352681 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-9d65f5bc-a31a-473e-818b-569c2630e525 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] [instance: 2fe5b190-5679-4b9d-8d5f-fac1a1c407d9] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:30:26.360071 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-9d65f5bc-a31a-473e-818b-569c2630e525 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:26.360575 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-9d65f5bc-a31a-473e-818b-569c2630e525 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:26.361412 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-9d65f5bc-a31a-473e-818b-569c2630e525 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:26.361904 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-9d65f5bc-a31a-473e-818b-569c2630e525 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:26.575617 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-9d65f5bc-a31a-473e-818b-569c2630e525 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1daf9a83b1d24033a3d4c0f531a4eb2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5336afdcf4aa4b46b0655432b7a1323c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:30:26.584536 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-9d65f5bc-a31a-473e-818b-569c2630e525 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] 10.222.0.78 "GET /compute/v2.1/servers/2fe5b190-5679-4b9d-8d5f-fac1a1c407d9" status: 200 len: 1520 microversion: 2.1 time: 0.236529 Feb 17 04:30:26.585767 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 192/346] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:30:26 2021] GET /compute/v2.1/servers/2fe5b190-5679-4b9d-8d5f-fac1a1c407d9 => generated 1520 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:30:26.737896 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-eab99397-2ed0-4abc-9e09-ca88d2327342 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:30:26.738682 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-eab99397-2ed0-4abc-9e09-ca88d2327342 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] [instance: 8b4ba536-4de5-4f0e-9cb0-cc08d8616e5d] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:30:26.746860 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-eab99397-2ed0-4abc-9e09-ca88d2327342 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:26.747413 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-eab99397-2ed0-4abc-9e09-ca88d2327342 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:26.748278 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-eab99397-2ed0-4abc-9e09-ca88d2327342 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:26.748768 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-eab99397-2ed0-4abc-9e09-ca88d2327342 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:26.964441 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-eab99397-2ed0-4abc-9e09-ca88d2327342 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b4f65f82a97499dbb900d523924e946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440d4048a9ad43869a00218c7acb9614', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:30:26.973085 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-eab99397-2ed0-4abc-9e09-ca88d2327342 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] 10.222.0.78 "GET /compute/v2.1/servers/8b4ba536-4de5-4f0e-9cb0-cc08d8616e5d" status: 200 len: 1319 microversion: 2.1 time: 0.239474 Feb 17 04:30:26.973673 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 193/347] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:30:26 2021] GET /compute/v2.1/servers/8b4ba536-4de5-4f0e-9cb0-cc08d8616e5d => generated 1319 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:30:27.126496 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-da2e1982-fa57-4bbd-a855-b67ebe77dab4 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:30:27.127142 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-da2e1982-fa57-4bbd-a855-b67ebe77dab4 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] [instance: 133aedc5-dbda-4b17-93fa-1a41c505a3f5] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:30:27.136241 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-da2e1982-fa57-4bbd-a855-b67ebe77dab4 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:27.136903 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-da2e1982-fa57-4bbd-a855-b67ebe77dab4 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:27.137798 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-da2e1982-fa57-4bbd-a855-b67ebe77dab4 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:27.138297 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-da2e1982-fa57-4bbd-a855-b67ebe77dab4 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:27.353749 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-da2e1982-fa57-4bbd-a855-b67ebe77dab4 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88eaaf0dd96340229d9f519b3489cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0608d586fdf4ba4b2b7f7137d49389a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:30:27.362821 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-da2e1982-fa57-4bbd-a855-b67ebe77dab4 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] 10.222.0.78 "GET /compute/v2.1/servers/133aedc5-dbda-4b17-93fa-1a41c505a3f5" status: 200 len: 1314 microversion: 2.1 time: 0.239969 Feb 17 04:30:27.363445 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 194/348] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:30:27 2021] GET /compute/v2.1/servers/133aedc5-dbda-4b17-93fa-1a41c505a3f5 => generated 1314 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:30:27.368232 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-a577d808-f948-42d6-b2db-6f0d0b489397 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:30:27.368893 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-a577d808-f948-42d6-b2db-6f0d0b489397 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] [instance: 555b8368-f196-4c6c-acf7-bc67d324c98a] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:30:27.376262 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-a577d808-f948-42d6-b2db-6f0d0b489397 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:27.376780 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-a577d808-f948-42d6-b2db-6f0d0b489397 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:27.377562 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-a577d808-f948-42d6-b2db-6f0d0b489397 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:27.378049 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-a577d808-f948-42d6-b2db-6f0d0b489397 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:27.526966 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-68327d8a-33b8-45b7-85a4-cceb38cae676 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "POST /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529/action" status: 200 len: 27957 microversion: 2.1 time: 4.423386 Feb 17 04:30:27.527822 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 155/349] 10.222.0.78 () {60 vars in 1268 bytes} [Wed Feb 17 04:30:23 2021] POST /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529/action => generated 27957 bytes in 4425 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 04:30:27.604861 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-d615e77b-ddd0-404e-9f16-1b383113870c tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:30:27.605697 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-d615e77b-ddd0-404e-9f16-1b383113870c tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] [instance: 2fe5b190-5679-4b9d-8d5f-fac1a1c407d9] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:30:27.615410 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-d615e77b-ddd0-404e-9f16-1b383113870c tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:27.615935 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-d615e77b-ddd0-404e-9f16-1b383113870c tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:27.617552 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-d615e77b-ddd0-404e-9f16-1b383113870c tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:27.617982 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-d615e77b-ddd0-404e-9f16-1b383113870c tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:27.796580 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-a577d808-f948-42d6-b2db-6f0d0b489397 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d68d4a6c12e4331b8df8191cdd7a669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2a1ca6347d4278899a1cc009d87d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:30:27.806333 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-a577d808-f948-42d6-b2db-6f0d0b489397 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] 10.222.0.78 "GET /compute/v2.1/servers/555b8368-f196-4c6c-acf7-bc67d324c98a" status: 200 len: 1317 microversion: 2.1 time: 0.441846 Feb 17 04:30:27.807049 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 195/350] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:30:27 2021] GET /compute/v2.1/servers/555b8368-f196-4c6c-acf7-bc67d324c98a => generated 1317 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:30:27.838946 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-d615e77b-ddd0-404e-9f16-1b383113870c tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1daf9a83b1d24033a3d4c0f531a4eb2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5336afdcf4aa4b46b0655432b7a1323c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:30:27.847845 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-d615e77b-ddd0-404e-9f16-1b383113870c tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] 10.222.0.78 "GET /compute/v2.1/servers/2fe5b190-5679-4b9d-8d5f-fac1a1c407d9" status: 200 len: 1520 microversion: 2.1 time: 0.248293 Feb 17 04:30:27.848420 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 156/351] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:30:27 2021] GET /compute/v2.1/servers/2fe5b190-5679-4b9d-8d5f-fac1a1c407d9 => generated 1520 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:30:27.992081 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-81c4658c-3b10-4da7-864c-ad1a030a61e5 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:30:27.992757 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-81c4658c-3b10-4da7-864c-ad1a030a61e5 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] [instance: 8b4ba536-4de5-4f0e-9cb0-cc08d8616e5d] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:30:28.000821 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-81c4658c-3b10-4da7-864c-ad1a030a61e5 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:28.001330 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-81c4658c-3b10-4da7-864c-ad1a030a61e5 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:28.002165 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-81c4658c-3b10-4da7-864c-ad1a030a61e5 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:28.002656 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-81c4658c-3b10-4da7-864c-ad1a030a61e5 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:28.214679 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-81c4658c-3b10-4da7-864c-ad1a030a61e5 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b4f65f82a97499dbb900d523924e946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440d4048a9ad43869a00218c7acb9614', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:30:28.223487 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-81c4658c-3b10-4da7-864c-ad1a030a61e5 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] 10.222.0.78 "GET /compute/v2.1/servers/8b4ba536-4de5-4f0e-9cb0-cc08d8616e5d" status: 200 len: 1319 microversion: 2.1 time: 0.236405 Feb 17 04:30:28.224086 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 196/352] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:30:27 2021] GET /compute/v2.1/servers/8b4ba536-4de5-4f0e-9cb0-cc08d8616e5d => generated 1319 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:30:28.380778 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-23ef29f7-3ec7-44b2-9b8e-8c8507352655 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:30:28.381459 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-23ef29f7-3ec7-44b2-9b8e-8c8507352655 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] [instance: 133aedc5-dbda-4b17-93fa-1a41c505a3f5] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:30:28.389498 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-23ef29f7-3ec7-44b2-9b8e-8c8507352655 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:28.390009 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-23ef29f7-3ec7-44b2-9b8e-8c8507352655 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:28.390852 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-23ef29f7-3ec7-44b2-9b8e-8c8507352655 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:28.391372 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-23ef29f7-3ec7-44b2-9b8e-8c8507352655 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:28.540665 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-998708b5-9538-4e30-a599-22c89ef30b9c tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:30:28.541814 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-998708b5-9538-4e30-a599-22c89ef30b9c tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: 29d1ce27-f63b-4523-88be-55f65a6a2529] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:30:28.549922 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-998708b5-9538-4e30-a599-22c89ef30b9c tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:28.550431 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-998708b5-9538-4e30-a599-22c89ef30b9c tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:28.551340 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-998708b5-9538-4e30-a599-22c89ef30b9c tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:28.551831 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-998708b5-9538-4e30-a599-22c89ef30b9c tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:28.696762 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-23ef29f7-3ec7-44b2-9b8e-8c8507352655 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88eaaf0dd96340229d9f519b3489cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0608d586fdf4ba4b2b7f7137d49389a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:30:28.705722 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-23ef29f7-3ec7-44b2-9b8e-8c8507352655 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] 10.222.0.78 "GET /compute/v2.1/servers/133aedc5-dbda-4b17-93fa-1a41c505a3f5" status: 200 len: 1314 microversion: 2.1 time: 0.328949 Feb 17 04:30:28.706331 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 157/353] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:30:28 2021] GET /compute/v2.1/servers/133aedc5-dbda-4b17-93fa-1a41c505a3f5 => generated 1314 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:30:28.798658 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-998708b5-9538-4e30-a599-22c89ef30b9c tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "POST /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529/action" status: 200 len: 27957 microversion: 2.1 time: 0.262622 Feb 17 04:30:28.799484 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 197/354] 10.222.0.78 () {60 vars in 1268 bytes} [Wed Feb 17 04:30:28 2021] POST /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529/action => generated 27957 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 17 04:30:28.824967 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-c21bac99-399f-4a2c-87fc-8d9165562578 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:30:28.825642 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-c21bac99-399f-4a2c-87fc-8d9165562578 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] [instance: 555b8368-f196-4c6c-acf7-bc67d324c98a] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:30:28.833575 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-c21bac99-399f-4a2c-87fc-8d9165562578 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:28.834091 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-c21bac99-399f-4a2c-87fc-8d9165562578 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:28.834973 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-c21bac99-399f-4a2c-87fc-8d9165562578 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:28.834973 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-c21bac99-399f-4a2c-87fc-8d9165562578 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:28.867959 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-babe279f-fa84-4501-a9c7-6ecaf3220206 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:30:28.868728 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-babe279f-fa84-4501-a9c7-6ecaf3220206 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] [instance: 2fe5b190-5679-4b9d-8d5f-fac1a1c407d9] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:30:28.877260 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-babe279f-fa84-4501-a9c7-6ecaf3220206 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:28.877766 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-babe279f-fa84-4501-a9c7-6ecaf3220206 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:28.878606 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-babe279f-fa84-4501-a9c7-6ecaf3220206 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:28.879121 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-babe279f-fa84-4501-a9c7-6ecaf3220206 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:29.050697 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-c21bac99-399f-4a2c-87fc-8d9165562578 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d68d4a6c12e4331b8df8191cdd7a669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2a1ca6347d4278899a1cc009d87d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:30:29.060751 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-c21bac99-399f-4a2c-87fc-8d9165562578 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] 10.222.0.78 "GET /compute/v2.1/servers/555b8368-f196-4c6c-acf7-bc67d324c98a" status: 200 len: 1317 microversion: 2.1 time: 0.239859 Feb 17 04:30:29.061458 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 158/355] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:30:28 2021] GET /compute/v2.1/servers/555b8368-f196-4c6c-acf7-bc67d324c98a => generated 1317 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:30:29.102283 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-babe279f-fa84-4501-a9c7-6ecaf3220206 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1daf9a83b1d24033a3d4c0f531a4eb2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5336afdcf4aa4b46b0655432b7a1323c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:30:29.112904 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-babe279f-fa84-4501-a9c7-6ecaf3220206 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] 10.222.0.78 "GET /compute/v2.1/servers/2fe5b190-5679-4b9d-8d5f-fac1a1c407d9" status: 200 len: 1520 microversion: 2.1 time: 0.250517 Feb 17 04:30:29.114221 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 198/356] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:30:28 2021] GET /compute/v2.1/servers/2fe5b190-5679-4b9d-8d5f-fac1a1c407d9 => generated 1520 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:30:29.242399 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-c540f9ed-0c16-4d20-995e-d00a18386979 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:30:29.243100 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-c540f9ed-0c16-4d20-995e-d00a18386979 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] [instance: 8b4ba536-4de5-4f0e-9cb0-cc08d8616e5d] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:30:29.251130 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-c540f9ed-0c16-4d20-995e-d00a18386979 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:29.251654 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-c540f9ed-0c16-4d20-995e-d00a18386979 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:29.252498 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-c540f9ed-0c16-4d20-995e-d00a18386979 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:29.253285 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-c540f9ed-0c16-4d20-995e-d00a18386979 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:29.467227 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-c540f9ed-0c16-4d20-995e-d00a18386979 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b4f65f82a97499dbb900d523924e946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440d4048a9ad43869a00218c7acb9614', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:30:29.476126 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-c540f9ed-0c16-4d20-995e-d00a18386979 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] 10.222.0.78 "GET /compute/v2.1/servers/8b4ba536-4de5-4f0e-9cb0-cc08d8616e5d" status: 200 len: 1319 microversion: 2.1 time: 0.237729 Feb 17 04:30:29.476739 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 159/357] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:30:29 2021] GET /compute/v2.1/servers/8b4ba536-4de5-4f0e-9cb0-cc08d8616e5d => generated 1319 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:30:29.723870 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-c4110552-d7d8-4e2d-9ee5-a8d241930843 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:30:29.724586 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-c4110552-d7d8-4e2d-9ee5-a8d241930843 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] [instance: 133aedc5-dbda-4b17-93fa-1a41c505a3f5] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:30:29.733447 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-c4110552-d7d8-4e2d-9ee5-a8d241930843 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:29.733954 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-c4110552-d7d8-4e2d-9ee5-a8d241930843 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:29.734838 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-c4110552-d7d8-4e2d-9ee5-a8d241930843 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:29.735371 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-c4110552-d7d8-4e2d-9ee5-a8d241930843 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:29.811051 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-e17f4197-fae9-4c17-92dc-ec8e334a96a4 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:30:29.813134 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-e17f4197-fae9-4c17-92dc-ec8e334a96a4 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: 29d1ce27-f63b-4523-88be-55f65a6a2529] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:30:29.826513 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-e17f4197-fae9-4c17-92dc-ec8e334a96a4 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:29.827057 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-e17f4197-fae9-4c17-92dc-ec8e334a96a4 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:29.827881 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-e17f4197-fae9-4c17-92dc-ec8e334a96a4 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:29.828539 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-e17f4197-fae9-4c17-92dc-ec8e334a96a4 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:30.078447 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-c4110552-d7d8-4e2d-9ee5-a8d241930843 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88eaaf0dd96340229d9f519b3489cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0608d586fdf4ba4b2b7f7137d49389a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:30:30.088875 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-c4110552-d7d8-4e2d-9ee5-a8d241930843 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] 10.222.0.78 "GET /compute/v2.1/servers/133aedc5-dbda-4b17-93fa-1a41c505a3f5" status: 200 len: 1314 microversion: 2.1 time: 0.368763 Feb 17 04:30:30.089847 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 199/358] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:30:29 2021] GET /compute/v2.1/servers/133aedc5-dbda-4b17-93fa-1a41c505a3f5 => generated 1314 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:30:30.094678 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [req-ea380202-ec5c-426e-a840-39dbd10190f8 req-d18770d6-0511-4fb1-9003-41ca4071b732 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "555b8368-f196-4c6c-acf7-bc67d324c98a", "name": "network-vif-plugged", "status": "completed", "tag": "65a369ca-8446-46ba-9c26-57d2b73c304a"}]} {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:30:30.096486 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:30:30.096486 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: warnings.warn(msg) Feb 17 04:30:30.100420 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-e17f4197-fae9-4c17-92dc-ec8e334a96a4 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "POST /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529/action" status: 200 len: 28075 microversion: 2.1 time: 0.292826 Feb 17 04:30:30.105831 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 160/359] 10.222.0.78 () {60 vars in 1268 bytes} [Wed Feb 17 04:30:29 2021] POST /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529/action => generated 28075 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 04:30:30.106918 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [req-ea380202-ec5c-426e-a840-39dbd10190f8 req-d18770d6-0511-4fb1-9003-41ca4071b732 service nova] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:30.107585 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [req-ea380202-ec5c-426e-a840-39dbd10190f8 req-d18770d6-0511-4fb1-9003-41ca4071b732 service nova] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:30.111365 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-f942b27a-8425-45de-b1fe-9f915835dd81 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:30:30.112117 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-f942b27a-8425-45de-b1fe-9f915835dd81 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] [instance: 555b8368-f196-4c6c-acf7-bc67d324c98a] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:30:30.122765 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-f942b27a-8425-45de-b1fe-9f915835dd81 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:30.123538 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-f942b27a-8425-45de-b1fe-9f915835dd81 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:30.124542 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-f942b27a-8425-45de-b1fe-9f915835dd81 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:30.125187 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-f942b27a-8425-45de-b1fe-9f915835dd81 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:30.127580 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.compute.server_external_events [req-ea380202-ec5c-426e-a840-39dbd10190f8 req-d18770d6-0511-4fb1-9003-41ca4071b732 service nova] Creating event network-vif-plugged:65a369ca-8446-46ba-9c26-57d2b73c304a for instance 555b8368-f196-4c6c-acf7-bc67d324c98a on hv-cinder-75998 Feb 17 04:30:30.151652 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [req-ea380202-ec5c-426e-a840-39dbd10190f8 req-d18770d6-0511-4fb1-9003-41ca4071b732 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060210 Feb 17 04:30:30.152306 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 200/360] 10.222.0.78 () {64 vars in 1308 bytes} [Wed Feb 17 04:30:30 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:30:30.172284 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-1fca2e17-b49c-4e75-ab7b-848659e8d72d tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:30:30.173054 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-1fca2e17-b49c-4e75-ab7b-848659e8d72d tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] [instance: 2fe5b190-5679-4b9d-8d5f-fac1a1c407d9] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:30:30.208980 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-1fca2e17-b49c-4e75-ab7b-848659e8d72d tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:30.209496 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-1fca2e17-b49c-4e75-ab7b-848659e8d72d tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:30.210514 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-1fca2e17-b49c-4e75-ab7b-848659e8d72d tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:30.211018 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-1fca2e17-b49c-4e75-ab7b-848659e8d72d tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:30.445741 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-f942b27a-8425-45de-b1fe-9f915835dd81 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d68d4a6c12e4331b8df8191cdd7a669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2a1ca6347d4278899a1cc009d87d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:30:30.456106 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-f942b27a-8425-45de-b1fe-9f915835dd81 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] 10.222.0.78 "GET /compute/v2.1/servers/555b8368-f196-4c6c-acf7-bc67d324c98a" status: 200 len: 1317 microversion: 2.1 time: 0.348924 Feb 17 04:30:30.467092 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 161/361] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:30:30 2021] GET /compute/v2.1/servers/555b8368-f196-4c6c-acf7-bc67d324c98a => generated 1317 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:30:30.495331 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-6a2fe595-2553-4496-b644-853123d41391 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:30:30.496012 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-6a2fe595-2553-4496-b644-853123d41391 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] [instance: 8b4ba536-4de5-4f0e-9cb0-cc08d8616e5d] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:30:30.516724 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-6a2fe595-2553-4496-b644-853123d41391 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:30.517242 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-6a2fe595-2553-4496-b644-853123d41391 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:30.518697 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-6a2fe595-2553-4496-b644-853123d41391 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:30.520552 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-6a2fe595-2553-4496-b644-853123d41391 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:30.615996 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-1fca2e17-b49c-4e75-ab7b-848659e8d72d tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1daf9a83b1d24033a3d4c0f531a4eb2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5336afdcf4aa4b46b0655432b7a1323c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:30:30.626119 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-1fca2e17-b49c-4e75-ab7b-848659e8d72d tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] 10.222.0.78 "GET /compute/v2.1/servers/2fe5b190-5679-4b9d-8d5f-fac1a1c407d9" status: 200 len: 1520 microversion: 2.1 time: 0.458289 Feb 17 04:30:30.631087 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 201/362] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:30:30 2021] GET /compute/v2.1/servers/2fe5b190-5679-4b9d-8d5f-fac1a1c407d9 => generated 1520 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:30:30.781069 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-6a2fe595-2553-4496-b644-853123d41391 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b4f65f82a97499dbb900d523924e946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440d4048a9ad43869a00218c7acb9614', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:30:30.791169 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-6a2fe595-2553-4496-b644-853123d41391 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] 10.222.0.78 "GET /compute/v2.1/servers/8b4ba536-4de5-4f0e-9cb0-cc08d8616e5d" status: 200 len: 1508 microversion: 2.1 time: 0.300894 Feb 17 04:30:30.791988 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 162/363] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:30:30 2021] GET /compute/v2.1/servers/8b4ba536-4de5-4f0e-9cb0-cc08d8616e5d => generated 1508 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:30:31.107104 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-59f9ba1b-f820-4115-922e-a6fec9d2c154 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:30:31.108436 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-59f9ba1b-f820-4115-922e-a6fec9d2c154 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] [instance: 133aedc5-dbda-4b17-93fa-1a41c505a3f5] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:30:31.113638 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-7efb7137-8b4b-43cd-a637-02ffab80e7a2 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:30:31.114684 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-7efb7137-8b4b-43cd-a637-02ffab80e7a2 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: 29d1ce27-f63b-4523-88be-55f65a6a2529] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:30:31.117639 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-59f9ba1b-f820-4115-922e-a6fec9d2c154 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:31.118152 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-59f9ba1b-f820-4115-922e-a6fec9d2c154 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:31.118995 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-59f9ba1b-f820-4115-922e-a6fec9d2c154 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:31.119508 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-59f9ba1b-f820-4115-922e-a6fec9d2c154 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:31.123771 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-7efb7137-8b4b-43cd-a637-02ffab80e7a2 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:31.124284 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-7efb7137-8b4b-43cd-a637-02ffab80e7a2 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:31.125133 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-7efb7137-8b4b-43cd-a637-02ffab80e7a2 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:31.125625 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-7efb7137-8b4b-43cd-a637-02ffab80e7a2 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:31.346587 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-59f9ba1b-f820-4115-922e-a6fec9d2c154 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88eaaf0dd96340229d9f519b3489cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0608d586fdf4ba4b2b7f7137d49389a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:30:31.356503 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-59f9ba1b-f820-4115-922e-a6fec9d2c154 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] 10.222.0.78 "GET /compute/v2.1/servers/133aedc5-dbda-4b17-93fa-1a41c505a3f5" status: 200 len: 1314 microversion: 2.1 time: 0.253665 Feb 17 04:30:31.359136 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 202/364] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:30:31 2021] GET /compute/v2.1/servers/133aedc5-dbda-4b17-93fa-1a41c505a3f5 => generated 1314 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:30:31.368398 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-7efb7137-8b4b-43cd-a637-02ffab80e7a2 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "POST /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529/action" status: 200 len: 28192 microversion: 2.1 time: 0.258720 Feb 17 04:30:31.369303 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 163/365] 10.222.0.78 () {60 vars in 1268 bytes} [Wed Feb 17 04:30:31 2021] POST /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529/action => generated 28192 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 04:30:31.484573 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-f71ca6ab-56db-4e6c-9c5c-06db6a468168 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:30:31.485391 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-f71ca6ab-56db-4e6c-9c5c-06db6a468168 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] [instance: 555b8368-f196-4c6c-acf7-bc67d324c98a] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:30:31.493550 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-f71ca6ab-56db-4e6c-9c5c-06db6a468168 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:31.494060 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-f71ca6ab-56db-4e6c-9c5c-06db6a468168 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:31.494912 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-f71ca6ab-56db-4e6c-9c5c-06db6a468168 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:31.495464 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-f71ca6ab-56db-4e6c-9c5c-06db6a468168 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:31.652240 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-d41af8d4-cffe-4694-a26e-4c3fdda18768 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:30:31.653673 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-d41af8d4-cffe-4694-a26e-4c3fdda18768 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] [instance: 2fe5b190-5679-4b9d-8d5f-fac1a1c407d9] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:30:31.670550 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-d41af8d4-cffe-4694-a26e-4c3fdda18768 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:31.674487 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-d41af8d4-cffe-4694-a26e-4c3fdda18768 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:31.675463 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-d41af8d4-cffe-4694-a26e-4c3fdda18768 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:31.675975 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-d41af8d4-cffe-4694-a26e-4c3fdda18768 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:31.800246 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-f71ca6ab-56db-4e6c-9c5c-06db6a468168 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d68d4a6c12e4331b8df8191cdd7a669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2a1ca6347d4278899a1cc009d87d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:30:31.809643 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-f71ca6ab-56db-4e6c-9c5c-06db6a468168 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] 10.222.0.78 "GET /compute/v2.1/servers/555b8368-f196-4c6c-acf7-bc67d324c98a" status: 200 len: 1317 microversion: 2.1 time: 0.328978 Feb 17 04:30:31.810860 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 203/366] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:30:31 2021] GET /compute/v2.1/servers/555b8368-f196-4c6c-acf7-bc67d324c98a => generated 1317 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:30:31.940399 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-d41af8d4-cffe-4694-a26e-4c3fdda18768 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1daf9a83b1d24033a3d4c0f531a4eb2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5336afdcf4aa4b46b0655432b7a1323c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:30:31.950175 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-d41af8d4-cffe-4694-a26e-4c3fdda18768 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] 10.222.0.78 "GET /compute/v2.1/servers/2fe5b190-5679-4b9d-8d5f-fac1a1c407d9" status: 200 len: 1520 microversion: 2.1 time: 0.308673 Feb 17 04:30:31.950925 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 164/367] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:30:31 2021] GET /compute/v2.1/servers/2fe5b190-5679-4b9d-8d5f-fac1a1c407d9 => generated 1520 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:30:32.374995 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-ff111ff1-c466-4f93-a8b5-018b95c46cb1 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:30:32.375636 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-ff111ff1-c466-4f93-a8b5-018b95c46cb1 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] [instance: 133aedc5-dbda-4b17-93fa-1a41c505a3f5] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:30:32.381544 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-055eb698-ccb5-4ee4-b816-96425e9b7b22 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:30:32.383555 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-055eb698-ccb5-4ee4-b816-96425e9b7b22 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: 29d1ce27-f63b-4523-88be-55f65a6a2529] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:30:32.384817 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-ff111ff1-c466-4f93-a8b5-018b95c46cb1 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:32.385327 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-ff111ff1-c466-4f93-a8b5-018b95c46cb1 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:32.386177 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-ff111ff1-c466-4f93-a8b5-018b95c46cb1 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:32.386694 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-ff111ff1-c466-4f93-a8b5-018b95c46cb1 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:32.391504 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-055eb698-ccb5-4ee4-b816-96425e9b7b22 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:32.392016 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-055eb698-ccb5-4ee4-b816-96425e9b7b22 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:32.392851 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-055eb698-ccb5-4ee4-b816-96425e9b7b22 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:32.393345 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-055eb698-ccb5-4ee4-b816-96425e9b7b22 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:32.603239 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-ff111ff1-c466-4f93-a8b5-018b95c46cb1 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88eaaf0dd96340229d9f519b3489cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0608d586fdf4ba4b2b7f7137d49389a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:30:32.612079 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-ff111ff1-c466-4f93-a8b5-018b95c46cb1 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] 10.222.0.78 "GET /compute/v2.1/servers/133aedc5-dbda-4b17-93fa-1a41c505a3f5" status: 200 len: 1314 microversion: 2.1 time: 0.241300 Feb 17 04:30:32.612952 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 204/368] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:30:32 2021] GET /compute/v2.1/servers/133aedc5-dbda-4b17-93fa-1a41c505a3f5 => generated 1314 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:30:32.829196 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-35137293-06fa-4afc-b098-52ec051d8ee7 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:30:32.829875 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-35137293-06fa-4afc-b098-52ec051d8ee7 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] [instance: 555b8368-f196-4c6c-acf7-bc67d324c98a] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:30:32.838347 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-35137293-06fa-4afc-b098-52ec051d8ee7 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:32.838860 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-35137293-06fa-4afc-b098-52ec051d8ee7 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:32.839726 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-35137293-06fa-4afc-b098-52ec051d8ee7 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:32.840221 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-35137293-06fa-4afc-b098-52ec051d8ee7 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:33.057493 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-35137293-06fa-4afc-b098-52ec051d8ee7 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d68d4a6c12e4331b8df8191cdd7a669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2a1ca6347d4278899a1cc009d87d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:30:33.066359 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-35137293-06fa-4afc-b098-52ec051d8ee7 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] 10.222.0.78 "GET /compute/v2.1/servers/555b8368-f196-4c6c-acf7-bc67d324c98a" status: 200 len: 1317 microversion: 2.1 time: 0.241234 Feb 17 04:30:33.066943 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 205/369] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:30:32 2021] GET /compute/v2.1/servers/555b8368-f196-4c6c-acf7-bc67d324c98a => generated 1317 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:30:33.071816 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-18f800ff-ad64-4acc-b496-4680233ecfca tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:30:33.072533 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-18f800ff-ad64-4acc-b496-4680233ecfca tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] [instance: 2fe5b190-5679-4b9d-8d5f-fac1a1c407d9] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:30:33.080373 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-18f800ff-ad64-4acc-b496-4680233ecfca tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:33.080886 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-18f800ff-ad64-4acc-b496-4680233ecfca tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:33.081730 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-18f800ff-ad64-4acc-b496-4680233ecfca tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:33.082228 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-18f800ff-ad64-4acc-b496-4680233ecfca tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:33.301223 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-18f800ff-ad64-4acc-b496-4680233ecfca tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1daf9a83b1d24033a3d4c0f531a4eb2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5336afdcf4aa4b46b0655432b7a1323c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:30:33.310200 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-18f800ff-ad64-4acc-b496-4680233ecfca tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] 10.222.0.78 "GET /compute/v2.1/servers/2fe5b190-5679-4b9d-8d5f-fac1a1c407d9" status: 200 len: 1520 microversion: 2.1 time: 0.242016 Feb 17 04:30:33.310802 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 206/370] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:30:33 2021] GET /compute/v2.1/servers/2fe5b190-5679-4b9d-8d5f-fac1a1c407d9 => generated 1520 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:30:33.629825 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-2c7352fb-e42f-4d69-bbba-e20c7a908d41 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:30:33.630491 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-2c7352fb-e42f-4d69-bbba-e20c7a908d41 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] [instance: 133aedc5-dbda-4b17-93fa-1a41c505a3f5] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:30:33.638997 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-2c7352fb-e42f-4d69-bbba-e20c7a908d41 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:33.639546 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-2c7352fb-e42f-4d69-bbba-e20c7a908d41 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:33.640368 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-2c7352fb-e42f-4d69-bbba-e20c7a908d41 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:33.640855 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-2c7352fb-e42f-4d69-bbba-e20c7a908d41 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:33.847851 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-2c7352fb-e42f-4d69-bbba-e20c7a908d41 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88eaaf0dd96340229d9f519b3489cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0608d586fdf4ba4b2b7f7137d49389a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:30:33.856635 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-2c7352fb-e42f-4d69-bbba-e20c7a908d41 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] 10.222.0.78 "GET /compute/v2.1/servers/133aedc5-dbda-4b17-93fa-1a41c505a3f5" status: 200 len: 1314 microversion: 2.1 time: 0.230773 Feb 17 04:30:33.857236 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 207/371] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:30:33 2021] GET /compute/v2.1/servers/133aedc5-dbda-4b17-93fa-1a41c505a3f5 => generated 1314 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:30:34.085477 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-5afa54ce-4f95-4ab5-83ae-ed84d4e62364 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:30:34.086152 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-5afa54ce-4f95-4ab5-83ae-ed84d4e62364 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] [instance: 555b8368-f196-4c6c-acf7-bc67d324c98a] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:30:34.094017 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-5afa54ce-4f95-4ab5-83ae-ed84d4e62364 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:34.094539 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-5afa54ce-4f95-4ab5-83ae-ed84d4e62364 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:34.095536 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-5afa54ce-4f95-4ab5-83ae-ed84d4e62364 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:34.095917 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-5afa54ce-4f95-4ab5-83ae-ed84d4e62364 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:34.316910 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-5afa54ce-4f95-4ab5-83ae-ed84d4e62364 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d68d4a6c12e4331b8df8191cdd7a669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2a1ca6347d4278899a1cc009d87d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:30:34.326052 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-5afa54ce-4f95-4ab5-83ae-ed84d4e62364 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] 10.222.0.78 "GET /compute/v2.1/servers/555b8368-f196-4c6c-acf7-bc67d324c98a" status: 200 len: 1317 microversion: 2.1 time: 0.245080 Feb 17 04:30:34.326666 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 208/372] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:30:34 2021] GET /compute/v2.1/servers/555b8368-f196-4c6c-acf7-bc67d324c98a => generated 1317 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:30:34.331389 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-e33d7d27-49f6-48e0-8fc8-4eb0285a354c tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:30:34.332059 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-e33d7d27-49f6-48e0-8fc8-4eb0285a354c tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] [instance: 2fe5b190-5679-4b9d-8d5f-fac1a1c407d9] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:30:34.340544 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-e33d7d27-49f6-48e0-8fc8-4eb0285a354c tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:34.341054 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-e33d7d27-49f6-48e0-8fc8-4eb0285a354c tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:34.341916 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-e33d7d27-49f6-48e0-8fc8-4eb0285a354c tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:34.342397 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-e33d7d27-49f6-48e0-8fc8-4eb0285a354c tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:34.555504 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-e33d7d27-49f6-48e0-8fc8-4eb0285a354c tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1daf9a83b1d24033a3d4c0f531a4eb2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5336afdcf4aa4b46b0655432b7a1323c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:30:34.564724 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-e33d7d27-49f6-48e0-8fc8-4eb0285a354c tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] 10.222.0.78 "GET /compute/v2.1/servers/2fe5b190-5679-4b9d-8d5f-fac1a1c407d9" status: 200 len: 1520 microversion: 2.1 time: 0.236961 Feb 17 04:30:34.565519 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 209/373] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:30:34 2021] GET /compute/v2.1/servers/2fe5b190-5679-4b9d-8d5f-fac1a1c407d9 => generated 1520 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:30:34.600303 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-055eb698-ccb5-4ee4-b816-96425e9b7b22 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "POST /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529/action" status: 200 len: 28192 microversion: 2.1 time: 2.222720 Feb 17 04:30:34.601326 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 165/374] 10.222.0.78 () {60 vars in 1268 bytes} [Wed Feb 17 04:30:32 2021] POST /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529/action => generated 28192 bytes in 2225 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 17 04:30:34.874897 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-f47943ba-989d-47a0-9445-0401278a4488 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:30:34.875606 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-f47943ba-989d-47a0-9445-0401278a4488 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] [instance: 133aedc5-dbda-4b17-93fa-1a41c505a3f5] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:30:34.883773 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-f47943ba-989d-47a0-9445-0401278a4488 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:34.884331 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-f47943ba-989d-47a0-9445-0401278a4488 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:34.885111 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-f47943ba-989d-47a0-9445-0401278a4488 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:34.885605 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-f47943ba-989d-47a0-9445-0401278a4488 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:35.095615 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-f47943ba-989d-47a0-9445-0401278a4488 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88eaaf0dd96340229d9f519b3489cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0608d586fdf4ba4b2b7f7137d49389a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:30:35.104954 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-f47943ba-989d-47a0-9445-0401278a4488 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] 10.222.0.78 "GET /compute/v2.1/servers/133aedc5-dbda-4b17-93fa-1a41c505a3f5" status: 200 len: 1314 microversion: 2.1 time: 0.234122 Feb 17 04:30:35.105548 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 210/375] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:30:34 2021] GET /compute/v2.1/servers/133aedc5-dbda-4b17-93fa-1a41c505a3f5 => generated 1314 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:30:35.345990 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-d38c7eb4-1ec2-43e6-8206-205f587743ab tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:30:35.346773 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-d38c7eb4-1ec2-43e6-8206-205f587743ab tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] [instance: 555b8368-f196-4c6c-acf7-bc67d324c98a] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:30:35.356312 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-d38c7eb4-1ec2-43e6-8206-205f587743ab tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:35.356825 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-d38c7eb4-1ec2-43e6-8206-205f587743ab tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:35.357675 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-d38c7eb4-1ec2-43e6-8206-205f587743ab tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:35.358166 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-d38c7eb4-1ec2-43e6-8206-205f587743ab tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:35.580304 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-d38c7eb4-1ec2-43e6-8206-205f587743ab tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d68d4a6c12e4331b8df8191cdd7a669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2a1ca6347d4278899a1cc009d87d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:30:35.584053 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-5e559ca2-06fd-4c7a-a11b-dcb01a9ee775 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:30:35.584782 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-5e559ca2-06fd-4c7a-a11b-dcb01a9ee775 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] [instance: 2fe5b190-5679-4b9d-8d5f-fac1a1c407d9] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:30:35.590043 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-d38c7eb4-1ec2-43e6-8206-205f587743ab tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] 10.222.0.78 "GET /compute/v2.1/servers/555b8368-f196-4c6c-acf7-bc67d324c98a" status: 200 len: 1317 microversion: 2.1 time: 0.248575 Feb 17 04:30:35.590610 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 166/376] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:30:35 2021] GET /compute/v2.1/servers/555b8368-f196-4c6c-acf7-bc67d324c98a => generated 1317 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:30:35.593239 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-5e559ca2-06fd-4c7a-a11b-dcb01a9ee775 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:35.593755 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-5e559ca2-06fd-4c7a-a11b-dcb01a9ee775 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:35.594596 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-5e559ca2-06fd-4c7a-a11b-dcb01a9ee775 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:35.595132 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-5e559ca2-06fd-4c7a-a11b-dcb01a9ee775 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:35.613492 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-be5e9756-e802-433a-9d00-c731dbae6911 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:30:35.614583 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-be5e9756-e802-433a-9d00-c731dbae6911 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: 29d1ce27-f63b-4523-88be-55f65a6a2529] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:30:35.622540 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-be5e9756-e802-433a-9d00-c731dbae6911 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:35.623067 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-be5e9756-e802-433a-9d00-c731dbae6911 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:35.624125 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-be5e9756-e802-433a-9d00-c731dbae6911 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:35.624632 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-be5e9756-e802-433a-9d00-c731dbae6911 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:35.812887 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-5e559ca2-06fd-4c7a-a11b-dcb01a9ee775 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1daf9a83b1d24033a3d4c0f531a4eb2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5336afdcf4aa4b46b0655432b7a1323c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:30:35.822735 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-5e559ca2-06fd-4c7a-a11b-dcb01a9ee775 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] 10.222.0.78 "GET /compute/v2.1/servers/2fe5b190-5679-4b9d-8d5f-fac1a1c407d9" status: 200 len: 1520 microversion: 2.1 time: 0.242772 Feb 17 04:30:35.823372 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 211/377] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:30:35 2021] GET /compute/v2.1/servers/2fe5b190-5679-4b9d-8d5f-fac1a1c407d9 => generated 1520 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:30:36.123701 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-db5a1a4c-28b1-414e-92d8-3af06f1b5a91 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:30:36.124385 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-db5a1a4c-28b1-414e-92d8-3af06f1b5a91 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] [instance: 133aedc5-dbda-4b17-93fa-1a41c505a3f5] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:30:36.133005 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-db5a1a4c-28b1-414e-92d8-3af06f1b5a91 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:36.133517 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-db5a1a4c-28b1-414e-92d8-3af06f1b5a91 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:36.134375 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-db5a1a4c-28b1-414e-92d8-3af06f1b5a91 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:36.134869 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-db5a1a4c-28b1-414e-92d8-3af06f1b5a91 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:36.347804 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-db5a1a4c-28b1-414e-92d8-3af06f1b5a91 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88eaaf0dd96340229d9f519b3489cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0608d586fdf4ba4b2b7f7137d49389a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:30:36.358104 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-db5a1a4c-28b1-414e-92d8-3af06f1b5a91 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] 10.222.0.78 "GET /compute/v2.1/servers/133aedc5-dbda-4b17-93fa-1a41c505a3f5" status: 200 len: 1314 microversion: 2.1 time: 0.238211 Feb 17 04:30:36.358614 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 212/378] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:30:36 2021] GET /compute/v2.1/servers/133aedc5-dbda-4b17-93fa-1a41c505a3f5 => generated 1314 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:30:36.608242 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-494300cf-4164-4428-8983-738f59ac8a3e tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:30:36.608950 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-494300cf-4164-4428-8983-738f59ac8a3e tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] [instance: 555b8368-f196-4c6c-acf7-bc67d324c98a] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:30:36.618412 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-494300cf-4164-4428-8983-738f59ac8a3e tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:36.618924 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-494300cf-4164-4428-8983-738f59ac8a3e tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:36.619798 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-494300cf-4164-4428-8983-738f59ac8a3e tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:36.620299 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-494300cf-4164-4428-8983-738f59ac8a3e tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:36.834378 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-494300cf-4164-4428-8983-738f59ac8a3e tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d68d4a6c12e4331b8df8191cdd7a669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2a1ca6347d4278899a1cc009d87d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:30:36.843755 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-494300cf-4164-4428-8983-738f59ac8a3e tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] 10.222.0.78 "GET /compute/v2.1/servers/555b8368-f196-4c6c-acf7-bc67d324c98a" status: 200 len: 1317 microversion: 2.1 time: 0.239583 Feb 17 04:30:36.844352 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 213/379] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:30:36 2021] GET /compute/v2.1/servers/555b8368-f196-4c6c-acf7-bc67d324c98a => generated 1317 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:30:36.848959 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-76343f85-891f-46c3-8b30-9376a2309ac7 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:30:36.849624 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-76343f85-891f-46c3-8b30-9376a2309ac7 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] [instance: 2fe5b190-5679-4b9d-8d5f-fac1a1c407d9] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:30:36.857578 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-76343f85-891f-46c3-8b30-9376a2309ac7 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:36.858089 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-76343f85-891f-46c3-8b30-9376a2309ac7 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:36.858922 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-76343f85-891f-46c3-8b30-9376a2309ac7 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:36.859443 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-76343f85-891f-46c3-8b30-9376a2309ac7 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:37.085241 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-76343f85-891f-46c3-8b30-9376a2309ac7 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1daf9a83b1d24033a3d4c0f531a4eb2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5336afdcf4aa4b46b0655432b7a1323c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:30:37.094308 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-76343f85-891f-46c3-8b30-9376a2309ac7 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] 10.222.0.78 "GET /compute/v2.1/servers/2fe5b190-5679-4b9d-8d5f-fac1a1c407d9" status: 200 len: 1520 microversion: 2.1 time: 0.248935 Feb 17 04:30:37.094924 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 214/380] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:30:36 2021] GET /compute/v2.1/servers/2fe5b190-5679-4b9d-8d5f-fac1a1c407d9 => generated 1520 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:30:37.377321 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-bd312d88-80c1-4a8b-9a5a-1b94a6c8b121 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:30:37.378012 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-bd312d88-80c1-4a8b-9a5a-1b94a6c8b121 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] [instance: 133aedc5-dbda-4b17-93fa-1a41c505a3f5] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:30:37.391973 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-bd312d88-80c1-4a8b-9a5a-1b94a6c8b121 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:37.392598 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-bd312d88-80c1-4a8b-9a5a-1b94a6c8b121 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:37.393548 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-bd312d88-80c1-4a8b-9a5a-1b94a6c8b121 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:37.394125 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-bd312d88-80c1-4a8b-9a5a-1b94a6c8b121 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:37.483490 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-be5e9756-e802-433a-9d00-c731dbae6911 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "POST /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529/action" status: 200 len: 28192 microversion: 2.1 time: 1.873933 Feb 17 04:30:37.484558 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 167/381] 10.222.0.78 () {60 vars in 1268 bytes} [Wed Feb 17 04:30:35 2021] POST /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529/action => generated 28192 bytes in 1876 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 17 04:30:37.491494 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [req-5ac0e598-f513-492e-9892-0b49363c917f req-8ccecc8a-4969-44ec-a352-5113dfa2709b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "133aedc5-dbda-4b17-93fa-1a41c505a3f5", "name": "network-vif-plugged", "status": "completed", "tag": "a9ee15ee-16f6-407c-a5d4-b6cf1d15152f"}]} {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:30:37.493529 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:30:37.493529 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: warnings.warn(msg) Feb 17 04:30:37.503803 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [req-5ac0e598-f513-492e-9892-0b49363c917f req-8ccecc8a-4969-44ec-a352-5113dfa2709b service nova] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:37.504419 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [req-5ac0e598-f513-492e-9892-0b49363c917f req-8ccecc8a-4969-44ec-a352-5113dfa2709b service nova] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:37.524720 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.compute.server_external_events [req-5ac0e598-f513-492e-9892-0b49363c917f req-8ccecc8a-4969-44ec-a352-5113dfa2709b service nova] Creating event network-vif-plugged:a9ee15ee-16f6-407c-a5d4-b6cf1d15152f for instance 133aedc5-dbda-4b17-93fa-1a41c505a3f5 on hv-cinder-75998 Feb 17 04:30:37.531165 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [req-5ac0e598-f513-492e-9892-0b49363c917f req-8ccecc8a-4969-44ec-a352-5113dfa2709b service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043605 Feb 17 04:30:37.531989 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 168/382] 10.222.0.78 () {64 vars in 1308 bytes} [Wed Feb 17 04:30:37 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:30:37.655990 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-bd312d88-80c1-4a8b-9a5a-1b94a6c8b121 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88eaaf0dd96340229d9f519b3489cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0608d586fdf4ba4b2b7f7137d49389a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:30:37.672855 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-bd312d88-80c1-4a8b-9a5a-1b94a6c8b121 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] 10.222.0.78 "GET /compute/v2.1/servers/133aedc5-dbda-4b17-93fa-1a41c505a3f5" status: 200 len: 1314 microversion: 2.1 time: 0.299810 Feb 17 04:30:37.673476 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 215/383] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:30:37 2021] GET /compute/v2.1/servers/133aedc5-dbda-4b17-93fa-1a41c505a3f5 => generated 1314 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:30:37.863429 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-a9367f84-a9c6-493b-9ba1-e456424165ca tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:30:37.864117 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-a9367f84-a9c6-493b-9ba1-e456424165ca tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] [instance: 555b8368-f196-4c6c-acf7-bc67d324c98a] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:30:37.873782 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-a9367f84-a9c6-493b-9ba1-e456424165ca tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:37.874292 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-a9367f84-a9c6-493b-9ba1-e456424165ca tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:37.875275 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-a9367f84-a9c6-493b-9ba1-e456424165ca tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:37.875767 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-a9367f84-a9c6-493b-9ba1-e456424165ca tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:38.112863 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-92be2cf5-8c82-4f42-abcf-1b653f2a7646 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:30:38.113827 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-92be2cf5-8c82-4f42-abcf-1b653f2a7646 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] [instance: 2fe5b190-5679-4b9d-8d5f-fac1a1c407d9] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:30:38.141029 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-92be2cf5-8c82-4f42-abcf-1b653f2a7646 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:38.141553 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-92be2cf5-8c82-4f42-abcf-1b653f2a7646 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:38.152095 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-92be2cf5-8c82-4f42-abcf-1b653f2a7646 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:38.152713 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-92be2cf5-8c82-4f42-abcf-1b653f2a7646 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:38.246874 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-a9367f84-a9c6-493b-9ba1-e456424165ca tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d68d4a6c12e4331b8df8191cdd7a669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2a1ca6347d4278899a1cc009d87d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:30:38.258012 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-a9367f84-a9c6-493b-9ba1-e456424165ca tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] 10.222.0.78 "GET /compute/v2.1/servers/555b8368-f196-4c6c-acf7-bc67d324c98a" status: 200 len: 1317 microversion: 2.1 time: 0.399506 Feb 17 04:30:38.258786 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 169/384] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:30:37 2021] GET /compute/v2.1/servers/555b8368-f196-4c6c-acf7-bc67d324c98a => generated 1317 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:30:38.389508 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-92be2cf5-8c82-4f42-abcf-1b653f2a7646 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1daf9a83b1d24033a3d4c0f531a4eb2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5336afdcf4aa4b46b0655432b7a1323c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:30:38.399180 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-92be2cf5-8c82-4f42-abcf-1b653f2a7646 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] 10.222.0.78 "GET /compute/v2.1/servers/2fe5b190-5679-4b9d-8d5f-fac1a1c407d9" status: 200 len: 1520 microversion: 2.1 time: 0.290335 Feb 17 04:30:38.399795 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 216/385] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:30:38 2021] GET /compute/v2.1/servers/2fe5b190-5679-4b9d-8d5f-fac1a1c407d9 => generated 1520 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:30:38.497143 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-69e7ea03-326e-4399-9e1a-ff7269c76c7a tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:30:38.498283 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-69e7ea03-326e-4399-9e1a-ff7269c76c7a tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: 29d1ce27-f63b-4523-88be-55f65a6a2529] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:30:38.508251 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-69e7ea03-326e-4399-9e1a-ff7269c76c7a tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:38.508771 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-69e7ea03-326e-4399-9e1a-ff7269c76c7a tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:38.509688 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-69e7ea03-326e-4399-9e1a-ff7269c76c7a tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:38.510192 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-69e7ea03-326e-4399-9e1a-ff7269c76c7a tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:38.689927 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-de4135c4-118a-456f-a4f2-aedea7e97574 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:30:38.690773 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-de4135c4-118a-456f-a4f2-aedea7e97574 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] [instance: 133aedc5-dbda-4b17-93fa-1a41c505a3f5] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:30:38.699739 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-de4135c4-118a-456f-a4f2-aedea7e97574 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:38.700241 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-de4135c4-118a-456f-a4f2-aedea7e97574 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:38.701189 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-de4135c4-118a-456f-a4f2-aedea7e97574 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:38.701677 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-de4135c4-118a-456f-a4f2-aedea7e97574 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:38.781780 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-69e7ea03-326e-4399-9e1a-ff7269c76c7a tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "POST /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529/action" status: 200 len: 28192 microversion: 2.1 time: 0.288654 Feb 17 04:30:38.782498 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 170/386] 10.222.0.78 () {60 vars in 1268 bytes} [Wed Feb 17 04:30:38 2021] POST /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529/action => generated 28192 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 04:30:38.955065 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-de4135c4-118a-456f-a4f2-aedea7e97574 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88eaaf0dd96340229d9f519b3489cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0608d586fdf4ba4b2b7f7137d49389a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:30:38.966166 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-de4135c4-118a-456f-a4f2-aedea7e97574 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] 10.222.0.78 "GET /compute/v2.1/servers/133aedc5-dbda-4b17-93fa-1a41c505a3f5" status: 200 len: 1314 microversion: 2.1 time: 0.279842 Feb 17 04:30:38.976857 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 217/387] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:30:38 2021] GET /compute/v2.1/servers/133aedc5-dbda-4b17-93fa-1a41c505a3f5 => generated 1314 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:30:39.277267 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-f84bc57d-3fd4-49c2-bf2e-2b865f0613c2 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:30:39.278044 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-f84bc57d-3fd4-49c2-bf2e-2b865f0613c2 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] [instance: 555b8368-f196-4c6c-acf7-bc67d324c98a] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:30:39.294177 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-f84bc57d-3fd4-49c2-bf2e-2b865f0613c2 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:39.294860 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-f84bc57d-3fd4-49c2-bf2e-2b865f0613c2 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:39.295956 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-f84bc57d-3fd4-49c2-bf2e-2b865f0613c2 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:39.296556 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-f84bc57d-3fd4-49c2-bf2e-2b865f0613c2 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:39.418664 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-406aa9a7-837f-41dc-8cd7-708217df2a5d tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:30:39.420285 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-406aa9a7-837f-41dc-8cd7-708217df2a5d tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] [instance: 2fe5b190-5679-4b9d-8d5f-fac1a1c407d9] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:30:39.431379 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-406aa9a7-837f-41dc-8cd7-708217df2a5d tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:39.432452 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-406aa9a7-837f-41dc-8cd7-708217df2a5d tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:39.433393 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-406aa9a7-837f-41dc-8cd7-708217df2a5d tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:39.434055 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-406aa9a7-837f-41dc-8cd7-708217df2a5d tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:39.548597 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-f84bc57d-3fd4-49c2-bf2e-2b865f0613c2 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d68d4a6c12e4331b8df8191cdd7a669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2a1ca6347d4278899a1cc009d87d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:30:39.563762 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-f84bc57d-3fd4-49c2-bf2e-2b865f0613c2 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] 10.222.0.78 "GET /compute/v2.1/servers/555b8368-f196-4c6c-acf7-bc67d324c98a" status: 200 len: 1507 microversion: 2.1 time: 0.291088 Feb 17 04:30:39.566900 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 171/388] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:30:39 2021] GET /compute/v2.1/servers/555b8368-f196-4c6c-acf7-bc67d324c98a => generated 1507 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:30:39.591621 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-09ee3317-2fd9-45a5-9df0-b6f9191f0cf9 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fe9f2c16-089f-43a9-8385-1a4882c7700f"}} {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:30:39.593260 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-09ee3317-2fd9-45a5-9df0-b6f9191f0cf9 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] [instance: 555b8368-f196-4c6c-acf7-bc67d324c98a] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:30:39.611523 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-09ee3317-2fd9-45a5-9df0-b6f9191f0cf9 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:39.613841 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-09ee3317-2fd9-45a5-9df0-b6f9191f0cf9 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:39.615281 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-09ee3317-2fd9-45a5-9df0-b6f9191f0cf9 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:39.619192 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-09ee3317-2fd9-45a5-9df0-b6f9191f0cf9 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:39.712961 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-406aa9a7-837f-41dc-8cd7-708217df2a5d tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1daf9a83b1d24033a3d4c0f531a4eb2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5336afdcf4aa4b46b0655432b7a1323c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:30:39.730905 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-406aa9a7-837f-41dc-8cd7-708217df2a5d tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] 10.222.0.78 "GET /compute/v2.1/servers/2fe5b190-5679-4b9d-8d5f-fac1a1c407d9" status: 200 len: 1520 microversion: 2.1 time: 0.317021 Feb 17 04:30:39.731660 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 218/389] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:30:39 2021] GET /compute/v2.1/servers/2fe5b190-5679-4b9d-8d5f-fac1a1c407d9 => generated 1520 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:30:39.795667 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-5afb80ee-6f0f-4a0a-ba3e-1e7855061e28 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:30:39.796982 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-5afb80ee-6f0f-4a0a-ba3e-1e7855061e28 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: 29d1ce27-f63b-4523-88be-55f65a6a2529] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:30:39.805441 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-5afb80ee-6f0f-4a0a-ba3e-1e7855061e28 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:39.806087 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-5afb80ee-6f0f-4a0a-ba3e-1e7855061e28 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:39.807093 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-5afb80ee-6f0f-4a0a-ba3e-1e7855061e28 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:39.807703 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-5afb80ee-6f0f-4a0a-ba3e-1e7855061e28 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:39.868942 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.wsgi [None req-09ee3317-2fd9-45a5-9df0-b6f9191f0cf9 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] HTTP exception thrown: Invalid volume: volume fe9f2c16-089f-43a9-8385-1a4882c7700f is already attached to instances: 21edfff0-5c5c-43a5-a4e5-22ddd5f452eb Feb 17 04:30:39.869743 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-09ee3317-2fd9-45a5-9df0-b6f9191f0cf9 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Returning 400 to user: Invalid volume: volume fe9f2c16-089f-43a9-8385-1a4882c7700f is already attached to instances: 21edfff0-5c5c-43a5-a4e5-22ddd5f452eb {{(pid=98178) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 17 04:30:39.870912 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-09ee3317-2fd9-45a5-9df0-b6f9191f0cf9 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] 10.222.0.78 "POST /compute/v2.1/servers/555b8368-f196-4c6c-acf7-bc67d324c98a/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.285301 Feb 17 04:30:39.872048 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 172/390] 10.222.0.78 () {60 vars in 1313 bytes} [Wed Feb 17 04:30:39 2021] POST /compute/v2.1/servers/555b8368-f196-4c6c-acf7-bc67d324c98a/os-volume_attachments => generated 174 bytes in 288 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Feb 17 04:30:39.984308 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-552da918-9a27-4a56-be34-ce87d444ae54 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:30:39.984984 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-552da918-9a27-4a56-be34-ce87d444ae54 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] [instance: 133aedc5-dbda-4b17-93fa-1a41c505a3f5] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:30:39.993860 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-5afb80ee-6f0f-4a0a-ba3e-1e7855061e28 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "POST /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529/action" status: 200 len: 28192 microversion: 2.1 time: 0.202540 Feb 17 04:30:39.994168 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-552da918-9a27-4a56-be34-ce87d444ae54 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:39.994827 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 219/391] 10.222.0.78 () {60 vars in 1268 bytes} [Wed Feb 17 04:30:39 2021] POST /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529/action => generated 28192 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 04:30:39.994965 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-552da918-9a27-4a56-be34-ce87d444ae54 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:39.995523 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-552da918-9a27-4a56-be34-ce87d444ae54 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:39.996001 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-552da918-9a27-4a56-be34-ce87d444ae54 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:40.000117 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-7fa94bb7-b272-4d25-9629-68fa126d9c53 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:30:40.000762 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-7fa94bb7-b272-4d25-9629-68fa126d9c53 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] [instance: 21edfff0-5c5c-43a5-a4e5-22ddd5f452eb] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:30:40.010018 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-7fa94bb7-b272-4d25-9629-68fa126d9c53 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:40.010522 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-7fa94bb7-b272-4d25-9629-68fa126d9c53 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:40.011405 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-7fa94bb7-b272-4d25-9629-68fa126d9c53 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:40.011870 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-7fa94bb7-b272-4d25-9629-68fa126d9c53 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:40.201606 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.objects.instance [None req-7fa94bb7-b272-4d25-9629-68fa126d9c53 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lazy-loading 'services' on Instance uuid 21edfff0-5c5c-43a5-a4e5-22ddd5f452eb {{(pid=98179) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Feb 17 04:30:40.260935 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-552da918-9a27-4a56-be34-ce87d444ae54 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88eaaf0dd96340229d9f519b3489cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0608d586fdf4ba4b2b7f7137d49389a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:30:40.270542 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-552da918-9a27-4a56-be34-ce87d444ae54 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] 10.222.0.78 "GET /compute/v2.1/servers/133aedc5-dbda-4b17-93fa-1a41c505a3f5" status: 200 len: 1314 microversion: 2.1 time: 0.290387 Feb 17 04:30:40.282566 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 173/392] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:30:39 2021] GET /compute/v2.1/servers/133aedc5-dbda-4b17-93fa-1a41c505a3f5 => generated 1314 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:30:40.383927 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-7fa94bb7-b272-4d25-9629-68fa126d9c53 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] 10.222.0.78 "DELETE /compute/v2.1/servers/21edfff0-5c5c-43a5-a4e5-22ddd5f452eb/os-volume_attachments/fe9f2c16-089f-43a9-8385-1a4882c7700f" status: 202 len: 0 microversion: 2.1 time: 0.387779 Feb 17 04:30:40.384927 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 220/393] 10.222.0.78 () {58 vars in 1406 bytes} [Wed Feb 17 04:30:39 2021] DELETE /compute/v2.1/servers/21edfff0-5c5c-43a5-a4e5-22ddd5f452eb/os-volume_attachments/fe9f2c16-089f-43a9-8385-1a4882c7700f => generated 0 bytes in 390 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:30:40.749636 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-d7342c57-cf3c-43a0-94de-0cc44c4a0899 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:30:40.750318 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-d7342c57-cf3c-43a0-94de-0cc44c4a0899 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] [instance: 2fe5b190-5679-4b9d-8d5f-fac1a1c407d9] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:30:40.759829 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-d7342c57-cf3c-43a0-94de-0cc44c4a0899 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:40.760336 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-d7342c57-cf3c-43a0-94de-0cc44c4a0899 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:40.761192 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-d7342c57-cf3c-43a0-94de-0cc44c4a0899 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:40.761764 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-d7342c57-cf3c-43a0-94de-0cc44c4a0899 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:40.976181 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-d7342c57-cf3c-43a0-94de-0cc44c4a0899 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1daf9a83b1d24033a3d4c0f531a4eb2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5336afdcf4aa4b46b0655432b7a1323c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:30:40.985377 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-d7342c57-cf3c-43a0-94de-0cc44c4a0899 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] 10.222.0.78 "GET /compute/v2.1/servers/2fe5b190-5679-4b9d-8d5f-fac1a1c407d9" status: 200 len: 1500 microversion: 2.1 time: 0.239697 Feb 17 04:30:40.985978 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 174/394] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:30:40 2021] GET /compute/v2.1/servers/2fe5b190-5679-4b9d-8d5f-fac1a1c407d9 => generated 1500 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:30:41.003829 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-057044ea-61cf-4728-a9f2-542279cbfcc2 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:30:41.004524 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-057044ea-61cf-4728-a9f2-542279cbfcc2 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] [instance: 20760e77-fe67-4ebe-87f1-34d840495341] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:30:41.005969 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-feb5d458-3273-4718-864c-9cef2943874b tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:30:41.007798 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-feb5d458-3273-4718-864c-9cef2943874b tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: 29d1ce27-f63b-4523-88be-55f65a6a2529] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:30:41.014469 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-057044ea-61cf-4728-a9f2-542279cbfcc2 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:41.015012 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-057044ea-61cf-4728-a9f2-542279cbfcc2 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:41.016014 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-feb5d458-3273-4718-864c-9cef2943874b tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:41.016124 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-057044ea-61cf-4728-a9f2-542279cbfcc2 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:41.016521 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-feb5d458-3273-4718-864c-9cef2943874b tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:41.016639 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-057044ea-61cf-4728-a9f2-542279cbfcc2 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:41.017361 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-feb5d458-3273-4718-864c-9cef2943874b tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:41.017852 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-feb5d458-3273-4718-864c-9cef2943874b tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:41.190592 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-feb5d458-3273-4718-864c-9cef2943874b tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "POST /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529/action" status: 200 len: 28192 microversion: 2.1 time: 0.188388 Feb 17 04:30:41.196064 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 175/395] 10.222.0.78 () {60 vars in 1268 bytes} [Wed Feb 17 04:30:41 2021] POST /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529/action => generated 28192 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 04:30:41.250077 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-057044ea-61cf-4728-a9f2-542279cbfcc2 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1daf9a83b1d24033a3d4c0f531a4eb2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5336afdcf4aa4b46b0655432b7a1323c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:30:41.259851 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-057044ea-61cf-4728-a9f2-542279cbfcc2 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] 10.222.0.78 "GET /compute/v2.1/servers/20760e77-fe67-4ebe-87f1-34d840495341" status: 200 len: 1515 microversion: 2.1 time: 0.260578 Feb 17 04:30:41.260398 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 221/396] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:30:40 2021] GET /compute/v2.1/servers/20760e77-fe67-4ebe-87f1-34d840495341 => generated 1515 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:30:41.292307 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-59477049-3c51-42ee-91c2-f1888cd50d89 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:30:41.293097 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-59477049-3c51-42ee-91c2-f1888cd50d89 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] [instance: 133aedc5-dbda-4b17-93fa-1a41c505a3f5] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:30:41.302671 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-59477049-3c51-42ee-91c2-f1888cd50d89 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:41.303766 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-59477049-3c51-42ee-91c2-f1888cd50d89 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:41.305227 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-59477049-3c51-42ee-91c2-f1888cd50d89 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:41.305726 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-59477049-3c51-42ee-91c2-f1888cd50d89 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:41.592651 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-59477049-3c51-42ee-91c2-f1888cd50d89 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88eaaf0dd96340229d9f519b3489cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0608d586fdf4ba4b2b7f7137d49389a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:30:41.603572 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-59477049-3c51-42ee-91c2-f1888cd50d89 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] 10.222.0.78 "GET /compute/v2.1/servers/133aedc5-dbda-4b17-93fa-1a41c505a3f5" status: 200 len: 1499 microversion: 2.1 time: 0.317650 Feb 17 04:30:41.604224 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 176/397] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:30:41 2021] GET /compute/v2.1/servers/133aedc5-dbda-4b17-93fa-1a41c505a3f5 => generated 1499 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:30:42.203668 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-08ce9663-9002-417f-bc5c-9f28fd09d97b tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:30:42.204767 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-08ce9663-9002-417f-bc5c-9f28fd09d97b tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: 29d1ce27-f63b-4523-88be-55f65a6a2529] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:30:42.213401 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-08ce9663-9002-417f-bc5c-9f28fd09d97b tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:42.213901 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-08ce9663-9002-417f-bc5c-9f28fd09d97b tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:42.214739 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-08ce9663-9002-417f-bc5c-9f28fd09d97b tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:42.215262 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-08ce9663-9002-417f-bc5c-9f28fd09d97b tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:42.360568 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-08ce9663-9002-417f-bc5c-9f28fd09d97b tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "POST /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529/action" status: 200 len: 28192 microversion: 2.1 time: 0.160554 Feb 17 04:30:42.361243 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 222/398] 10.222.0.78 () {60 vars in 1268 bytes} [Wed Feb 17 04:30:42 2021] POST /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529/action => generated 28192 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 04:30:43.358101 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-aecc5fd8-e42b-4cad-8bed-83e677b2e768 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-659994688", "imageRef": "b005ed36-a85a-4c46-ba22-9fa8c5ec62e5", "flavorRef": "452", "networks": [{"uuid": "96c670ae-41b0-4a7d-b9a0-1a1a0b99417f"}]}} {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:30:43.375056 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-6c02f20a-4ea1-4980-b48e-fb24b30562aa tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:30:43.376408 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-6c02f20a-4ea1-4980-b48e-fb24b30562aa tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: 29d1ce27-f63b-4523-88be-55f65a6a2529] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:30:43.386824 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-6c02f20a-4ea1-4980-b48e-fb24b30562aa tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:43.387324 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-6c02f20a-4ea1-4980-b48e-fb24b30562aa tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:43.388250 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-6c02f20a-4ea1-4980-b48e-fb24b30562aa tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:43.388832 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-6c02f20a-4ea1-4980-b48e-fb24b30562aa tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:43.428591 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.network.neutron [None req-aecc5fd8-e42b-4cad-8bed-83e677b2e768 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] validate_networks() for [('96c670ae-41b0-4a7d-b9a0-1a1a0b99417f', None, None, None)] {{(pid=98178) validate_networks /opt/stack/nova/nova/network/neutron.py:2345}} Feb 17 04:30:43.530952 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-6c02f20a-4ea1-4980-b48e-fb24b30562aa tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "POST /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529/action" status: 200 len: 28192 microversion: 2.1 time: 0.160891 Feb 17 04:30:43.532436 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 223/399] 10.222.0.78 () {60 vars in 1268 bytes} [Wed Feb 17 04:30:43 2021] POST /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529/action => generated 28192 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 17 04:30:43.879631 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-ab88bc24-cb57-40aa-9e96-634ff3699572 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:30:43.881137 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-ab88bc24-cb57-40aa-9e96-634ff3699572 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] [instance: 20760e77-fe67-4ebe-87f1-34d840495341] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:30:43.890818 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-ab88bc24-cb57-40aa-9e96-634ff3699572 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:43.891669 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-ab88bc24-cb57-40aa-9e96-634ff3699572 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:43.892679 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-ab88bc24-cb57-40aa-9e96-634ff3699572 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:43.893324 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-ab88bc24-cb57-40aa-9e96-634ff3699572 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:43.958938 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.objects.instance [None req-ab88bc24-cb57-40aa-9e96-634ff3699572 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lazy-loading 'flavor' on Instance uuid 20760e77-fe67-4ebe-87f1-34d840495341 {{(pid=98179) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Feb 17 04:30:44.032879 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.virt.hardware [None req-aecc5fd8-e42b-4cad-8bed-83e677b2e768 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Flavor limits 0:0:0 {{(pid=98178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 17 04:30:44.033480 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.virt.hardware [None req-aecc5fd8-e42b-4cad-8bed-83e677b2e768 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Image limits 0:0:0 {{(pid=98178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Feb 17 04:30:44.034144 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.virt.hardware [None req-aecc5fd8-e42b-4cad-8bed-83e677b2e768 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Flavor pref 0:0:0 {{(pid=98178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 17 04:30:44.034768 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.virt.hardware [None req-aecc5fd8-e42b-4cad-8bed-83e677b2e768 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Image pref 0:0:0 {{(pid=98178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Feb 17 04:30:44.035392 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.virt.hardware [None req-aecc5fd8-e42b-4cad-8bed-83e677b2e768 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Feb 17 04:30:44.045190 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-aecc5fd8-e42b-4cad-8bed-83e677b2e768 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:44.045866 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-aecc5fd8-e42b-4cad-8bed-83e677b2e768 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:44.046874 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-aecc5fd8-e42b-4cad-8bed-83e677b2e768 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:44.047413 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-aecc5fd8-e42b-4cad-8bed-83e677b2e768 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:44.067131 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.quota [None req-aecc5fd8-e42b-4cad-8bed-83e677b2e768 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Getting quotas for project 2f2a1ca6347d4278899a1cc009d87d33. Resources: {'ram', 'cores', 'instances'} {{(pid=98178) _get_quotas /opt/stack/nova/nova/quota.py:388}} Feb 17 04:30:44.071904 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.quota [None req-aecc5fd8-e42b-4cad-8bed-83e677b2e768 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Getting quotas for user 6d68d4a6c12e4331b8df8191cdd7a669 and project 2f2a1ca6347d4278899a1cc009d87d33. Resources: {'ram', 'cores', 'instances'} {{(pid=98178) _get_quotas /opt/stack/nova/nova/quota.py:380}} Feb 17 04:30:44.083305 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-aecc5fd8-e42b-4cad-8bed-83e677b2e768 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Going to run 1 instances... {{(pid=98178) _provision_instances /opt/stack/nova/nova/compute/api.py:1264}} Feb 17 04:30:44.087412 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-aecc5fd8-e42b-4cad-8bed-83e677b2e768 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] [instance: ad42ab86-4168-46d3-9394-9fb44fc79d18] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b005ed36-a85a-4c46-ba22-9fa8c5ec62e5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98178) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1666}} Feb 17 04:30:44.142069 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-aecc5fd8-e42b-4cad-8bed-83e677b2e768 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.788342 Feb 17 04:30:44.143313 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 177/400] 10.222.0.78 () {60 vars in 1137 bytes} [Wed Feb 17 04:30:43 2021] POST /compute/v2.1/servers => generated 380 bytes in 790 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 17 04:30:44.154805 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-91779bd7-6e49-48d6-aeb8-f2ee50d8c427 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:30:44.155786 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-91779bd7-6e49-48d6-aeb8-f2ee50d8c427 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] [instance: ad42ab86-4168-46d3-9394-9fb44fc79d18] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:30:44.159680 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-ab88bc24-cb57-40aa-9e96-634ff3699572 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] 10.222.0.78 "POST /compute/v2.1/servers/20760e77-fe67-4ebe-87f1-34d840495341/action" status: 200 len: 32 microversion: 2.1 time: 0.284338 Feb 17 04:30:44.160377 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 224/401] 10.222.0.78 () {60 vars in 1268 bytes} [Wed Feb 17 04:30:43 2021] POST /compute/v2.1/servers/20760e77-fe67-4ebe-87f1-34d840495341/action => generated 32 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Feb 17 04:30:44.170740 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-4bd907e8-3210-426a-bfdf-a627bd71e5d6 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:30:44.171549 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-4bd907e8-3210-426a-bfdf-a627bd71e5d6 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] [instance: 20760e77-fe67-4ebe-87f1-34d840495341] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:30:44.185248 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-4bd907e8-3210-426a-bfdf-a627bd71e5d6 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:44.185726 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-4bd907e8-3210-426a-bfdf-a627bd71e5d6 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:44.186585 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-4bd907e8-3210-426a-bfdf-a627bd71e5d6 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:44.187064 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-4bd907e8-3210-426a-bfdf-a627bd71e5d6 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:44.400917 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-91779bd7-6e49-48d6-aeb8-f2ee50d8c427 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d68d4a6c12e4331b8df8191cdd7a669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2a1ca6347d4278899a1cc009d87d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:30:44.421924 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-91779bd7-6e49-48d6-aeb8-f2ee50d8c427 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] 10.222.0.78 "GET /compute/v2.1/servers/ad42ab86-4168-46d3-9394-9fb44fc79d18" status: 200 len: 1217 microversion: 2.1 time: 0.271165 Feb 17 04:30:44.422176 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 178/402] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:30:44 2021] GET /compute/v2.1/servers/ad42ab86-4168-46d3-9394-9fb44fc79d18 => generated 1217 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:30:44.431315 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-17b4d1e8-6215-4491-b1a5-c958d25c49d2 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:30:44.431315 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-17b4d1e8-6215-4491-b1a5-c958d25c49d2 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] [instance: 133aedc5-dbda-4b17-93fa-1a41c505a3f5] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:30:44.436138 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-17b4d1e8-6215-4491-b1a5-c958d25c49d2 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:44.436595 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-17b4d1e8-6215-4491-b1a5-c958d25c49d2 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:44.437457 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-17b4d1e8-6215-4491-b1a5-c958d25c49d2 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:44.437958 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-17b4d1e8-6215-4491-b1a5-c958d25c49d2 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:44.468160 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-4bd907e8-3210-426a-bfdf-a627bd71e5d6 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1daf9a83b1d24033a3d4c0f531a4eb2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5336afdcf4aa4b46b0655432b7a1323c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:30:44.478133 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-4bd907e8-3210-426a-bfdf-a627bd71e5d6 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] 10.222.0.78 "GET /compute/v2.1/servers/20760e77-fe67-4ebe-87f1-34d840495341" status: 200 len: 1521 microversion: 2.1 time: 0.311868 Feb 17 04:30:44.478784 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 225/403] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:30:44 2021] GET /compute/v2.1/servers/20760e77-fe67-4ebe-87f1-34d840495341 => generated 1521 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:30:44.516561 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-17b4d1e8-6215-4491-b1a5-c958d25c49d2 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] [instance: 133aedc5-dbda-4b17-93fa-1a41c505a3f5] Going to try to terminate instance {{(pid=98178) delete /opt/stack/nova/nova/compute/api.py:2540}} Feb 17 04:30:44.544360 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-6e8373ae-4b49-4245-8e9e-67157d3a6cba tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:30:44.545548 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-6e8373ae-4b49-4245-8e9e-67157d3a6cba tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: 29d1ce27-f63b-4523-88be-55f65a6a2529] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:30:44.554899 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-6e8373ae-4b49-4245-8e9e-67157d3a6cba tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:44.555653 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-6e8373ae-4b49-4245-8e9e-67157d3a6cba tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:44.556970 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-6e8373ae-4b49-4245-8e9e-67157d3a6cba tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:44.557807 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-6e8373ae-4b49-4245-8e9e-67157d3a6cba tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:44.672275 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-17b4d1e8-6215-4491-b1a5-c958d25c49d2 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] 10.222.0.78 "DELETE /compute/v2.1/servers/133aedc5-dbda-4b17-93fa-1a41c505a3f5" status: 204 len: 0 microversion: 2.1 time: 0.245915 Feb 17 04:30:44.673189 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 179/404] 10.222.0.78 () {58 vars in 1229 bytes} [Wed Feb 17 04:30:44 2021] DELETE /compute/v2.1/servers/133aedc5-dbda-4b17-93fa-1a41c505a3f5 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 17 04:30:44.685328 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-3e0167d5-25a2-473d-883d-14b17108a3c0 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:30:44.686222 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-3e0167d5-25a2-473d-883d-14b17108a3c0 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] [instance: 133aedc5-dbda-4b17-93fa-1a41c505a3f5] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:30:44.697780 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-3e0167d5-25a2-473d-883d-14b17108a3c0 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:44.698180 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-3e0167d5-25a2-473d-883d-14b17108a3c0 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:44.699372 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-3e0167d5-25a2-473d-883d-14b17108a3c0 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:44.699836 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-3e0167d5-25a2-473d-883d-14b17108a3c0 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:44.815916 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-6e8373ae-4b49-4245-8e9e-67157d3a6cba tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "POST /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529/action" status: 200 len: 28192 microversion: 2.1 time: 0.275129 Feb 17 04:30:44.817471 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 226/405] 10.222.0.78 () {60 vars in 1268 bytes} [Wed Feb 17 04:30:44 2021] POST /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529/action => generated 28192 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 17 04:30:45.133927 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-3e0167d5-25a2-473d-883d-14b17108a3c0 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88eaaf0dd96340229d9f519b3489cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0608d586fdf4ba4b2b7f7137d49389a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:30:45.153732 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-3e0167d5-25a2-473d-883d-14b17108a3c0 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] 10.222.0.78 "GET /compute/v2.1/servers/133aedc5-dbda-4b17-93fa-1a41c505a3f5" status: 200 len: 1505 microversion: 2.1 time: 0.475465 Feb 17 04:30:45.168434 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 180/406] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:30:44 2021] GET /compute/v2.1/servers/133aedc5-dbda-4b17-93fa-1a41c505a3f5 => generated 1505 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:30:45.442042 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-870554b0-15d3-4147-9bb9-84fa25098e0e tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:30:45.442822 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-870554b0-15d3-4147-9bb9-84fa25098e0e tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] [instance: ad42ab86-4168-46d3-9394-9fb44fc79d18] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:30:45.452483 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-870554b0-15d3-4147-9bb9-84fa25098e0e tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:45.452936 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-870554b0-15d3-4147-9bb9-84fa25098e0e tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:45.453785 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-870554b0-15d3-4147-9bb9-84fa25098e0e tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:45.454281 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-870554b0-15d3-4147-9bb9-84fa25098e0e tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:45.507116 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-a53c3d1e-3b5c-4691-abf5-23800c7bf812 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:30:45.508142 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-a53c3d1e-3b5c-4691-abf5-23800c7bf812 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] [instance: 20760e77-fe67-4ebe-87f1-34d840495341] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:30:45.521322 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-a53c3d1e-3b5c-4691-abf5-23800c7bf812 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:45.522809 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-a53c3d1e-3b5c-4691-abf5-23800c7bf812 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:45.523748 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-a53c3d1e-3b5c-4691-abf5-23800c7bf812 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:45.524253 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-a53c3d1e-3b5c-4691-abf5-23800c7bf812 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:45.619476 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-870554b0-15d3-4147-9bb9-84fa25098e0e tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d68d4a6c12e4331b8df8191cdd7a669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2a1ca6347d4278899a1cc009d87d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:30:45.632052 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-870554b0-15d3-4147-9bb9-84fa25098e0e tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] 10.222.0.78 "GET /compute/v2.1/servers/ad42ab86-4168-46d3-9394-9fb44fc79d18" status: 200 len: 1269 microversion: 2.1 time: 0.194385 Feb 17 04:30:45.633084 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 227/407] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:30:45 2021] GET /compute/v2.1/servers/ad42ab86-4168-46d3-9394-9fb44fc79d18 => generated 1269 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:30:45.830300 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-52fbd3a1-9139-4007-9483-a1e98e0d2352 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:30:45.831555 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-52fbd3a1-9139-4007-9483-a1e98e0d2352 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: 29d1ce27-f63b-4523-88be-55f65a6a2529] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:30:45.844170 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-52fbd3a1-9139-4007-9483-a1e98e0d2352 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:45.847931 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-52fbd3a1-9139-4007-9483-a1e98e0d2352 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:45.848835 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-52fbd3a1-9139-4007-9483-a1e98e0d2352 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:45.849750 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-52fbd3a1-9139-4007-9483-a1e98e0d2352 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:46.005156 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-a53c3d1e-3b5c-4691-abf5-23800c7bf812 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1daf9a83b1d24033a3d4c0f531a4eb2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5336afdcf4aa4b46b0655432b7a1323c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:30:46.015466 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-a53c3d1e-3b5c-4691-abf5-23800c7bf812 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] 10.222.0.78 "GET /compute/v2.1/servers/20760e77-fe67-4ebe-87f1-34d840495341" status: 200 len: 1521 microversion: 2.1 time: 0.513345 Feb 17 04:30:46.018498 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 181/408] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:30:45 2021] GET /compute/v2.1/servers/20760e77-fe67-4ebe-87f1-34d840495341 => generated 1521 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:30:46.162293 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-52fbd3a1-9139-4007-9483-a1e98e0d2352 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "POST /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529/action" status: 200 len: 28192 microversion: 2.1 time: 0.336910 Feb 17 04:30:46.164074 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 228/409] 10.222.0.78 () {60 vars in 1268 bytes} [Wed Feb 17 04:30:45 2021] POST /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529/action => generated 28192 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 17 04:30:46.175558 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-7f1c9db4-db0d-4416-b78c-6bf9e329b230 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:30:46.176616 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-7f1c9db4-db0d-4416-b78c-6bf9e329b230 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] [instance: 133aedc5-dbda-4b17-93fa-1a41c505a3f5] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:30:46.186336 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-7f1c9db4-db0d-4416-b78c-6bf9e329b230 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:46.187006 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-7f1c9db4-db0d-4416-b78c-6bf9e329b230 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:46.188036 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-7f1c9db4-db0d-4416-b78c-6bf9e329b230 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:46.188644 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-7f1c9db4-db0d-4416-b78c-6bf9e329b230 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:46.625917 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-7f1c9db4-db0d-4416-b78c-6bf9e329b230 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88eaaf0dd96340229d9f519b3489cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0608d586fdf4ba4b2b7f7137d49389a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:30:46.643013 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-7f1c9db4-db0d-4416-b78c-6bf9e329b230 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] 10.222.0.78 "GET /compute/v2.1/servers/133aedc5-dbda-4b17-93fa-1a41c505a3f5" status: 200 len: 1505 microversion: 2.1 time: 0.472340 Feb 17 04:30:46.643997 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 182/410] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:30:46 2021] GET /compute/v2.1/servers/133aedc5-dbda-4b17-93fa-1a41c505a3f5 => generated 1505 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:30:46.652707 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-02cf3176-e7cf-4b36-b773-26fd8ae7bf73 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:30:46.653482 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-02cf3176-e7cf-4b36-b773-26fd8ae7bf73 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] [instance: ad42ab86-4168-46d3-9394-9fb44fc79d18] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:30:46.663018 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-02cf3176-e7cf-4b36-b773-26fd8ae7bf73 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:46.663556 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-02cf3176-e7cf-4b36-b773-26fd8ae7bf73 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:46.664508 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-02cf3176-e7cf-4b36-b773-26fd8ae7bf73 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:46.665186 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-02cf3176-e7cf-4b36-b773-26fd8ae7bf73 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:46.822880 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-02cf3176-e7cf-4b36-b773-26fd8ae7bf73 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d68d4a6c12e4331b8df8191cdd7a669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2a1ca6347d4278899a1cc009d87d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:30:46.832781 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-02cf3176-e7cf-4b36-b773-26fd8ae7bf73 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] 10.222.0.78 "GET /compute/v2.1/servers/ad42ab86-4168-46d3-9394-9fb44fc79d18" status: 200 len: 1275 microversion: 2.1 time: 0.184798 Feb 17 04:30:46.833385 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 229/411] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:30:46 2021] GET /compute/v2.1/servers/ad42ab86-4168-46d3-9394-9fb44fc79d18 => generated 1275 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:30:47.034343 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-06135d0a-3a59-41a1-8317-6d7a9ae63665 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:30:47.035089 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-06135d0a-3a59-41a1-8317-6d7a9ae63665 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] [instance: 20760e77-fe67-4ebe-87f1-34d840495341] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:30:47.044239 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-06135d0a-3a59-41a1-8317-6d7a9ae63665 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:47.044746 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-06135d0a-3a59-41a1-8317-6d7a9ae63665 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:47.045590 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-06135d0a-3a59-41a1-8317-6d7a9ae63665 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:47.046081 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-06135d0a-3a59-41a1-8317-6d7a9ae63665 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:47.186344 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-63cc2105-9659-463f-bc73-a84eb62a0b9b tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:30:47.191297 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-63cc2105-9659-463f-bc73-a84eb62a0b9b tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: 29d1ce27-f63b-4523-88be-55f65a6a2529] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:30:47.216204 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-63cc2105-9659-463f-bc73-a84eb62a0b9b tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:47.216930 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-63cc2105-9659-463f-bc73-a84eb62a0b9b tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:47.220186 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-63cc2105-9659-463f-bc73-a84eb62a0b9b tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:47.220899 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-63cc2105-9659-463f-bc73-a84eb62a0b9b tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:47.611445 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-06135d0a-3a59-41a1-8317-6d7a9ae63665 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1daf9a83b1d24033a3d4c0f531a4eb2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5336afdcf4aa4b46b0655432b7a1323c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:30:47.621863 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-06135d0a-3a59-41a1-8317-6d7a9ae63665 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] 10.222.0.78 "GET /compute/v2.1/servers/20760e77-fe67-4ebe-87f1-34d840495341" status: 200 len: 1521 microversion: 2.1 time: 0.591780 Feb 17 04:30:47.627983 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-63cc2105-9659-463f-bc73-a84eb62a0b9b tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "POST /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529/action" status: 200 len: 28192 microversion: 2.1 time: 0.453182 Feb 17 04:30:47.633974 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 183/412] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:30:47 2021] GET /compute/v2.1/servers/20760e77-fe67-4ebe-87f1-34d840495341 => generated 1521 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:30:47.634228 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 230/413] 10.222.0.78 () {60 vars in 1268 bytes} [Wed Feb 17 04:30:47 2021] POST /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529/action => generated 28192 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 04:30:47.661432 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-e6880217-5cf9-4f41-99c6-68a9990a6e48 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:30:47.662115 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-e6880217-5cf9-4f41-99c6-68a9990a6e48 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] [instance: 133aedc5-dbda-4b17-93fa-1a41c505a3f5] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:30:47.670609 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-e6880217-5cf9-4f41-99c6-68a9990a6e48 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:47.671163 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-e6880217-5cf9-4f41-99c6-68a9990a6e48 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:47.672020 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-e6880217-5cf9-4f41-99c6-68a9990a6e48 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:47.672521 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-e6880217-5cf9-4f41-99c6-68a9990a6e48 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:47.856517 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-dbaa2c38-f16d-4978-bed9-d9c7be4e9dce tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:30:47.857939 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-dbaa2c38-f16d-4978-bed9-d9c7be4e9dce tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] [instance: ad42ab86-4168-46d3-9394-9fb44fc79d18] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:30:47.867556 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-dbaa2c38-f16d-4978-bed9-d9c7be4e9dce tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:47.867988 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-dbaa2c38-f16d-4978-bed9-d9c7be4e9dce tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:47.868835 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-dbaa2c38-f16d-4978-bed9-d9c7be4e9dce tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:47.869516 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-dbaa2c38-f16d-4978-bed9-d9c7be4e9dce tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:48.120504 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-dbaa2c38-f16d-4978-bed9-d9c7be4e9dce tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d68d4a6c12e4331b8df8191cdd7a669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2a1ca6347d4278899a1cc009d87d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:30:48.130165 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-dbaa2c38-f16d-4978-bed9-d9c7be4e9dce tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] 10.222.0.78 "GET /compute/v2.1/servers/ad42ab86-4168-46d3-9394-9fb44fc79d18" status: 200 len: 1317 microversion: 2.1 time: 0.281767 Feb 17 04:30:48.130769 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 231/414] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:30:47 2021] GET /compute/v2.1/servers/ad42ab86-4168-46d3-9394-9fb44fc79d18 => generated 1317 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:30:48.250116 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-e6880217-5cf9-4f41-99c6-68a9990a6e48 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88eaaf0dd96340229d9f519b3489cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0608d586fdf4ba4b2b7f7137d49389a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:30:48.259992 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-e6880217-5cf9-4f41-99c6-68a9990a6e48 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] 10.222.0.78 "GET /compute/v2.1/servers/133aedc5-dbda-4b17-93fa-1a41c505a3f5" status: 200 len: 1505 microversion: 2.1 time: 0.602545 Feb 17 04:30:48.260604 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 184/415] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:30:47 2021] GET /compute/v2.1/servers/133aedc5-dbda-4b17-93fa-1a41c505a3f5 => generated 1505 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:30:48.644924 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-35fb2b64-c20a-4409-80d1-4de10ad04867 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:30:48.646159 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-35fb2b64-c20a-4409-80d1-4de10ad04867 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: 29d1ce27-f63b-4523-88be-55f65a6a2529] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:30:48.647406 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-a89abef2-dc79-4684-8deb-3c9cd8a6ffba tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:30:48.648400 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-a89abef2-dc79-4684-8deb-3c9cd8a6ffba tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] [instance: 20760e77-fe67-4ebe-87f1-34d840495341] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:30:48.655721 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-35fb2b64-c20a-4409-80d1-4de10ad04867 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:48.656328 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-35fb2b64-c20a-4409-80d1-4de10ad04867 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:48.657265 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-35fb2b64-c20a-4409-80d1-4de10ad04867 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:48.657836 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-35fb2b64-c20a-4409-80d1-4de10ad04867 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:48.662024 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-a89abef2-dc79-4684-8deb-3c9cd8a6ffba tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:48.663809 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-a89abef2-dc79-4684-8deb-3c9cd8a6ffba tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:48.665403 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-a89abef2-dc79-4684-8deb-3c9cd8a6ffba tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:48.666091 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-a89abef2-dc79-4684-8deb-3c9cd8a6ffba tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:48.811475 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-35fb2b64-c20a-4409-80d1-4de10ad04867 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "POST /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529/action" status: 200 len: 28192 microversion: 2.1 time: 0.170249 Feb 17 04:30:48.812848 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 185/416] 10.222.0.78 () {60 vars in 1268 bytes} [Wed Feb 17 04:30:48 2021] POST /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529/action => generated 28192 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 04:30:48.920179 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [req-6fbdc715-f2fa-4975-93ba-84b54ae48315 req-c064b9a5-e151-452f-9c34-f518b9307950 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "133aedc5-dbda-4b17-93fa-1a41c505a3f5", "name": "network-vif-unplugged", "status": "completed", "tag": "a9ee15ee-16f6-407c-a5d4-b6cf1d15152f"}]} {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:30:48.922506 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:30:48.922506 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: warnings.warn(msg) Feb 17 04:30:48.933562 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [req-6fbdc715-f2fa-4975-93ba-84b54ae48315 req-c064b9a5-e151-452f-9c34-f518b9307950 service nova] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:48.934332 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [req-6fbdc715-f2fa-4975-93ba-84b54ae48315 req-c064b9a5-e151-452f-9c34-f518b9307950 service nova] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:48.935448 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-a89abef2-dc79-4684-8deb-3c9cd8a6ffba tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1daf9a83b1d24033a3d4c0f531a4eb2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5336afdcf4aa4b46b0655432b7a1323c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:30:48.947415 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-a89abef2-dc79-4684-8deb-3c9cd8a6ffba tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] 10.222.0.78 "GET /compute/v2.1/servers/20760e77-fe67-4ebe-87f1-34d840495341" status: 200 len: 1521 microversion: 2.1 time: 0.311140 Feb 17 04:30:48.948396 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 232/417] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:30:48 2021] GET /compute/v2.1/servers/20760e77-fe67-4ebe-87f1-34d840495341 => generated 1521 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:30:48.958116 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.compute.server_external_events [req-6fbdc715-f2fa-4975-93ba-84b54ae48315 req-c064b9a5-e151-452f-9c34-f518b9307950 service nova] Creating event network-vif-unplugged:a9ee15ee-16f6-407c-a5d4-b6cf1d15152f for instance 133aedc5-dbda-4b17-93fa-1a41c505a3f5 on hv-cinder-75998 Feb 17 04:30:48.963680 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [req-6fbdc715-f2fa-4975-93ba-84b54ae48315 req-c064b9a5-e151-452f-9c34-f518b9307950 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047799 Feb 17 04:30:48.964412 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 186/418] 10.222.0.78 () {64 vars in 1308 bytes} [Wed Feb 17 04:30:48 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 17 04:30:49.149596 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-2028280e-bf2d-47ed-86c8-8b475ba5ee8b tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:30:49.150277 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-2028280e-bf2d-47ed-86c8-8b475ba5ee8b tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] [instance: ad42ab86-4168-46d3-9394-9fb44fc79d18] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:30:49.158652 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-2028280e-bf2d-47ed-86c8-8b475ba5ee8b tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:49.159525 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-2028280e-bf2d-47ed-86c8-8b475ba5ee8b tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:49.160578 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-2028280e-bf2d-47ed-86c8-8b475ba5ee8b tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:49.161265 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-2028280e-bf2d-47ed-86c8-8b475ba5ee8b tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:49.282304 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-14743bd8-9f5f-40ac-affc-2df7e73dcc75 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:30:49.283514 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-14743bd8-9f5f-40ac-affc-2df7e73dcc75 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] [instance: 133aedc5-dbda-4b17-93fa-1a41c505a3f5] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:30:49.296998 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-14743bd8-9f5f-40ac-affc-2df7e73dcc75 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:49.297615 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-14743bd8-9f5f-40ac-affc-2df7e73dcc75 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:49.298569 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-14743bd8-9f5f-40ac-affc-2df7e73dcc75 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:49.299127 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-14743bd8-9f5f-40ac-affc-2df7e73dcc75 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:49.405624 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-2028280e-bf2d-47ed-86c8-8b475ba5ee8b tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d68d4a6c12e4331b8df8191cdd7a669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2a1ca6347d4278899a1cc009d87d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:30:49.417068 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-2028280e-bf2d-47ed-86c8-8b475ba5ee8b tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] 10.222.0.78 "GET /compute/v2.1/servers/ad42ab86-4168-46d3-9394-9fb44fc79d18" status: 200 len: 1317 microversion: 2.1 time: 0.272375 Feb 17 04:30:49.417767 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 233/419] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:30:49 2021] GET /compute/v2.1/servers/ad42ab86-4168-46d3-9394-9fb44fc79d18 => generated 1317 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:30:49.778934 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-14743bd8-9f5f-40ac-affc-2df7e73dcc75 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88eaaf0dd96340229d9f519b3489cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0608d586fdf4ba4b2b7f7137d49389a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:30:49.788543 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-14743bd8-9f5f-40ac-affc-2df7e73dcc75 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] 10.222.0.78 "GET /compute/v2.1/servers/133aedc5-dbda-4b17-93fa-1a41c505a3f5" status: 200 len: 1505 microversion: 2.1 time: 0.513924 Feb 17 04:30:49.789974 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 187/420] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:30:49 2021] GET /compute/v2.1/servers/133aedc5-dbda-4b17-93fa-1a41c505a3f5 => generated 1505 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:30:49.825275 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-96916b02-6f7c-489f-a9de-0ff09d5db9ac tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:30:49.826551 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-96916b02-6f7c-489f-a9de-0ff09d5db9ac tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: 29d1ce27-f63b-4523-88be-55f65a6a2529] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:30:49.834808 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-96916b02-6f7c-489f-a9de-0ff09d5db9ac tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:49.835591 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-96916b02-6f7c-489f-a9de-0ff09d5db9ac tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:49.836754 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-96916b02-6f7c-489f-a9de-0ff09d5db9ac tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:49.837215 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-96916b02-6f7c-489f-a9de-0ff09d5db9ac tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:49.965775 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-7aa04031-42de-48e2-8de5-18c3e12e9476 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:30:49.966371 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-7aa04031-42de-48e2-8de5-18c3e12e9476 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] [instance: 20760e77-fe67-4ebe-87f1-34d840495341] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:30:49.975460 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-7aa04031-42de-48e2-8de5-18c3e12e9476 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:49.975981 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-7aa04031-42de-48e2-8de5-18c3e12e9476 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:49.976972 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-7aa04031-42de-48e2-8de5-18c3e12e9476 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:49.977472 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-7aa04031-42de-48e2-8de5-18c3e12e9476 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:49.986169 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-96916b02-6f7c-489f-a9de-0ff09d5db9ac tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "POST /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529/action" status: 200 len: 28192 microversion: 2.1 time: 0.163872 Feb 17 04:30:49.986169 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 234/421] 10.222.0.78 () {60 vars in 1268 bytes} [Wed Feb 17 04:30:49 2021] POST /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529/action => generated 28192 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 04:30:50.259911 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [req-f74cafb1-e4ed-46c2-955c-783028da76b8 req-9fdf919b-c732-4ad5-98a2-8722a8b48d5d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ad42ab86-4168-46d3-9394-9fb44fc79d18", "tag": "792b9d8e-6dd8-4b55-a5f2-852e8232b46b"}]} {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:30:50.262927 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:30:50.262927 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: warnings.warn(msg) Feb 17 04:30:50.275293 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [req-f74cafb1-e4ed-46c2-955c-783028da76b8 req-9fdf919b-c732-4ad5-98a2-8722a8b48d5d service nova] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:50.275955 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [req-f74cafb1-e4ed-46c2-955c-783028da76b8 req-9fdf919b-c732-4ad5-98a2-8722a8b48d5d service nova] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:50.296344 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.compute.server_external_events [req-f74cafb1-e4ed-46c2-955c-783028da76b8 req-9fdf919b-c732-4ad5-98a2-8722a8b48d5d service nova] Creating event network-changed:792b9d8e-6dd8-4b55-a5f2-852e8232b46b for instance ad42ab86-4168-46d3-9394-9fb44fc79d18 on hv-cinder-75998 Feb 17 04:30:50.302190 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [req-f74cafb1-e4ed-46c2-955c-783028da76b8 req-9fdf919b-c732-4ad5-98a2-8722a8b48d5d service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047408 Feb 17 04:30:50.302940 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 235/422] 10.222.0.78 () {64 vars in 1308 bytes} [Wed Feb 17 04:30:50 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:30:50.437539 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-462f3497-5c1a-4435-8e22-a1f4650509a4 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:30:50.438440 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-462f3497-5c1a-4435-8e22-a1f4650509a4 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] [instance: ad42ab86-4168-46d3-9394-9fb44fc79d18] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:30:50.448040 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-462f3497-5c1a-4435-8e22-a1f4650509a4 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:50.448645 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-462f3497-5c1a-4435-8e22-a1f4650509a4 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:50.449562 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-462f3497-5c1a-4435-8e22-a1f4650509a4 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:50.450130 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-462f3497-5c1a-4435-8e22-a1f4650509a4 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:50.539019 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-7aa04031-42de-48e2-8de5-18c3e12e9476 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1daf9a83b1d24033a3d4c0f531a4eb2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5336afdcf4aa4b46b0655432b7a1323c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:30:50.548010 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-7aa04031-42de-48e2-8de5-18c3e12e9476 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] 10.222.0.78 "GET /compute/v2.1/servers/20760e77-fe67-4ebe-87f1-34d840495341" status: 200 len: 1521 microversion: 2.1 time: 0.586391 Feb 17 04:30:50.548815 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 188/423] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:30:49 2021] GET /compute/v2.1/servers/20760e77-fe67-4ebe-87f1-34d840495341 => generated 1521 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:30:50.691436 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-462f3497-5c1a-4435-8e22-a1f4650509a4 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d68d4a6c12e4331b8df8191cdd7a669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2a1ca6347d4278899a1cc009d87d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:30:50.700921 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-462f3497-5c1a-4435-8e22-a1f4650509a4 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] 10.222.0.78 "GET /compute/v2.1/servers/ad42ab86-4168-46d3-9394-9fb44fc79d18" status: 200 len: 1317 microversion: 2.1 time: 0.268124 Feb 17 04:30:50.701530 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 236/424] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:30:50 2021] GET /compute/v2.1/servers/ad42ab86-4168-46d3-9394-9fb44fc79d18 => generated 1317 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:30:50.808296 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-7b1dc451-12ae-42c5-8192-4925ecf3087a tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:30:50.808987 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-7b1dc451-12ae-42c5-8192-4925ecf3087a tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] [instance: 133aedc5-dbda-4b17-93fa-1a41c505a3f5] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:30:50.817888 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-7b1dc451-12ae-42c5-8192-4925ecf3087a tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:50.818427 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-7b1dc451-12ae-42c5-8192-4925ecf3087a tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:50.820144 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-7b1dc451-12ae-42c5-8192-4925ecf3087a tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:50.820650 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-7b1dc451-12ae-42c5-8192-4925ecf3087a tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:50.998461 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-b1fe70e5-4930-433f-a3e7-1990b0cf0062 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:30:51.000036 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-b1fe70e5-4930-433f-a3e7-1990b0cf0062 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: 29d1ce27-f63b-4523-88be-55f65a6a2529] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:30:51.009810 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-b1fe70e5-4930-433f-a3e7-1990b0cf0062 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:51.010313 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-b1fe70e5-4930-433f-a3e7-1990b0cf0062 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:51.011424 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-b1fe70e5-4930-433f-a3e7-1990b0cf0062 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:51.011921 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-b1fe70e5-4930-433f-a3e7-1990b0cf0062 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:51.170911 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-b1fe70e5-4930-433f-a3e7-1990b0cf0062 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "POST /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529/action" status: 200 len: 28192 microversion: 2.1 time: 0.176228 Feb 17 04:30:51.176300 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 237/425] 10.222.0.78 () {60 vars in 1268 bytes} [Wed Feb 17 04:30:50 2021] POST /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529/action => generated 28192 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 04:30:51.567671 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-353978b9-3380-4422-823c-e7bab4572727 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:30:51.568797 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-353978b9-3380-4422-823c-e7bab4572727 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] [instance: 20760e77-fe67-4ebe-87f1-34d840495341] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:30:51.577441 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-353978b9-3380-4422-823c-e7bab4572727 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:51.577948 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-353978b9-3380-4422-823c-e7bab4572727 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:51.578822 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-353978b9-3380-4422-823c-e7bab4572727 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:51.579364 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-353978b9-3380-4422-823c-e7bab4572727 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:51.601032 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-7b1dc451-12ae-42c5-8192-4925ecf3087a tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88eaaf0dd96340229d9f519b3489cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0608d586fdf4ba4b2b7f7137d49389a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:30:51.611531 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-7b1dc451-12ae-42c5-8192-4925ecf3087a tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] 10.222.0.78 "GET /compute/v2.1/servers/133aedc5-dbda-4b17-93fa-1a41c505a3f5" status: 200 len: 1505 microversion: 2.1 time: 0.808690 Feb 17 04:30:51.612614 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 189/426] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:30:50 2021] GET /compute/v2.1/servers/133aedc5-dbda-4b17-93fa-1a41c505a3f5 => generated 1505 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:30:51.721879 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-f44cabb3-c5d4-4d33-b5ef-bde7867779ca tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:30:51.722916 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-f44cabb3-c5d4-4d33-b5ef-bde7867779ca tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] [instance: ad42ab86-4168-46d3-9394-9fb44fc79d18] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:30:51.732738 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-f44cabb3-c5d4-4d33-b5ef-bde7867779ca tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:51.733244 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-f44cabb3-c5d4-4d33-b5ef-bde7867779ca tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:51.734108 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-f44cabb3-c5d4-4d33-b5ef-bde7867779ca tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:51.734600 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-f44cabb3-c5d4-4d33-b5ef-bde7867779ca tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:51.825375 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-353978b9-3380-4422-823c-e7bab4572727 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1daf9a83b1d24033a3d4c0f531a4eb2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5336afdcf4aa4b46b0655432b7a1323c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:30:51.835007 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-353978b9-3380-4422-823c-e7bab4572727 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] 10.222.0.78 "GET /compute/v2.1/servers/20760e77-fe67-4ebe-87f1-34d840495341" status: 200 len: 1521 microversion: 2.1 time: 0.271852 Feb 17 04:30:51.835850 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 238/427] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:30:51 2021] GET /compute/v2.1/servers/20760e77-fe67-4ebe-87f1-34d840495341 => generated 1521 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:30:52.044173 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-f44cabb3-c5d4-4d33-b5ef-bde7867779ca tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d68d4a6c12e4331b8df8191cdd7a669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2a1ca6347d4278899a1cc009d87d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:30:52.053720 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-f44cabb3-c5d4-4d33-b5ef-bde7867779ca tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] 10.222.0.78 "GET /compute/v2.1/servers/ad42ab86-4168-46d3-9394-9fb44fc79d18" status: 200 len: 1317 microversion: 2.1 time: 0.336800 Feb 17 04:30:52.054338 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 190/428] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:30:51 2021] GET /compute/v2.1/servers/ad42ab86-4168-46d3-9394-9fb44fc79d18 => generated 1317 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:30:52.185235 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-80da8f03-2934-4e1d-ba7a-a09c006d10a9 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:30:52.186493 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-80da8f03-2934-4e1d-ba7a-a09c006d10a9 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: 29d1ce27-f63b-4523-88be-55f65a6a2529] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:30:52.194901 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-80da8f03-2934-4e1d-ba7a-a09c006d10a9 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:52.195541 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-80da8f03-2934-4e1d-ba7a-a09c006d10a9 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:52.196405 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-80da8f03-2934-4e1d-ba7a-a09c006d10a9 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:52.196895 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-80da8f03-2934-4e1d-ba7a-a09c006d10a9 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:52.339529 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [req-7e98f668-8ae7-4128-b7a5-1a0c6aa74ed9 req-daef47c1-d1c5-4110-b337-5e95ef9a20bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "133aedc5-dbda-4b17-93fa-1a41c505a3f5", "name": "network-vif-deleted", "tag": "a9ee15ee-16f6-407c-a5d4-b6cf1d15152f"}]} {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:30:52.341361 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:30:52.341361 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: warnings.warn(msg) Feb 17 04:30:52.352025 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [req-7e98f668-8ae7-4128-b7a5-1a0c6aa74ed9 req-daef47c1-d1c5-4110-b337-5e95ef9a20bd service nova] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:52.352532 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [req-7e98f668-8ae7-4128-b7a5-1a0c6aa74ed9 req-daef47c1-d1c5-4110-b337-5e95ef9a20bd service nova] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:52.370150 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.compute.server_external_events [req-7e98f668-8ae7-4128-b7a5-1a0c6aa74ed9 req-daef47c1-d1c5-4110-b337-5e95ef9a20bd service nova] Creating event network-vif-deleted:a9ee15ee-16f6-407c-a5d4-b6cf1d15152f for instance 133aedc5-dbda-4b17-93fa-1a41c505a3f5 on hv-cinder-75998 Feb 17 04:30:52.375022 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [req-7e98f668-8ae7-4128-b7a5-1a0c6aa74ed9 req-daef47c1-d1c5-4110-b337-5e95ef9a20bd service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040523 Feb 17 04:30:52.375716 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 191/429] 10.222.0.78 () {64 vars in 1308 bytes} [Wed Feb 17 04:30:52 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:30:52.630844 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-3bdef7be-97d8-4bc7-a5cb-fff7958579e1 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:30:52.631854 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-3bdef7be-97d8-4bc7-a5cb-fff7958579e1 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] [instance: 133aedc5-dbda-4b17-93fa-1a41c505a3f5] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:30:52.640941 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-3bdef7be-97d8-4bc7-a5cb-fff7958579e1 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:52.641452 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-3bdef7be-97d8-4bc7-a5cb-fff7958579e1 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:52.642316 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-3bdef7be-97d8-4bc7-a5cb-fff7958579e1 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:52.642816 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-3bdef7be-97d8-4bc7-a5cb-fff7958579e1 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:52.726177 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-3bdef7be-97d8-4bc7-a5cb-fff7958579e1 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:52.726689 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-3bdef7be-97d8-4bc7-a5cb-fff7958579e1 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:52.727226 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.objects.instance [None req-3bdef7be-97d8-4bc7-a5cb-fff7958579e1 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lazy-loading 'fault' on Instance uuid 133aedc5-dbda-4b17-93fa-1a41c505a3f5 {{(pid=98178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Feb 17 04:30:52.815744 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-3bdef7be-97d8-4bc7-a5cb-fff7958579e1 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88eaaf0dd96340229d9f519b3489cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0608d586fdf4ba4b2b7f7137d49389a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:30:52.824616 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-3bdef7be-97d8-4bc7-a5cb-fff7958579e1 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] 10.222.0.78 "GET /compute/v2.1/servers/133aedc5-dbda-4b17-93fa-1a41c505a3f5" status: 200 len: 1304 microversion: 2.1 time: 0.198312 Feb 17 04:30:52.825226 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 192/430] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:30:52 2021] GET /compute/v2.1/servers/133aedc5-dbda-4b17-93fa-1a41c505a3f5 => generated 1304 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:30:52.853668 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-dd6a3a98-2bcc-44b0-afb8-0989f800e478 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:30:52.854333 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-dd6a3a98-2bcc-44b0-afb8-0989f800e478 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] [instance: 20760e77-fe67-4ebe-87f1-34d840495341] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:30:52.862631 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-dd6a3a98-2bcc-44b0-afb8-0989f800e478 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:52.863165 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-dd6a3a98-2bcc-44b0-afb8-0989f800e478 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:52.864013 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-dd6a3a98-2bcc-44b0-afb8-0989f800e478 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:52.864512 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-dd6a3a98-2bcc-44b0-afb8-0989f800e478 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:53.087119 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-dd6a3a98-2bcc-44b0-afb8-0989f800e478 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1daf9a83b1d24033a3d4c0f531a4eb2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5336afdcf4aa4b46b0655432b7a1323c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:30:53.096020 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-dd6a3a98-2bcc-44b0-afb8-0989f800e478 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] 10.222.0.78 "GET /compute/v2.1/servers/20760e77-fe67-4ebe-87f1-34d840495341" status: 200 len: 1521 microversion: 2.1 time: 0.246766 Feb 17 04:30:53.096660 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 193/431] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:30:52 2021] GET /compute/v2.1/servers/20760e77-fe67-4ebe-87f1-34d840495341 => generated 1521 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:30:53.103120 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-79b93623-ec89-4f28-a5a0-e3733476a2b7 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:30:53.103878 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-79b93623-ec89-4f28-a5a0-e3733476a2b7 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] [instance: ad42ab86-4168-46d3-9394-9fb44fc79d18] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:30:53.113880 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-79b93623-ec89-4f28-a5a0-e3733476a2b7 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:53.114393 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-79b93623-ec89-4f28-a5a0-e3733476a2b7 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:53.116174 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-79b93623-ec89-4f28-a5a0-e3733476a2b7 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:53.117198 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-79b93623-ec89-4f28-a5a0-e3733476a2b7 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:53.340315 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-79b93623-ec89-4f28-a5a0-e3733476a2b7 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d68d4a6c12e4331b8df8191cdd7a669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2a1ca6347d4278899a1cc009d87d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:30:53.349063 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-79b93623-ec89-4f28-a5a0-e3733476a2b7 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] 10.222.0.78 "GET /compute/v2.1/servers/ad42ab86-4168-46d3-9394-9fb44fc79d18" status: 200 len: 1317 microversion: 2.1 time: 0.251386 Feb 17 04:30:53.349672 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 194/432] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:30:53 2021] GET /compute/v2.1/servers/ad42ab86-4168-46d3-9394-9fb44fc79d18 => generated 1317 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:30:53.842744 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-ae43630b-618f-42f6-9c30-8f682b6065fb tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:30:53.843373 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-ae43630b-618f-42f6-9c30-8f682b6065fb tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] [instance: 133aedc5-dbda-4b17-93fa-1a41c505a3f5] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:30:53.851451 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-ae43630b-618f-42f6-9c30-8f682b6065fb tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:53.851958 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-ae43630b-618f-42f6-9c30-8f682b6065fb tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:53.852794 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-ae43630b-618f-42f6-9c30-8f682b6065fb tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:53.853289 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-ae43630b-618f-42f6-9c30-8f682b6065fb tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:53.925087 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-ae43630b-618f-42f6-9c30-8f682b6065fb tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:53.925641 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-ae43630b-618f-42f6-9c30-8f682b6065fb tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:53.926080 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.objects.instance [None req-ae43630b-618f-42f6-9c30-8f682b6065fb tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lazy-loading 'fault' on Instance uuid 133aedc5-dbda-4b17-93fa-1a41c505a3f5 {{(pid=98178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Feb 17 04:30:53.990803 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-ae43630b-618f-42f6-9c30-8f682b6065fb tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88eaaf0dd96340229d9f519b3489cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0608d586fdf4ba4b2b7f7137d49389a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:30:53.999486 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-ae43630b-618f-42f6-9c30-8f682b6065fb tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] 10.222.0.78 "GET /compute/v2.1/servers/133aedc5-dbda-4b17-93fa-1a41c505a3f5" status: 200 len: 1304 microversion: 2.1 time: 0.160788 Feb 17 04:30:54.000090 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 195/433] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:30:53 2021] GET /compute/v2.1/servers/133aedc5-dbda-4b17-93fa-1a41c505a3f5 => generated 1304 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:30:54.117182 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-c90ba9e4-abbf-40b2-8303-29f9143ccc26 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:30:54.117861 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-c90ba9e4-abbf-40b2-8303-29f9143ccc26 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] [instance: 20760e77-fe67-4ebe-87f1-34d840495341] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:30:54.125687 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-c90ba9e4-abbf-40b2-8303-29f9143ccc26 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:54.126200 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-c90ba9e4-abbf-40b2-8303-29f9143ccc26 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:54.127105 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-c90ba9e4-abbf-40b2-8303-29f9143ccc26 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:54.127604 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-c90ba9e4-abbf-40b2-8303-29f9143ccc26 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:54.350824 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-c90ba9e4-abbf-40b2-8303-29f9143ccc26 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1daf9a83b1d24033a3d4c0f531a4eb2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5336afdcf4aa4b46b0655432b7a1323c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:30:54.359962 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-c90ba9e4-abbf-40b2-8303-29f9143ccc26 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] 10.222.0.78 "GET /compute/v2.1/servers/20760e77-fe67-4ebe-87f1-34d840495341" status: 200 len: 1521 microversion: 2.1 time: 0.248052 Feb 17 04:30:54.360508 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 196/434] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:30:54 2021] GET /compute/v2.1/servers/20760e77-fe67-4ebe-87f1-34d840495341 => generated 1521 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:30:54.367658 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-47474bed-0475-4471-ae01-23fdd870954c tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:30:54.368340 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-47474bed-0475-4471-ae01-23fdd870954c tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] [instance: ad42ab86-4168-46d3-9394-9fb44fc79d18] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:30:54.375981 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-47474bed-0475-4471-ae01-23fdd870954c tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:54.376502 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-47474bed-0475-4471-ae01-23fdd870954c tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:54.377353 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-47474bed-0475-4471-ae01-23fdd870954c tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:54.377858 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-47474bed-0475-4471-ae01-23fdd870954c tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:54.591981 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-47474bed-0475-4471-ae01-23fdd870954c tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d68d4a6c12e4331b8df8191cdd7a669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2a1ca6347d4278899a1cc009d87d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:30:54.601042 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-47474bed-0475-4471-ae01-23fdd870954c tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] 10.222.0.78 "GET /compute/v2.1/servers/ad42ab86-4168-46d3-9394-9fb44fc79d18" status: 200 len: 1317 microversion: 2.1 time: 0.237060 Feb 17 04:30:54.601642 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 197/435] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:30:54 2021] GET /compute/v2.1/servers/ad42ab86-4168-46d3-9394-9fb44fc79d18 => generated 1317 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:30:55.017530 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-623612b7-b820-4adb-8ef0-dc64a30f8c9e tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:30:55.018204 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-623612b7-b820-4adb-8ef0-dc64a30f8c9e tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] [instance: 133aedc5-dbda-4b17-93fa-1a41c505a3f5] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:30:55.026238 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-623612b7-b820-4adb-8ef0-dc64a30f8c9e tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:55.026749 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-623612b7-b820-4adb-8ef0-dc64a30f8c9e tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:55.027632 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-623612b7-b820-4adb-8ef0-dc64a30f8c9e tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:55.028133 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-623612b7-b820-4adb-8ef0-dc64a30f8c9e tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:55.102132 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-623612b7-b820-4adb-8ef0-dc64a30f8c9e tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:55.102646 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-623612b7-b820-4adb-8ef0-dc64a30f8c9e tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:55.103193 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.objects.instance [None req-623612b7-b820-4adb-8ef0-dc64a30f8c9e tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lazy-loading 'fault' on Instance uuid 133aedc5-dbda-4b17-93fa-1a41c505a3f5 {{(pid=98178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Feb 17 04:30:55.185032 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-623612b7-b820-4adb-8ef0-dc64a30f8c9e tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88eaaf0dd96340229d9f519b3489cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0608d586fdf4ba4b2b7f7137d49389a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:30:55.195447 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-623612b7-b820-4adb-8ef0-dc64a30f8c9e tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] 10.222.0.78 "GET /compute/v2.1/servers/133aedc5-dbda-4b17-93fa-1a41c505a3f5" status: 200 len: 1304 microversion: 2.1 time: 0.181975 Feb 17 04:30:55.196065 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 198/436] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:30:55 2021] GET /compute/v2.1/servers/133aedc5-dbda-4b17-93fa-1a41c505a3f5 => generated 1304 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:30:55.380375 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-38a066cd-57f1-4373-8d66-ca39f798efdf tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:30:55.381718 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-38a066cd-57f1-4373-8d66-ca39f798efdf tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] [instance: 20760e77-fe67-4ebe-87f1-34d840495341] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:30:55.389642 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-38a066cd-57f1-4373-8d66-ca39f798efdf tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:55.390151 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-38a066cd-57f1-4373-8d66-ca39f798efdf tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:55.390988 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-38a066cd-57f1-4373-8d66-ca39f798efdf tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:55.391500 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-38a066cd-57f1-4373-8d66-ca39f798efdf tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:55.618836 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-38a066cd-57f1-4373-8d66-ca39f798efdf tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1daf9a83b1d24033a3d4c0f531a4eb2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5336afdcf4aa4b46b0655432b7a1323c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:30:55.627778 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-38a066cd-57f1-4373-8d66-ca39f798efdf tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] 10.222.0.78 "GET /compute/v2.1/servers/20760e77-fe67-4ebe-87f1-34d840495341" status: 200 len: 1521 microversion: 2.1 time: 0.252381 Feb 17 04:30:55.628387 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 199/437] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:30:55 2021] GET /compute/v2.1/servers/20760e77-fe67-4ebe-87f1-34d840495341 => generated 1521 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:30:55.633281 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-12a8bafc-595c-4077-be22-1633a63cbedf tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:30:55.633901 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-12a8bafc-595c-4077-be22-1633a63cbedf tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] [instance: ad42ab86-4168-46d3-9394-9fb44fc79d18] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:30:55.641668 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-12a8bafc-595c-4077-be22-1633a63cbedf tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:55.642166 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-12a8bafc-595c-4077-be22-1633a63cbedf tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:55.642992 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-12a8bafc-595c-4077-be22-1633a63cbedf tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:55.643622 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-12a8bafc-595c-4077-be22-1633a63cbedf tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:55.866566 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-12a8bafc-595c-4077-be22-1633a63cbedf tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d68d4a6c12e4331b8df8191cdd7a669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2a1ca6347d4278899a1cc009d87d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:30:55.875675 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-12a8bafc-595c-4077-be22-1633a63cbedf tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] 10.222.0.78 "GET /compute/v2.1/servers/ad42ab86-4168-46d3-9394-9fb44fc79d18" status: 200 len: 1317 microversion: 2.1 time: 0.246177 Feb 17 04:30:55.876303 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 200/438] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:30:55 2021] GET /compute/v2.1/servers/ad42ab86-4168-46d3-9394-9fb44fc79d18 => generated 1317 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:30:56.213581 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-b60dfd25-8a3f-4707-919d-0891c546ebe4 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:30:56.214244 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-b60dfd25-8a3f-4707-919d-0891c546ebe4 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] [instance: 133aedc5-dbda-4b17-93fa-1a41c505a3f5] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:30:56.222567 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-b60dfd25-8a3f-4707-919d-0891c546ebe4 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:56.223090 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-b60dfd25-8a3f-4707-919d-0891c546ebe4 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:56.223924 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-b60dfd25-8a3f-4707-919d-0891c546ebe4 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:56.224415 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-b60dfd25-8a3f-4707-919d-0891c546ebe4 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:56.299577 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-b60dfd25-8a3f-4707-919d-0891c546ebe4 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:56.300095 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-b60dfd25-8a3f-4707-919d-0891c546ebe4 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:56.300635 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.objects.instance [None req-b60dfd25-8a3f-4707-919d-0891c546ebe4 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lazy-loading 'fault' on Instance uuid 133aedc5-dbda-4b17-93fa-1a41c505a3f5 {{(pid=98178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Feb 17 04:30:56.367943 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-b60dfd25-8a3f-4707-919d-0891c546ebe4 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88eaaf0dd96340229d9f519b3489cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0608d586fdf4ba4b2b7f7137d49389a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:30:56.377236 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-b60dfd25-8a3f-4707-919d-0891c546ebe4 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] 10.222.0.78 "GET /compute/v2.1/servers/133aedc5-dbda-4b17-93fa-1a41c505a3f5" status: 200 len: 1304 microversion: 2.1 time: 0.167736 Feb 17 04:30:56.377856 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 201/439] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:30:56 2021] GET /compute/v2.1/servers/133aedc5-dbda-4b17-93fa-1a41c505a3f5 => generated 1304 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:30:56.650914 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-7531d4f1-a44e-4425-b621-48d1e04bef45 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:30:56.651622 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-7531d4f1-a44e-4425-b621-48d1e04bef45 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] [instance: 20760e77-fe67-4ebe-87f1-34d840495341] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:30:56.659477 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-7531d4f1-a44e-4425-b621-48d1e04bef45 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:56.659989 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-7531d4f1-a44e-4425-b621-48d1e04bef45 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:56.660827 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-7531d4f1-a44e-4425-b621-48d1e04bef45 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:56.661324 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-7531d4f1-a44e-4425-b621-48d1e04bef45 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:56.887634 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-7531d4f1-a44e-4425-b621-48d1e04bef45 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1daf9a83b1d24033a3d4c0f531a4eb2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5336afdcf4aa4b46b0655432b7a1323c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:30:56.898381 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-7531d4f1-a44e-4425-b621-48d1e04bef45 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] 10.222.0.78 "GET /compute/v2.1/servers/20760e77-fe67-4ebe-87f1-34d840495341" status: 200 len: 1521 microversion: 2.1 time: 0.251218 Feb 17 04:30:56.898997 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 202/440] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:30:56 2021] GET /compute/v2.1/servers/20760e77-fe67-4ebe-87f1-34d840495341 => generated 1521 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:30:56.903832 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-5c303138-1512-4ce5-b435-6e387916daf9 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:30:56.904531 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-5c303138-1512-4ce5-b435-6e387916daf9 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] [instance: ad42ab86-4168-46d3-9394-9fb44fc79d18] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:30:56.912164 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-5c303138-1512-4ce5-b435-6e387916daf9 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:56.913741 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-5c303138-1512-4ce5-b435-6e387916daf9 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:56.914580 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-5c303138-1512-4ce5-b435-6e387916daf9 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:56.915094 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-5c303138-1512-4ce5-b435-6e387916daf9 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:57.132344 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-5c303138-1512-4ce5-b435-6e387916daf9 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d68d4a6c12e4331b8df8191cdd7a669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2a1ca6347d4278899a1cc009d87d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:30:57.142395 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-5c303138-1512-4ce5-b435-6e387916daf9 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] 10.222.0.78 "GET /compute/v2.1/servers/ad42ab86-4168-46d3-9394-9fb44fc79d18" status: 200 len: 1317 microversion: 2.1 time: 0.242294 Feb 17 04:30:57.143242 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 203/441] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:30:56 2021] GET /compute/v2.1/servers/ad42ab86-4168-46d3-9394-9fb44fc79d18 => generated 1317 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:30:57.448429 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-09b4f55c-eaea-401f-8911-572a161cf08c tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:30:57.449118 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-09b4f55c-eaea-401f-8911-572a161cf08c tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] [instance: 133aedc5-dbda-4b17-93fa-1a41c505a3f5] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:30:57.457167 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-09b4f55c-eaea-401f-8911-572a161cf08c tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:57.457681 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-09b4f55c-eaea-401f-8911-572a161cf08c tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:57.458529 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-09b4f55c-eaea-401f-8911-572a161cf08c tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:57.459748 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-09b4f55c-eaea-401f-8911-572a161cf08c tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:57.532117 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-09b4f55c-eaea-401f-8911-572a161cf08c tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:57.532635 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-09b4f55c-eaea-401f-8911-572a161cf08c tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:57.533144 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.objects.instance [None req-09b4f55c-eaea-401f-8911-572a161cf08c tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lazy-loading 'fault' on Instance uuid 133aedc5-dbda-4b17-93fa-1a41c505a3f5 {{(pid=98178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Feb 17 04:30:57.603109 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-09b4f55c-eaea-401f-8911-572a161cf08c tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88eaaf0dd96340229d9f519b3489cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0608d586fdf4ba4b2b7f7137d49389a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:30:57.612369 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-09b4f55c-eaea-401f-8911-572a161cf08c tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] 10.222.0.78 "GET /compute/v2.1/servers/133aedc5-dbda-4b17-93fa-1a41c505a3f5" status: 200 len: 1304 microversion: 2.1 time: 0.168324 Feb 17 04:30:57.612969 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 204/442] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:30:57 2021] GET /compute/v2.1/servers/133aedc5-dbda-4b17-93fa-1a41c505a3f5 => generated 1304 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:30:57.917647 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-324ef9c6-7ead-4885-9321-98f22f8c5965 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:30:57.918232 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-324ef9c6-7ead-4885-9321-98f22f8c5965 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] [instance: 20760e77-fe67-4ebe-87f1-34d840495341] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:30:57.926058 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-324ef9c6-7ead-4885-9321-98f22f8c5965 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:57.926558 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-324ef9c6-7ead-4885-9321-98f22f8c5965 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:57.927411 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-324ef9c6-7ead-4885-9321-98f22f8c5965 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:57.928572 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-324ef9c6-7ead-4885-9321-98f22f8c5965 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:58.150872 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-324ef9c6-7ead-4885-9321-98f22f8c5965 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1daf9a83b1d24033a3d4c0f531a4eb2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5336afdcf4aa4b46b0655432b7a1323c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:30:58.160198 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-324ef9c6-7ead-4885-9321-98f22f8c5965 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] 10.222.0.78 "GET /compute/v2.1/servers/20760e77-fe67-4ebe-87f1-34d840495341" status: 200 len: 1521 microversion: 2.1 time: 0.246564 Feb 17 04:30:58.160813 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 205/443] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:30:57 2021] GET /compute/v2.1/servers/20760e77-fe67-4ebe-87f1-34d840495341 => generated 1521 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:30:58.166082 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-2b15e3bc-0fbd-479d-914a-7780ad35586f tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:30:58.166751 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-2b15e3bc-0fbd-479d-914a-7780ad35586f tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] [instance: ad42ab86-4168-46d3-9394-9fb44fc79d18] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:30:58.175934 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-2b15e3bc-0fbd-479d-914a-7780ad35586f tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:58.176366 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-2b15e3bc-0fbd-479d-914a-7780ad35586f tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:58.177235 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-2b15e3bc-0fbd-479d-914a-7780ad35586f tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:58.178321 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-2b15e3bc-0fbd-479d-914a-7780ad35586f tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:58.398246 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-2b15e3bc-0fbd-479d-914a-7780ad35586f tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d68d4a6c12e4331b8df8191cdd7a669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2a1ca6347d4278899a1cc009d87d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:30:58.407134 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-2b15e3bc-0fbd-479d-914a-7780ad35586f tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] 10.222.0.78 "GET /compute/v2.1/servers/ad42ab86-4168-46d3-9394-9fb44fc79d18" status: 200 len: 1317 microversion: 2.1 time: 0.245272 Feb 17 04:30:58.407743 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 206/444] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:30:58 2021] GET /compute/v2.1/servers/ad42ab86-4168-46d3-9394-9fb44fc79d18 => generated 1317 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:30:58.629817 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-4b7b7b8b-cb1f-4e1d-8602-d137465ff297 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:30:58.630488 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-4b7b7b8b-cb1f-4e1d-8602-d137465ff297 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] [instance: 133aedc5-dbda-4b17-93fa-1a41c505a3f5] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:30:58.639860 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-4b7b7b8b-cb1f-4e1d-8602-d137465ff297 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:58.640382 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-4b7b7b8b-cb1f-4e1d-8602-d137465ff297 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:58.641254 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-4b7b7b8b-cb1f-4e1d-8602-d137465ff297 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:58.641752 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-4b7b7b8b-cb1f-4e1d-8602-d137465ff297 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:58.719411 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-4b7b7b8b-cb1f-4e1d-8602-d137465ff297 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:58.719921 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-4b7b7b8b-cb1f-4e1d-8602-d137465ff297 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:58.720432 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.objects.instance [None req-4b7b7b8b-cb1f-4e1d-8602-d137465ff297 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lazy-loading 'fault' on Instance uuid 133aedc5-dbda-4b17-93fa-1a41c505a3f5 {{(pid=98178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Feb 17 04:30:58.784712 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-4b7b7b8b-cb1f-4e1d-8602-d137465ff297 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88eaaf0dd96340229d9f519b3489cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0608d586fdf4ba4b2b7f7137d49389a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:30:58.795175 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-4b7b7b8b-cb1f-4e1d-8602-d137465ff297 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] 10.222.0.78 "GET /compute/v2.1/servers/133aedc5-dbda-4b17-93fa-1a41c505a3f5" status: 200 len: 1304 microversion: 2.1 time: 0.169021 Feb 17 04:30:58.796005 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 207/445] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:30:58 2021] GET /compute/v2.1/servers/133aedc5-dbda-4b17-93fa-1a41c505a3f5 => generated 1304 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:30:59.180429 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-9dffbff0-95c8-4edd-9e52-39ac6b40e453 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:30:59.181255 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-9dffbff0-95c8-4edd-9e52-39ac6b40e453 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] [instance: 20760e77-fe67-4ebe-87f1-34d840495341] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:30:59.189445 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-9dffbff0-95c8-4edd-9e52-39ac6b40e453 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:59.190188 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-9dffbff0-95c8-4edd-9e52-39ac6b40e453 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:59.191346 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-9dffbff0-95c8-4edd-9e52-39ac6b40e453 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:59.191866 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-9dffbff0-95c8-4edd-9e52-39ac6b40e453 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:59.420067 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-9dffbff0-95c8-4edd-9e52-39ac6b40e453 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1daf9a83b1d24033a3d4c0f531a4eb2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5336afdcf4aa4b46b0655432b7a1323c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:30:59.429715 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-9dffbff0-95c8-4edd-9e52-39ac6b40e453 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] 10.222.0.78 "GET /compute/v2.1/servers/20760e77-fe67-4ebe-87f1-34d840495341" status: 200 len: 1521 microversion: 2.1 time: 0.254250 Feb 17 04:30:59.430455 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 208/446] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:30:59 2021] GET /compute/v2.1/servers/20760e77-fe67-4ebe-87f1-34d840495341 => generated 1521 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:30:59.434953 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-26e84ce9-d618-487d-b9be-dd685383640b tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:30:59.435634 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-26e84ce9-d618-487d-b9be-dd685383640b tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] [instance: ad42ab86-4168-46d3-9394-9fb44fc79d18] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:30:59.442969 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-26e84ce9-d618-487d-b9be-dd685383640b tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:59.443503 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-26e84ce9-d618-487d-b9be-dd685383640b tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:59.444513 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-26e84ce9-d618-487d-b9be-dd685383640b tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:59.444922 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-26e84ce9-d618-487d-b9be-dd685383640b tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:59.661213 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-26e84ce9-d618-487d-b9be-dd685383640b tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d68d4a6c12e4331b8df8191cdd7a669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2a1ca6347d4278899a1cc009d87d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:30:59.671014 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-26e84ce9-d618-487d-b9be-dd685383640b tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] 10.222.0.78 "GET /compute/v2.1/servers/ad42ab86-4168-46d3-9394-9fb44fc79d18" status: 200 len: 1317 microversion: 2.1 time: 0.239538 Feb 17 04:30:59.671640 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 209/447] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:30:59 2021] GET /compute/v2.1/servers/ad42ab86-4168-46d3-9394-9fb44fc79d18 => generated 1317 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:30:59.813231 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-b28493e1-a8d8-4aaa-8532-f471a7ab0d8d tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:30:59.814059 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-b28493e1-a8d8-4aaa-8532-f471a7ab0d8d tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] [instance: 133aedc5-dbda-4b17-93fa-1a41c505a3f5] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:30:59.825042 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-b28493e1-a8d8-4aaa-8532-f471a7ab0d8d tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:59.825673 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-b28493e1-a8d8-4aaa-8532-f471a7ab0d8d tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:59.826717 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-b28493e1-a8d8-4aaa-8532-f471a7ab0d8d tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:59.827364 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-b28493e1-a8d8-4aaa-8532-f471a7ab0d8d tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:59.904096 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-b28493e1-a8d8-4aaa-8532-f471a7ab0d8d tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:30:59.904530 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-b28493e1-a8d8-4aaa-8532-f471a7ab0d8d tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:30:59.905039 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.objects.instance [None req-b28493e1-a8d8-4aaa-8532-f471a7ab0d8d tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lazy-loading 'fault' on Instance uuid 133aedc5-dbda-4b17-93fa-1a41c505a3f5 {{(pid=98178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Feb 17 04:30:59.971116 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-b28493e1-a8d8-4aaa-8532-f471a7ab0d8d tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88eaaf0dd96340229d9f519b3489cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0608d586fdf4ba4b2b7f7137d49389a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:30:59.980618 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-b28493e1-a8d8-4aaa-8532-f471a7ab0d8d tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] 10.222.0.78 "GET /compute/v2.1/servers/133aedc5-dbda-4b17-93fa-1a41c505a3f5" status: 200 len: 1304 microversion: 2.1 time: 0.171605 Feb 17 04:30:59.981376 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 210/448] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:30:59 2021] GET /compute/v2.1/servers/133aedc5-dbda-4b17-93fa-1a41c505a3f5 => generated 1304 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:31:00.449097 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-36b7b525-a51b-4dc0-98e9-faf5464a878f tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:31:00.449714 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-36b7b525-a51b-4dc0-98e9-faf5464a878f tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] [instance: 20760e77-fe67-4ebe-87f1-34d840495341] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:31:00.457634 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-36b7b525-a51b-4dc0-98e9-faf5464a878f tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:31:00.458150 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-36b7b525-a51b-4dc0-98e9-faf5464a878f tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:31:00.458994 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-36b7b525-a51b-4dc0-98e9-faf5464a878f tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:31:00.460210 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-36b7b525-a51b-4dc0-98e9-faf5464a878f tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:31:00.679050 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-36b7b525-a51b-4dc0-98e9-faf5464a878f tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1daf9a83b1d24033a3d4c0f531a4eb2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5336afdcf4aa4b46b0655432b7a1323c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:31:00.689615 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-36b7b525-a51b-4dc0-98e9-faf5464a878f tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] 10.222.0.78 "GET /compute/v2.1/servers/20760e77-fe67-4ebe-87f1-34d840495341" status: 200 len: 1521 microversion: 2.1 time: 0.244744 Feb 17 04:31:00.690782 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 211/449] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:31:00 2021] GET /compute/v2.1/servers/20760e77-fe67-4ebe-87f1-34d840495341 => generated 1521 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:31:00.696217 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-12c17f4d-656f-44a8-bcb6-b394ea8be6d2 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:31:00.696890 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-12c17f4d-656f-44a8-bcb6-b394ea8be6d2 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] [instance: ad42ab86-4168-46d3-9394-9fb44fc79d18] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:31:00.710942 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-12c17f4d-656f-44a8-bcb6-b394ea8be6d2 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:31:00.711551 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-12c17f4d-656f-44a8-bcb6-b394ea8be6d2 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:31:00.712423 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-12c17f4d-656f-44a8-bcb6-b394ea8be6d2 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:31:00.712922 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-12c17f4d-656f-44a8-bcb6-b394ea8be6d2 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:31:00.933690 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-12c17f4d-656f-44a8-bcb6-b394ea8be6d2 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d68d4a6c12e4331b8df8191cdd7a669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2a1ca6347d4278899a1cc009d87d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:31:00.942595 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-12c17f4d-656f-44a8-bcb6-b394ea8be6d2 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] 10.222.0.78 "GET /compute/v2.1/servers/ad42ab86-4168-46d3-9394-9fb44fc79d18" status: 200 len: 1317 microversion: 2.1 time: 0.250888 Feb 17 04:31:00.943220 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 212/450] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:31:00 2021] GET /compute/v2.1/servers/ad42ab86-4168-46d3-9394-9fb44fc79d18 => generated 1317 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:31:00.997538 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-d13615f1-b575-44f7-aab3-1fc69704134a tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:31:00.998210 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-d13615f1-b575-44f7-aab3-1fc69704134a tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] [instance: 133aedc5-dbda-4b17-93fa-1a41c505a3f5] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:31:01.005916 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-d13615f1-b575-44f7-aab3-1fc69704134a tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:31:01.007598 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-d13615f1-b575-44f7-aab3-1fc69704134a tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:31:01.008503 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-d13615f1-b575-44f7-aab3-1fc69704134a tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:31:01.009004 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-d13615f1-b575-44f7-aab3-1fc69704134a tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:31:01.082354 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-d13615f1-b575-44f7-aab3-1fc69704134a tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:31:01.082860 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-d13615f1-b575-44f7-aab3-1fc69704134a tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:31:01.083398 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.objects.instance [None req-d13615f1-b575-44f7-aab3-1fc69704134a tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lazy-loading 'fault' on Instance uuid 133aedc5-dbda-4b17-93fa-1a41c505a3f5 {{(pid=98178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Feb 17 04:31:01.149063 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-d13615f1-b575-44f7-aab3-1fc69704134a tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88eaaf0dd96340229d9f519b3489cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0608d586fdf4ba4b2b7f7137d49389a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:31:01.157946 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-d13615f1-b575-44f7-aab3-1fc69704134a tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] 10.222.0.78 "GET /compute/v2.1/servers/133aedc5-dbda-4b17-93fa-1a41c505a3f5" status: 200 len: 1304 microversion: 2.1 time: 0.164219 Feb 17 04:31:01.158546 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 213/451] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:31:00 2021] GET /compute/v2.1/servers/133aedc5-dbda-4b17-93fa-1a41c505a3f5 => generated 1304 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:31:01.709165 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-cf551d1d-9a1b-4ae6-a962-93535d19245e tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:31:01.709941 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-cf551d1d-9a1b-4ae6-a962-93535d19245e tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] [instance: 20760e77-fe67-4ebe-87f1-34d840495341] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:31:01.718668 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-cf551d1d-9a1b-4ae6-a962-93535d19245e tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:31:01.719220 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-cf551d1d-9a1b-4ae6-a962-93535d19245e tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:31:01.720078 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-cf551d1d-9a1b-4ae6-a962-93535d19245e tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:31:01.720579 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-cf551d1d-9a1b-4ae6-a962-93535d19245e tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:31:01.937690 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-cf551d1d-9a1b-4ae6-a962-93535d19245e tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1daf9a83b1d24033a3d4c0f531a4eb2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5336afdcf4aa4b46b0655432b7a1323c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:31:01.946413 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-cf551d1d-9a1b-4ae6-a962-93535d19245e tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] 10.222.0.78 "GET /compute/v2.1/servers/20760e77-fe67-4ebe-87f1-34d840495341" status: 200 len: 1521 microversion: 2.1 time: 0.241387 Feb 17 04:31:01.947016 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 214/452] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:31:01 2021] GET /compute/v2.1/servers/20760e77-fe67-4ebe-87f1-34d840495341 => generated 1521 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:31:01.961084 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-93aa267c-975d-4d44-bb2a-d8afb4f4673e tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:31:01.961690 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-93aa267c-975d-4d44-bb2a-d8afb4f4673e tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] [instance: ad42ab86-4168-46d3-9394-9fb44fc79d18] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:31:01.969357 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-93aa267c-975d-4d44-bb2a-d8afb4f4673e tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:31:01.969863 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-93aa267c-975d-4d44-bb2a-d8afb4f4673e tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:31:01.970695 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-93aa267c-975d-4d44-bb2a-d8afb4f4673e tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:31:01.971213 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-93aa267c-975d-4d44-bb2a-d8afb4f4673e tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:31:02.488351 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-93aa267c-975d-4d44-bb2a-d8afb4f4673e tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d68d4a6c12e4331b8df8191cdd7a669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2a1ca6347d4278899a1cc009d87d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:31:02.497114 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-93aa267c-975d-4d44-bb2a-d8afb4f4673e tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] 10.222.0.78 "GET /compute/v2.1/servers/ad42ab86-4168-46d3-9394-9fb44fc79d18" status: 200 len: 1317 microversion: 2.1 time: 0.540036 Feb 17 04:31:02.497713 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 215/453] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:31:01 2021] GET /compute/v2.1/servers/ad42ab86-4168-46d3-9394-9fb44fc79d18 => generated 1317 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:31:02.502287 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-afd430c2-089f-43aa-a77a-76c8bcbc6fcf tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:31:02.502950 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-afd430c2-089f-43aa-a77a-76c8bcbc6fcf tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] [instance: 133aedc5-dbda-4b17-93fa-1a41c505a3f5] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:31:02.511473 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-afd430c2-089f-43aa-a77a-76c8bcbc6fcf tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:31:02.511972 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-afd430c2-089f-43aa-a77a-76c8bcbc6fcf tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:31:02.512815 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-afd430c2-089f-43aa-a77a-76c8bcbc6fcf tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:31:02.513307 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-afd430c2-089f-43aa-a77a-76c8bcbc6fcf tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:31:02.588948 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-afd430c2-089f-43aa-a77a-76c8bcbc6fcf tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:31:02.589460 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-afd430c2-089f-43aa-a77a-76c8bcbc6fcf tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:31:02.589980 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.objects.instance [None req-afd430c2-089f-43aa-a77a-76c8bcbc6fcf tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lazy-loading 'fault' on Instance uuid 133aedc5-dbda-4b17-93fa-1a41c505a3f5 {{(pid=98178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Feb 17 04:31:02.690355 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-afd430c2-089f-43aa-a77a-76c8bcbc6fcf tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88eaaf0dd96340229d9f519b3489cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0608d586fdf4ba4b2b7f7137d49389a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:31:02.699870 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-afd430c2-089f-43aa-a77a-76c8bcbc6fcf tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] 10.222.0.78 "GET /compute/v2.1/servers/133aedc5-dbda-4b17-93fa-1a41c505a3f5" status: 200 len: 1304 microversion: 2.1 time: 0.201119 Feb 17 04:31:02.700484 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 216/454] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:31:02 2021] GET /compute/v2.1/servers/133aedc5-dbda-4b17-93fa-1a41c505a3f5 => generated 1304 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:31:02.964657 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-dea9e3b1-1e3e-486a-860f-2fc4c643d0c1 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:31:02.965250 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-dea9e3b1-1e3e-486a-860f-2fc4c643d0c1 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] [instance: 20760e77-fe67-4ebe-87f1-34d840495341] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:31:02.972989 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-dea9e3b1-1e3e-486a-860f-2fc4c643d0c1 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:31:02.973495 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-dea9e3b1-1e3e-486a-860f-2fc4c643d0c1 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:31:02.974330 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-dea9e3b1-1e3e-486a-860f-2fc4c643d0c1 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:31:02.974817 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-dea9e3b1-1e3e-486a-860f-2fc4c643d0c1 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:31:03.215266 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-dea9e3b1-1e3e-486a-860f-2fc4c643d0c1 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1daf9a83b1d24033a3d4c0f531a4eb2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5336afdcf4aa4b46b0655432b7a1323c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:31:03.224196 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-dea9e3b1-1e3e-486a-860f-2fc4c643d0c1 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] 10.222.0.78 "GET /compute/v2.1/servers/20760e77-fe67-4ebe-87f1-34d840495341" status: 200 len: 1521 microversion: 2.1 time: 0.263644 Feb 17 04:31:03.224795 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 217/455] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:31:02 2021] GET /compute/v2.1/servers/20760e77-fe67-4ebe-87f1-34d840495341 => generated 1521 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:31:03.514428 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-925eb0e2-3a9e-4cd6-a9a2-8bbef07980f7 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:31:03.515212 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-925eb0e2-3a9e-4cd6-a9a2-8bbef07980f7 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] [instance: ad42ab86-4168-46d3-9394-9fb44fc79d18] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:31:03.523761 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-925eb0e2-3a9e-4cd6-a9a2-8bbef07980f7 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:31:03.524280 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-925eb0e2-3a9e-4cd6-a9a2-8bbef07980f7 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:31:03.525115 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-925eb0e2-3a9e-4cd6-a9a2-8bbef07980f7 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:31:03.525611 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-925eb0e2-3a9e-4cd6-a9a2-8bbef07980f7 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:31:03.736754 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-925eb0e2-3a9e-4cd6-a9a2-8bbef07980f7 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d68d4a6c12e4331b8df8191cdd7a669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2a1ca6347d4278899a1cc009d87d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:31:03.746489 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-925eb0e2-3a9e-4cd6-a9a2-8bbef07980f7 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] 10.222.0.78 "GET /compute/v2.1/servers/ad42ab86-4168-46d3-9394-9fb44fc79d18" status: 200 len: 1317 microversion: 2.1 time: 0.235989 Feb 17 04:31:03.747110 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 218/456] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:31:03 2021] GET /compute/v2.1/servers/ad42ab86-4168-46d3-9394-9fb44fc79d18 => generated 1317 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:31:03.751645 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-6b05d256-91b0-4608-9e1b-3c07ef05bb7a tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:31:03.752311 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-6b05d256-91b0-4608-9e1b-3c07ef05bb7a tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] [instance: 133aedc5-dbda-4b17-93fa-1a41c505a3f5] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:31:03.760576 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-6b05d256-91b0-4608-9e1b-3c07ef05bb7a tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:31:03.761029 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-6b05d256-91b0-4608-9e1b-3c07ef05bb7a tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:31:03.761868 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-6b05d256-91b0-4608-9e1b-3c07ef05bb7a tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:31:03.762366 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-6b05d256-91b0-4608-9e1b-3c07ef05bb7a tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:31:03.836751 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-6b05d256-91b0-4608-9e1b-3c07ef05bb7a tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:31:03.837266 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-6b05d256-91b0-4608-9e1b-3c07ef05bb7a tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:31:03.837770 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.objects.instance [None req-6b05d256-91b0-4608-9e1b-3c07ef05bb7a tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lazy-loading 'fault' on Instance uuid 133aedc5-dbda-4b17-93fa-1a41c505a3f5 {{(pid=98178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Feb 17 04:31:03.905418 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-6b05d256-91b0-4608-9e1b-3c07ef05bb7a tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88eaaf0dd96340229d9f519b3489cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0608d586fdf4ba4b2b7f7137d49389a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:31:03.914863 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-6b05d256-91b0-4608-9e1b-3c07ef05bb7a tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] 10.222.0.78 "GET /compute/v2.1/servers/133aedc5-dbda-4b17-93fa-1a41c505a3f5" status: 200 len: 1304 microversion: 2.1 time: 0.166628 Feb 17 04:31:03.915512 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 219/457] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:31:03 2021] GET /compute/v2.1/servers/133aedc5-dbda-4b17-93fa-1a41c505a3f5 => generated 1304 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:31:04.244197 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-58bfdddb-dd3f-48b8-a17f-f4170ecabefe tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:31:04.244876 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-58bfdddb-dd3f-48b8-a17f-f4170ecabefe tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] [instance: 20760e77-fe67-4ebe-87f1-34d840495341] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:31:04.254100 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-58bfdddb-dd3f-48b8-a17f-f4170ecabefe tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:31:04.254617 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-58bfdddb-dd3f-48b8-a17f-f4170ecabefe tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:31:04.255523 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-58bfdddb-dd3f-48b8-a17f-f4170ecabefe tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:31:04.256023 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-58bfdddb-dd3f-48b8-a17f-f4170ecabefe tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:31:04.467340 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-58bfdddb-dd3f-48b8-a17f-f4170ecabefe tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1daf9a83b1d24033a3d4c0f531a4eb2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5336afdcf4aa4b46b0655432b7a1323c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:31:04.476762 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-58bfdddb-dd3f-48b8-a17f-f4170ecabefe tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] 10.222.0.78 "GET /compute/v2.1/servers/20760e77-fe67-4ebe-87f1-34d840495341" status: 200 len: 1521 microversion: 2.1 time: 0.236670 Feb 17 04:31:04.477438 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 220/458] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:31:04 2021] GET /compute/v2.1/servers/20760e77-fe67-4ebe-87f1-34d840495341 => generated 1521 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:31:04.764436 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-97ff84a5-8acd-49f1-b1a2-3ee6791df713 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:31:04.765112 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-97ff84a5-8acd-49f1-b1a2-3ee6791df713 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] [instance: ad42ab86-4168-46d3-9394-9fb44fc79d18] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:31:04.773153 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-97ff84a5-8acd-49f1-b1a2-3ee6791df713 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:31:04.774142 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-97ff84a5-8acd-49f1-b1a2-3ee6791df713 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:31:04.774998 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-97ff84a5-8acd-49f1-b1a2-3ee6791df713 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:31:04.775522 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-97ff84a5-8acd-49f1-b1a2-3ee6791df713 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:31:04.990108 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-97ff84a5-8acd-49f1-b1a2-3ee6791df713 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d68d4a6c12e4331b8df8191cdd7a669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2a1ca6347d4278899a1cc009d87d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:31:04.999360 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-97ff84a5-8acd-49f1-b1a2-3ee6791df713 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] 10.222.0.78 "GET /compute/v2.1/servers/ad42ab86-4168-46d3-9394-9fb44fc79d18" status: 200 len: 1317 microversion: 2.1 time: 0.238925 Feb 17 04:31:04.999965 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 221/459] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:31:04 2021] GET /compute/v2.1/servers/ad42ab86-4168-46d3-9394-9fb44fc79d18 => generated 1317 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:31:05.004496 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-fcb470c7-41e3-44fc-a7df-18b06fee81f8 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:31:05.005161 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-fcb470c7-41e3-44fc-a7df-18b06fee81f8 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] [instance: 133aedc5-dbda-4b17-93fa-1a41c505a3f5] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:31:05.012606 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-fcb470c7-41e3-44fc-a7df-18b06fee81f8 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:31:05.013104 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-fcb470c7-41e3-44fc-a7df-18b06fee81f8 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:31:05.013929 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-fcb470c7-41e3-44fc-a7df-18b06fee81f8 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:31:05.014418 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-fcb470c7-41e3-44fc-a7df-18b06fee81f8 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:31:05.087634 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-fcb470c7-41e3-44fc-a7df-18b06fee81f8 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:31:05.088345 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-fcb470c7-41e3-44fc-a7df-18b06fee81f8 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:31:05.088681 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.objects.instance [None req-fcb470c7-41e3-44fc-a7df-18b06fee81f8 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lazy-loading 'fault' on Instance uuid 133aedc5-dbda-4b17-93fa-1a41c505a3f5 {{(pid=98178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Feb 17 04:31:05.153050 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-fcb470c7-41e3-44fc-a7df-18b06fee81f8 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88eaaf0dd96340229d9f519b3489cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0608d586fdf4ba4b2b7f7137d49389a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:31:05.161747 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-fcb470c7-41e3-44fc-a7df-18b06fee81f8 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] 10.222.0.78 "GET /compute/v2.1/servers/133aedc5-dbda-4b17-93fa-1a41c505a3f5" status: 200 len: 1304 microversion: 2.1 time: 0.160771 Feb 17 04:31:05.162337 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 222/460] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:31:04 2021] GET /compute/v2.1/servers/133aedc5-dbda-4b17-93fa-1a41c505a3f5 => generated 1304 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:31:05.179823 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-80da8f03-2934-4e1d-ba7a-a09c006d10a9 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "POST /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529/action" status: 200 len: 28192 microversion: 2.1 time: 12.998114 Feb 17 04:31:05.180568 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 239/461] 10.222.0.78 () {60 vars in 1268 bytes} [Wed Feb 17 04:30:52 2021] POST /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529/action => generated 28192 bytes in 13000 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 04:31:05.495651 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-3a6818fd-e6a5-4be7-9fa4-f4ea411a2293 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:31:05.496314 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-3a6818fd-e6a5-4be7-9fa4-f4ea411a2293 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] [instance: 20760e77-fe67-4ebe-87f1-34d840495341] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:31:05.504108 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-3a6818fd-e6a5-4be7-9fa4-f4ea411a2293 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:31:05.504617 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-3a6818fd-e6a5-4be7-9fa4-f4ea411a2293 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:31:05.505448 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-3a6818fd-e6a5-4be7-9fa4-f4ea411a2293 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:31:05.505933 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-3a6818fd-e6a5-4be7-9fa4-f4ea411a2293 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:31:05.727362 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-3a6818fd-e6a5-4be7-9fa4-f4ea411a2293 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1daf9a83b1d24033a3d4c0f531a4eb2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5336afdcf4aa4b46b0655432b7a1323c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:31:05.736442 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-3a6818fd-e6a5-4be7-9fa4-f4ea411a2293 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] 10.222.0.78 "GET /compute/v2.1/servers/20760e77-fe67-4ebe-87f1-34d840495341" status: 200 len: 1521 microversion: 2.1 time: 0.244962 Feb 17 04:31:05.737499 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 223/462] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:31:05 2021] GET /compute/v2.1/servers/20760e77-fe67-4ebe-87f1-34d840495341 => generated 1521 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:31:06.018431 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-409c273d-0e89-4634-8a3e-2aff460b116f tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:31:06.019229 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-409c273d-0e89-4634-8a3e-2aff460b116f tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] [instance: ad42ab86-4168-46d3-9394-9fb44fc79d18] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:31:06.027890 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-409c273d-0e89-4634-8a3e-2aff460b116f tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:31:06.028404 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-409c273d-0e89-4634-8a3e-2aff460b116f tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:31:06.029237 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-409c273d-0e89-4634-8a3e-2aff460b116f tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:31:06.029731 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-409c273d-0e89-4634-8a3e-2aff460b116f tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:31:06.182618 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-db9e8031-104a-4a76-8366-84316dbb5187 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:31:06.183326 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-db9e8031-104a-4a76-8366-84316dbb5187 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] [instance: 133aedc5-dbda-4b17-93fa-1a41c505a3f5] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:31:06.194066 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-db9e8031-104a-4a76-8366-84316dbb5187 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:31:06.194579 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-db9e8031-104a-4a76-8366-84316dbb5187 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:31:06.196033 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-db9e8031-104a-4a76-8366-84316dbb5187 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:31:06.196534 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-db9e8031-104a-4a76-8366-84316dbb5187 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:31:06.245492 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-409c273d-0e89-4634-8a3e-2aff460b116f tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d68d4a6c12e4331b8df8191cdd7a669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2a1ca6347d4278899a1cc009d87d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:31:06.254559 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-409c273d-0e89-4634-8a3e-2aff460b116f tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] 10.222.0.78 "GET /compute/v2.1/servers/ad42ab86-4168-46d3-9394-9fb44fc79d18" status: 200 len: 1317 microversion: 2.1 time: 0.240483 Feb 17 04:31:06.255209 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 240/463] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:31:06 2021] GET /compute/v2.1/servers/ad42ab86-4168-46d3-9394-9fb44fc79d18 => generated 1317 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:31:06.260564 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-08d5e2de-6749-4615-b8b7-7948e83a0796 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:31:06.261602 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-08d5e2de-6749-4615-b8b7-7948e83a0796 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: 29d1ce27-f63b-4523-88be-55f65a6a2529] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:31:06.269264 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-08d5e2de-6749-4615-b8b7-7948e83a0796 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:31:06.269778 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-08d5e2de-6749-4615-b8b7-7948e83a0796 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:31:06.270627 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-08d5e2de-6749-4615-b8b7-7948e83a0796 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:31:06.271136 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-08d5e2de-6749-4615-b8b7-7948e83a0796 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:31:06.275594 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-db9e8031-104a-4a76-8366-84316dbb5187 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:31:06.276113 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-db9e8031-104a-4a76-8366-84316dbb5187 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:31:06.276623 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.objects.instance [None req-db9e8031-104a-4a76-8366-84316dbb5187 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lazy-loading 'fault' on Instance uuid 133aedc5-dbda-4b17-93fa-1a41c505a3f5 {{(pid=98178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Feb 17 04:31:06.340395 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-db9e8031-104a-4a76-8366-84316dbb5187 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88eaaf0dd96340229d9f519b3489cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0608d586fdf4ba4b2b7f7137d49389a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:31:06.349182 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-db9e8031-104a-4a76-8366-84316dbb5187 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] 10.222.0.78 "GET /compute/v2.1/servers/133aedc5-dbda-4b17-93fa-1a41c505a3f5" status: 200 len: 1304 microversion: 2.1 time: 0.172592 Feb 17 04:31:06.349784 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 224/464] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:31:06 2021] GET /compute/v2.1/servers/133aedc5-dbda-4b17-93fa-1a41c505a3f5 => generated 1304 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:31:06.755739 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-88374614-a26a-464d-b99a-435086bb05f9 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:31:06.756419 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-88374614-a26a-464d-b99a-435086bb05f9 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] [instance: 20760e77-fe67-4ebe-87f1-34d840495341] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:31:06.764597 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-88374614-a26a-464d-b99a-435086bb05f9 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:31:06.765160 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-88374614-a26a-464d-b99a-435086bb05f9 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:31:06.766010 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-88374614-a26a-464d-b99a-435086bb05f9 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:31:06.766514 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-88374614-a26a-464d-b99a-435086bb05f9 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:31:06.979327 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-88374614-a26a-464d-b99a-435086bb05f9 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1daf9a83b1d24033a3d4c0f531a4eb2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5336afdcf4aa4b46b0655432b7a1323c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:31:06.988322 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-88374614-a26a-464d-b99a-435086bb05f9 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] 10.222.0.78 "GET /compute/v2.1/servers/20760e77-fe67-4ebe-87f1-34d840495341" status: 200 len: 1521 microversion: 2.1 time: 0.236837 Feb 17 04:31:06.988929 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 225/465] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:31:06 2021] GET /compute/v2.1/servers/20760e77-fe67-4ebe-87f1-34d840495341 => generated 1521 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:31:07.273691 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-b18e94cb-0a5b-4dc8-9d5b-39ea72a85036 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:31:07.274358 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-b18e94cb-0a5b-4dc8-9d5b-39ea72a85036 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] [instance: ad42ab86-4168-46d3-9394-9fb44fc79d18] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:31:07.282492 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-b18e94cb-0a5b-4dc8-9d5b-39ea72a85036 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:31:07.283006 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-b18e94cb-0a5b-4dc8-9d5b-39ea72a85036 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:31:07.283881 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-b18e94cb-0a5b-4dc8-9d5b-39ea72a85036 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:31:07.284373 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-b18e94cb-0a5b-4dc8-9d5b-39ea72a85036 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:31:07.503528 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-b18e94cb-0a5b-4dc8-9d5b-39ea72a85036 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d68d4a6c12e4331b8df8191cdd7a669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2a1ca6347d4278899a1cc009d87d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:31:07.513027 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-b18e94cb-0a5b-4dc8-9d5b-39ea72a85036 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] 10.222.0.78 "GET /compute/v2.1/servers/ad42ab86-4168-46d3-9394-9fb44fc79d18" status: 200 len: 1317 microversion: 2.1 time: 0.243652 Feb 17 04:31:07.513632 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 226/466] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:31:07 2021] GET /compute/v2.1/servers/ad42ab86-4168-46d3-9394-9fb44fc79d18 => generated 1317 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:31:07.518181 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-fd715a1c-2d93-4469-8477-c39cbf397b63 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:31:07.518853 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-fd715a1c-2d93-4469-8477-c39cbf397b63 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] [instance: 133aedc5-dbda-4b17-93fa-1a41c505a3f5] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:31:07.526301 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-fd715a1c-2d93-4469-8477-c39cbf397b63 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:31:07.526813 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-fd715a1c-2d93-4469-8477-c39cbf397b63 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:31:07.527728 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-fd715a1c-2d93-4469-8477-c39cbf397b63 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:31:07.528229 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-fd715a1c-2d93-4469-8477-c39cbf397b63 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:31:07.600913 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-fd715a1c-2d93-4469-8477-c39cbf397b63 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:31:07.601587 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-fd715a1c-2d93-4469-8477-c39cbf397b63 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:31:07.602105 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.objects.instance [None req-fd715a1c-2d93-4469-8477-c39cbf397b63 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lazy-loading 'fault' on Instance uuid 133aedc5-dbda-4b17-93fa-1a41c505a3f5 {{(pid=98178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Feb 17 04:31:07.673899 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-fd715a1c-2d93-4469-8477-c39cbf397b63 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88eaaf0dd96340229d9f519b3489cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0608d586fdf4ba4b2b7f7137d49389a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:31:07.683324 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-fd715a1c-2d93-4469-8477-c39cbf397b63 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] 10.222.0.78 "GET /compute/v2.1/servers/133aedc5-dbda-4b17-93fa-1a41c505a3f5" status: 200 len: 1304 microversion: 2.1 time: 0.168644 Feb 17 04:31:07.683924 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 227/467] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:31:07 2021] GET /compute/v2.1/servers/133aedc5-dbda-4b17-93fa-1a41c505a3f5 => generated 1304 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:31:07.947216 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-08d5e2de-6749-4615-b8b7-7948e83a0796 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "POST /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529/action" status: 200 len: 28192 microversion: 2.1 time: 1.682713 Feb 17 04:31:07.947216 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 241/468] 10.222.0.78 () {60 vars in 1268 bytes} [Wed Feb 17 04:31:06 2021] POST /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529/action => generated 28192 bytes in 1684 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 04:31:08.007254 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-55a2ed75-4692-4c2a-9562-4f255c358eae tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:31:08.008049 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-55a2ed75-4692-4c2a-9562-4f255c358eae tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] [instance: 20760e77-fe67-4ebe-87f1-34d840495341] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:31:08.015901 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-55a2ed75-4692-4c2a-9562-4f255c358eae tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:31:08.016452 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-55a2ed75-4692-4c2a-9562-4f255c358eae tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:31:08.017242 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-55a2ed75-4692-4c2a-9562-4f255c358eae tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:31:08.017738 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-55a2ed75-4692-4c2a-9562-4f255c358eae tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:31:08.234300 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-55a2ed75-4692-4c2a-9562-4f255c358eae tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1daf9a83b1d24033a3d4c0f531a4eb2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5336afdcf4aa4b46b0655432b7a1323c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:31:08.243478 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-55a2ed75-4692-4c2a-9562-4f255c358eae tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] 10.222.0.78 "GET /compute/v2.1/servers/20760e77-fe67-4ebe-87f1-34d840495341" status: 200 len: 1521 microversion: 2.1 time: 0.240374 Feb 17 04:31:08.244076 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 228/469] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:31:08 2021] GET /compute/v2.1/servers/20760e77-fe67-4ebe-87f1-34d840495341 => generated 1521 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:31:08.531947 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-9eb95755-d249-493d-983c-fe89954b138e tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:31:08.532724 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-9eb95755-d249-493d-983c-fe89954b138e tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] [instance: ad42ab86-4168-46d3-9394-9fb44fc79d18] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:31:08.541416 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-9eb95755-d249-493d-983c-fe89954b138e tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:31:08.541928 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-9eb95755-d249-493d-983c-fe89954b138e tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:31:08.542768 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-9eb95755-d249-493d-983c-fe89954b138e tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:31:08.543298 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-9eb95755-d249-493d-983c-fe89954b138e tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:31:08.701296 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-c377873b-37c9-4ec3-8ec6-1aabfcb3be82 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:31:08.702020 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-c377873b-37c9-4ec3-8ec6-1aabfcb3be82 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] [instance: 133aedc5-dbda-4b17-93fa-1a41c505a3f5] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:31:08.709980 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-c377873b-37c9-4ec3-8ec6-1aabfcb3be82 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:31:08.710555 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-c377873b-37c9-4ec3-8ec6-1aabfcb3be82 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:31:08.712066 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-c377873b-37c9-4ec3-8ec6-1aabfcb3be82 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:31:08.712580 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-c377873b-37c9-4ec3-8ec6-1aabfcb3be82 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:31:08.764348 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-9eb95755-d249-493d-983c-fe89954b138e tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d68d4a6c12e4331b8df8191cdd7a669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2a1ca6347d4278899a1cc009d87d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:31:08.770922 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.wsgi [None req-c377873b-37c9-4ec3-8ec6-1aabfcb3be82 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] HTTP exception thrown: Instance 133aedc5-dbda-4b17-93fa-1a41c505a3f5 could not be found. Feb 17 04:31:08.771629 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-c377873b-37c9-4ec3-8ec6-1aabfcb3be82 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Returning 404 to user: Instance 133aedc5-dbda-4b17-93fa-1a41c505a3f5 could not be found. {{(pid=98178) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 17 04:31:08.772541 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-c377873b-37c9-4ec3-8ec6-1aabfcb3be82 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] 10.222.0.78 "GET /compute/v2.1/servers/133aedc5-dbda-4b17-93fa-1a41c505a3f5" status: 404 len: 111 microversion: 2.1 time: 0.075341 Feb 17 04:31:08.773160 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 229/470] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:31:08 2021] GET /compute/v2.1/servers/133aedc5-dbda-4b17-93fa-1a41c505a3f5 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 17 04:31:08.773270 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-9eb95755-d249-493d-983c-fe89954b138e tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] 10.222.0.78 "GET /compute/v2.1/servers/ad42ab86-4168-46d3-9394-9fb44fc79d18" status: 200 len: 1317 microversion: 2.1 time: 0.245733 Feb 17 04:31:08.773770 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 242/471] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:31:08 2021] GET /compute/v2.1/servers/ad42ab86-4168-46d3-9394-9fb44fc79d18 => generated 1317 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:31:08.897224 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-b169ce78-6195-45a5-9454-4f61b4b53c69 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-232731703", "imageRef": "b005ed36-a85a-4c46-ba22-9fa8c5ec62e5", "flavorRef": "452", "networks": [{"uuid": "d46ecdde-60b7-4f1a-a53d-f388f26afd45"}]}} {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:31:08.953021 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-0c8f9daf-3f4d-462f-b6d8-de6ce18afbe9 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:31:08.954078 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-0c8f9daf-3f4d-462f-b6d8-de6ce18afbe9 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: 29d1ce27-f63b-4523-88be-55f65a6a2529] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:31:08.963579 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.network.neutron [None req-b169ce78-6195-45a5-9454-4f61b4b53c69 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] validate_networks() for [('d46ecdde-60b7-4f1a-a53d-f388f26afd45', None, None, None)] {{(pid=98178) validate_networks /opt/stack/nova/nova/network/neutron.py:2345}} Feb 17 04:31:08.969120 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-0c8f9daf-3f4d-462f-b6d8-de6ce18afbe9 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:31:08.969637 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-0c8f9daf-3f4d-462f-b6d8-de6ce18afbe9 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:31:08.970498 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-0c8f9daf-3f4d-462f-b6d8-de6ce18afbe9 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:31:08.970999 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-0c8f9daf-3f4d-462f-b6d8-de6ce18afbe9 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:31:09.292326 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-0c8f9daf-3f4d-462f-b6d8-de6ce18afbe9 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "POST /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529/action" status: 200 len: 28192 microversion: 2.1 time: 0.343389 Feb 17 04:31:09.293159 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 243/472] 10.222.0.78 () {60 vars in 1268 bytes} [Wed Feb 17 04:31:08 2021] POST /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529/action => generated 28192 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 04:31:09.302883 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-e8325b5e-0cc3-4ceb-8233-65ee5af1face tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:31:09.303777 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-e8325b5e-0cc3-4ceb-8233-65ee5af1face tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] [instance: 20760e77-fe67-4ebe-87f1-34d840495341] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:31:09.313335 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-e8325b5e-0cc3-4ceb-8233-65ee5af1face tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:31:09.313829 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-e8325b5e-0cc3-4ceb-8233-65ee5af1face tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:31:09.314692 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-e8325b5e-0cc3-4ceb-8233-65ee5af1face tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:31:09.315221 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-e8325b5e-0cc3-4ceb-8233-65ee5af1face tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:31:09.546056 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-e8325b5e-0cc3-4ceb-8233-65ee5af1face tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1daf9a83b1d24033a3d4c0f531a4eb2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5336afdcf4aa4b46b0655432b7a1323c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:31:09.549718 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.virt.hardware [None req-b169ce78-6195-45a5-9454-4f61b4b53c69 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Flavor limits 0:0:0 {{(pid=98178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 17 04:31:09.550199 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.virt.hardware [None req-b169ce78-6195-45a5-9454-4f61b4b53c69 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Image limits 0:0:0 {{(pid=98178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Feb 17 04:31:09.550748 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.virt.hardware [None req-b169ce78-6195-45a5-9454-4f61b4b53c69 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Flavor pref 0:0:0 {{(pid=98178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 17 04:31:09.551251 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.virt.hardware [None req-b169ce78-6195-45a5-9454-4f61b4b53c69 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Image pref 0:0:0 {{(pid=98178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Feb 17 04:31:09.551720 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.virt.hardware [None req-b169ce78-6195-45a5-9454-4f61b4b53c69 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Feb 17 04:31:09.555766 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-e8325b5e-0cc3-4ceb-8233-65ee5af1face tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] 10.222.0.78 "GET /compute/v2.1/servers/20760e77-fe67-4ebe-87f1-34d840495341" status: 200 len: 1521 microversion: 2.1 time: 0.256568 Feb 17 04:31:09.556377 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 244/473] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:31:09 2021] GET /compute/v2.1/servers/20760e77-fe67-4ebe-87f1-34d840495341 => generated 1521 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:31:09.561293 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-b169ce78-6195-45a5-9454-4f61b4b53c69 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:31:09.561808 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-b169ce78-6195-45a5-9454-4f61b4b53c69 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:31:09.562697 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-b169ce78-6195-45a5-9454-4f61b4b53c69 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:31:09.563238 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-b169ce78-6195-45a5-9454-4f61b4b53c69 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:31:09.583255 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.quota [None req-b169ce78-6195-45a5-9454-4f61b4b53c69 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Getting quotas for project b0608d586fdf4ba4b2b7f7137d49389a. Resources: {'ram', 'cores', 'instances'} {{(pid=98178) _get_quotas /opt/stack/nova/nova/quota.py:388}} Feb 17 04:31:09.589324 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.quota [None req-b169ce78-6195-45a5-9454-4f61b4b53c69 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Getting quotas for user 88eaaf0dd96340229d9f519b3489cf63 and project b0608d586fdf4ba4b2b7f7137d49389a. Resources: {'ram', 'cores', 'instances'} {{(pid=98178) _get_quotas /opt/stack/nova/nova/quota.py:380}} Feb 17 04:31:09.600659 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-b169ce78-6195-45a5-9454-4f61b4b53c69 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Going to run 1 instances... {{(pid=98178) _provision_instances /opt/stack/nova/nova/compute/api.py:1264}} Feb 17 04:31:09.603360 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-b169ce78-6195-45a5-9454-4f61b4b53c69 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] [instance: 82b1aa2d-c36c-4734-b664-0958e6f4d33e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b005ed36-a85a-4c46-ba22-9fa8c5ec62e5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98178) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1666}} Feb 17 04:31:09.655472 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-b169ce78-6195-45a5-9454-4f61b4b53c69 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.762153 Feb 17 04:31:09.656173 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 230/474] 10.222.0.78 () {60 vars in 1137 bytes} [Wed Feb 17 04:31:08 2021] POST /compute/v2.1/servers => generated 380 bytes in 764 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 17 04:31:09.667004 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-2e5326c7-f0d5-4550-a22d-93bcc71d6808 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:31:09.667715 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-2e5326c7-f0d5-4550-a22d-93bcc71d6808 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] [instance: 82b1aa2d-c36c-4734-b664-0958e6f4d33e] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:31:09.747738 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-2e5326c7-f0d5-4550-a22d-93bcc71d6808 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88eaaf0dd96340229d9f519b3489cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0608d586fdf4ba4b2b7f7137d49389a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:31:09.757187 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-2e5326c7-f0d5-4550-a22d-93bcc71d6808 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] 10.222.0.78 "GET /compute/v2.1/servers/82b1aa2d-c36c-4734-b664-0958e6f4d33e" status: 200 len: 1213 microversion: 2.1 time: 0.094450 Feb 17 04:31:09.757797 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 245/475] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:31:09 2021] GET /compute/v2.1/servers/82b1aa2d-c36c-4734-b664-0958e6f4d33e => generated 1213 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:31:09.791408 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-fea4d0ad-44ba-41c4-a836-4c462d0879de tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:31:09.792090 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-fea4d0ad-44ba-41c4-a836-4c462d0879de tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] [instance: ad42ab86-4168-46d3-9394-9fb44fc79d18] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:31:09.800789 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-fea4d0ad-44ba-41c4-a836-4c462d0879de tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:31:09.801247 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-fea4d0ad-44ba-41c4-a836-4c462d0879de tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:31:09.802098 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-fea4d0ad-44ba-41c4-a836-4c462d0879de tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:31:09.802599 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-fea4d0ad-44ba-41c4-a836-4c462d0879de tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:31:10.023354 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-fea4d0ad-44ba-41c4-a836-4c462d0879de tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d68d4a6c12e4331b8df8191cdd7a669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2a1ca6347d4278899a1cc009d87d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:31:10.032859 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-fea4d0ad-44ba-41c4-a836-4c462d0879de tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] 10.222.0.78 "GET /compute/v2.1/servers/ad42ab86-4168-46d3-9394-9fb44fc79d18" status: 200 len: 1317 microversion: 2.1 time: 0.246213 Feb 17 04:31:10.033460 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 231/476] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:31:09 2021] GET /compute/v2.1/servers/ad42ab86-4168-46d3-9394-9fb44fc79d18 => generated 1317 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:31:10.305774 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-db5bf23c-7090-4302-bf74-9d10184bd27d tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:31:10.307015 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-db5bf23c-7090-4302-bf74-9d10184bd27d tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: 29d1ce27-f63b-4523-88be-55f65a6a2529] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:31:10.315393 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-db5bf23c-7090-4302-bf74-9d10184bd27d tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:31:10.315927 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-db5bf23c-7090-4302-bf74-9d10184bd27d tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:31:10.316773 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-db5bf23c-7090-4302-bf74-9d10184bd27d tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:31:10.317271 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-db5bf23c-7090-4302-bf74-9d10184bd27d tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:31:10.548039 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-db5bf23c-7090-4302-bf74-9d10184bd27d tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "POST /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529/action" status: 200 len: 28192 microversion: 2.1 time: 0.246643 Feb 17 04:31:10.548779 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 246/477] 10.222.0.78 () {60 vars in 1268 bytes} [Wed Feb 17 04:31:10 2021] POST /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529/action => generated 28192 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 04:31:10.574428 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-f182ced2-0c33-4056-b11a-0b154575aa34 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:31:10.575020 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-f182ced2-0c33-4056-b11a-0b154575aa34 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] [instance: 20760e77-fe67-4ebe-87f1-34d840495341] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:31:10.582825 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-f182ced2-0c33-4056-b11a-0b154575aa34 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:31:10.583372 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-f182ced2-0c33-4056-b11a-0b154575aa34 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:31:10.584204 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-f182ced2-0c33-4056-b11a-0b154575aa34 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:31:10.584691 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-f182ced2-0c33-4056-b11a-0b154575aa34 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:31:10.777099 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-3fc56a18-168d-4473-90ee-a11174ae68f7 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:31:10.777876 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-3fc56a18-168d-4473-90ee-a11174ae68f7 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] [instance: 82b1aa2d-c36c-4734-b664-0958e6f4d33e] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:31:10.786597 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-3fc56a18-168d-4473-90ee-a11174ae68f7 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:31:10.787182 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-3fc56a18-168d-4473-90ee-a11174ae68f7 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:31:10.788045 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-3fc56a18-168d-4473-90ee-a11174ae68f7 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:31:10.788546 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-3fc56a18-168d-4473-90ee-a11174ae68f7 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:31:10.805980 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-f182ced2-0c33-4056-b11a-0b154575aa34 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1daf9a83b1d24033a3d4c0f531a4eb2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5336afdcf4aa4b46b0655432b7a1323c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:31:10.817318 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-f182ced2-0c33-4056-b11a-0b154575aa34 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] 10.222.0.78 "GET /compute/v2.1/servers/20760e77-fe67-4ebe-87f1-34d840495341" status: 200 len: 1521 microversion: 2.1 time: 0.247708 Feb 17 04:31:10.818138 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 232/478] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:31:10 2021] GET /compute/v2.1/servers/20760e77-fe67-4ebe-87f1-34d840495341 => generated 1521 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:31:10.918686 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-3fc56a18-168d-4473-90ee-a11174ae68f7 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88eaaf0dd96340229d9f519b3489cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0608d586fdf4ba4b2b7f7137d49389a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:31:10.927574 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-3fc56a18-168d-4473-90ee-a11174ae68f7 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] 10.222.0.78 "GET /compute/v2.1/servers/82b1aa2d-c36c-4734-b664-0958e6f4d33e" status: 200 len: 1265 microversion: 2.1 time: 0.155104 Feb 17 04:31:10.928177 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 247/479] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:31:10 2021] GET /compute/v2.1/servers/82b1aa2d-c36c-4734-b664-0958e6f4d33e => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:31:11.052061 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-d7ae72bd-0fd0-453e-90b4-f4c9b7bbe57d tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:31:11.052736 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-d7ae72bd-0fd0-453e-90b4-f4c9b7bbe57d tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] [instance: ad42ab86-4168-46d3-9394-9fb44fc79d18] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:31:11.060720 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-d7ae72bd-0fd0-453e-90b4-f4c9b7bbe57d tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:31:11.061227 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-d7ae72bd-0fd0-453e-90b4-f4c9b7bbe57d tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:31:11.062070 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-d7ae72bd-0fd0-453e-90b4-f4c9b7bbe57d tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:31:11.062565 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-d7ae72bd-0fd0-453e-90b4-f4c9b7bbe57d tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:31:11.500208 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-d7ae72bd-0fd0-453e-90b4-f4c9b7bbe57d tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d68d4a6c12e4331b8df8191cdd7a669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2a1ca6347d4278899a1cc009d87d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:31:11.510197 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-d7ae72bd-0fd0-453e-90b4-f4c9b7bbe57d tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] 10.222.0.78 "GET /compute/v2.1/servers/ad42ab86-4168-46d3-9394-9fb44fc79d18" status: 200 len: 1317 microversion: 2.1 time: 0.462008 Feb 17 04:31:11.511090 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 233/480] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:31:11 2021] GET /compute/v2.1/servers/ad42ab86-4168-46d3-9394-9fb44fc79d18 => generated 1317 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:31:11.562560 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-025b8cea-0af1-41b5-ac12-086a3fb407b0 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:31:11.563642 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-025b8cea-0af1-41b5-ac12-086a3fb407b0 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: 29d1ce27-f63b-4523-88be-55f65a6a2529] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:31:11.571845 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-025b8cea-0af1-41b5-ac12-086a3fb407b0 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:31:11.572359 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-025b8cea-0af1-41b5-ac12-086a3fb407b0 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:31:11.573208 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-025b8cea-0af1-41b5-ac12-086a3fb407b0 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:31:11.573798 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-025b8cea-0af1-41b5-ac12-086a3fb407b0 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:31:11.733517 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-025b8cea-0af1-41b5-ac12-086a3fb407b0 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "POST /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529/action" status: 200 len: 28192 microversion: 2.1 time: 0.174169 Feb 17 04:31:11.739386 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 248/481] 10.222.0.78 () {60 vars in 1268 bytes} [Wed Feb 17 04:31:11 2021] POST /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529/action => generated 28192 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 04:31:11.836144 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-d8a1f4f7-98ea-44b7-95ff-cb4395032530 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:31:11.837515 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-d8a1f4f7-98ea-44b7-95ff-cb4395032530 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] [instance: 20760e77-fe67-4ebe-87f1-34d840495341] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:31:11.845505 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-d8a1f4f7-98ea-44b7-95ff-cb4395032530 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:31:11.846303 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-d8a1f4f7-98ea-44b7-95ff-cb4395032530 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:31:11.847303 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-d8a1f4f7-98ea-44b7-95ff-cb4395032530 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:31:11.847884 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-d8a1f4f7-98ea-44b7-95ff-cb4395032530 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:31:11.947463 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-1cc8f02e-d9f6-4745-81e8-ec89b1886aa7 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:31:11.948630 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-1cc8f02e-d9f6-4745-81e8-ec89b1886aa7 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] [instance: 82b1aa2d-c36c-4734-b664-0958e6f4d33e] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:31:11.957329 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-1cc8f02e-d9f6-4745-81e8-ec89b1886aa7 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:31:11.958168 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-1cc8f02e-d9f6-4745-81e8-ec89b1886aa7 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:31:11.963071 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-1cc8f02e-d9f6-4745-81e8-ec89b1886aa7 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:31:11.963071 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-1cc8f02e-d9f6-4745-81e8-ec89b1886aa7 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:31:12.098191 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-1cc8f02e-d9f6-4745-81e8-ec89b1886aa7 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88eaaf0dd96340229d9f519b3489cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0608d586fdf4ba4b2b7f7137d49389a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:31:12.108210 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-1cc8f02e-d9f6-4745-81e8-ec89b1886aa7 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] 10.222.0.78 "GET /compute/v2.1/servers/82b1aa2d-c36c-4734-b664-0958e6f4d33e" status: 200 len: 1271 microversion: 2.1 time: 0.165491 Feb 17 04:31:12.108850 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 249/482] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:31:11 2021] GET /compute/v2.1/servers/82b1aa2d-c36c-4734-b664-0958e6f4d33e => generated 1271 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:31:12.217353 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-d8a1f4f7-98ea-44b7-95ff-cb4395032530 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1daf9a83b1d24033a3d4c0f531a4eb2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5336afdcf4aa4b46b0655432b7a1323c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:31:12.226125 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-d8a1f4f7-98ea-44b7-95ff-cb4395032530 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] 10.222.0.78 "GET /compute/v2.1/servers/20760e77-fe67-4ebe-87f1-34d840495341" status: 200 len: 1521 microversion: 2.1 time: 0.394062 Feb 17 04:31:12.226792 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 234/483] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:31:11 2021] GET /compute/v2.1/servers/20760e77-fe67-4ebe-87f1-34d840495341 => generated 1521 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:31:12.528825 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-7eabf73b-cdfa-4981-9339-f8a30c05f10b tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:31:12.529821 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-7eabf73b-cdfa-4981-9339-f8a30c05f10b tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] [instance: ad42ab86-4168-46d3-9394-9fb44fc79d18] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:31:12.538273 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-7eabf73b-cdfa-4981-9339-f8a30c05f10b tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:31:12.538787 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-7eabf73b-cdfa-4981-9339-f8a30c05f10b tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:31:12.540604 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-7eabf73b-cdfa-4981-9339-f8a30c05f10b tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:31:12.541104 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-7eabf73b-cdfa-4981-9339-f8a30c05f10b tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:31:12.747101 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-4f9f1f62-8b7c-4623-9318-c6d7404f60a4 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:31:12.748377 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-4f9f1f62-8b7c-4623-9318-c6d7404f60a4 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: 29d1ce27-f63b-4523-88be-55f65a6a2529] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:31:12.768043 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-4f9f1f62-8b7c-4623-9318-c6d7404f60a4 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:31:12.771350 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-4f9f1f62-8b7c-4623-9318-c6d7404f60a4 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:31:12.772678 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-4f9f1f62-8b7c-4623-9318-c6d7404f60a4 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:31:12.773212 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-4f9f1f62-8b7c-4623-9318-c6d7404f60a4 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:31:12.815531 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-7eabf73b-cdfa-4981-9339-f8a30c05f10b tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d68d4a6c12e4331b8df8191cdd7a669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2a1ca6347d4278899a1cc009d87d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:31:12.827253 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-7eabf73b-cdfa-4981-9339-f8a30c05f10b tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] 10.222.0.78 "GET /compute/v2.1/servers/ad42ab86-4168-46d3-9394-9fb44fc79d18" status: 200 len: 1317 microversion: 2.1 time: 0.302523 Feb 17 04:31:12.828601 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 250/484] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:31:12 2021] GET /compute/v2.1/servers/ad42ab86-4168-46d3-9394-9fb44fc79d18 => generated 1317 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:31:12.942749 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-4f9f1f62-8b7c-4623-9318-c6d7404f60a4 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "POST /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529/action" status: 200 len: 28192 microversion: 2.1 time: 0.200196 Feb 17 04:31:12.946940 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 235/485] 10.222.0.78 () {60 vars in 1268 bytes} [Wed Feb 17 04:31:12 2021] POST /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529/action => generated 28192 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 04:31:13.125964 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-3cc8234e-ce2d-40b2-8196-f774c1c334bc tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:31:13.126735 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-3cc8234e-ce2d-40b2-8196-f774c1c334bc tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] [instance: 82b1aa2d-c36c-4734-b664-0958e6f4d33e] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:31:13.136525 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-3cc8234e-ce2d-40b2-8196-f774c1c334bc tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:31:13.136712 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-3cc8234e-ce2d-40b2-8196-f774c1c334bc tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:31:13.138960 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-3cc8234e-ce2d-40b2-8196-f774c1c334bc tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:31:13.138960 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-3cc8234e-ce2d-40b2-8196-f774c1c334bc tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:31:13.251154 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-58c2c693-f80e-4bd2-a5f9-946ee36971cd tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:31:13.252040 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-58c2c693-f80e-4bd2-a5f9-946ee36971cd tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] [instance: 20760e77-fe67-4ebe-87f1-34d840495341] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:31:13.261482 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-58c2c693-f80e-4bd2-a5f9-946ee36971cd tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:31:13.262034 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-58c2c693-f80e-4bd2-a5f9-946ee36971cd tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:31:13.263210 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-58c2c693-f80e-4bd2-a5f9-946ee36971cd tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:31:13.263860 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-58c2c693-f80e-4bd2-a5f9-946ee36971cd tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:31:13.395626 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-3cc8234e-ce2d-40b2-8196-f774c1c334bc tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88eaaf0dd96340229d9f519b3489cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0608d586fdf4ba4b2b7f7137d49389a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:31:13.407341 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-3cc8234e-ce2d-40b2-8196-f774c1c334bc tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] 10.222.0.78 "GET /compute/v2.1/servers/82b1aa2d-c36c-4734-b664-0958e6f4d33e" status: 200 len: 1313 microversion: 2.1 time: 0.284381 Feb 17 04:31:13.408703 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 251/486] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:31:13 2021] GET /compute/v2.1/servers/82b1aa2d-c36c-4734-b664-0958e6f4d33e => generated 1313 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:31:13.653076 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-58c2c693-f80e-4bd2-a5f9-946ee36971cd tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1daf9a83b1d24033a3d4c0f531a4eb2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5336afdcf4aa4b46b0655432b7a1323c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:31:13.662446 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-58c2c693-f80e-4bd2-a5f9-946ee36971cd tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] 10.222.0.78 "GET /compute/v2.1/servers/20760e77-fe67-4ebe-87f1-34d840495341" status: 200 len: 1521 microversion: 2.1 time: 0.420827 Feb 17 04:31:13.673081 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 236/487] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:31:13 2021] GET /compute/v2.1/servers/20760e77-fe67-4ebe-87f1-34d840495341 => generated 1521 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:31:13.846038 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-2ec1efe3-c167-4ff0-ae95-2e62ed8cd703 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:31:13.846754 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-2ec1efe3-c167-4ff0-ae95-2e62ed8cd703 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] [instance: ad42ab86-4168-46d3-9394-9fb44fc79d18] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:31:13.855394 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-2ec1efe3-c167-4ff0-ae95-2e62ed8cd703 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:31:13.855959 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-2ec1efe3-c167-4ff0-ae95-2e62ed8cd703 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:31:13.856810 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-2ec1efe3-c167-4ff0-ae95-2e62ed8cd703 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:31:13.857300 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-2ec1efe3-c167-4ff0-ae95-2e62ed8cd703 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:31:13.954124 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-286a0ca9-f450-4ffd-8e4d-349ff1b7f46a tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:31:13.955564 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-286a0ca9-f450-4ffd-8e4d-349ff1b7f46a tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: 29d1ce27-f63b-4523-88be-55f65a6a2529] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:31:13.966072 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-286a0ca9-f450-4ffd-8e4d-349ff1b7f46a tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:31:13.966987 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-286a0ca9-f450-4ffd-8e4d-349ff1b7f46a tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:31:13.968096 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-286a0ca9-f450-4ffd-8e4d-349ff1b7f46a tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:31:13.968806 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-286a0ca9-f450-4ffd-8e4d-349ff1b7f46a tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:31:14.102459 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-2ec1efe3-c167-4ff0-ae95-2e62ed8cd703 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d68d4a6c12e4331b8df8191cdd7a669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2a1ca6347d4278899a1cc009d87d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:31:14.111199 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-2ec1efe3-c167-4ff0-ae95-2e62ed8cd703 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] 10.222.0.78 "GET /compute/v2.1/servers/ad42ab86-4168-46d3-9394-9fb44fc79d18" status: 200 len: 1317 microversion: 2.1 time: 0.269102 Feb 17 04:31:14.111810 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 252/488] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:31:13 2021] GET /compute/v2.1/servers/ad42ab86-4168-46d3-9394-9fb44fc79d18 => generated 1317 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:31:14.166463 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-286a0ca9-f450-4ffd-8e4d-349ff1b7f46a tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "POST /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529/action" status: 200 len: 28387 microversion: 2.1 time: 0.216026 Feb 17 04:31:14.168619 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 237/489] 10.222.0.78 () {60 vars in 1268 bytes} [Wed Feb 17 04:31:13 2021] POST /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529/action => generated 28387 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 04:31:14.385839 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [req-c6e607bf-8f84-48bd-b95e-f5ac87767ede req-54fc821f-90a7-4415-931a-257737237b82 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "82b1aa2d-c36c-4734-b664-0958e6f4d33e", "tag": "df06620b-cd13-40eb-a7ef-c665dd300756"}]} {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:31:14.387609 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:31:14.387609 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: warnings.warn(msg) Feb 17 04:31:14.396349 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [req-c6e607bf-8f84-48bd-b95e-f5ac87767ede req-54fc821f-90a7-4415-931a-257737237b82 service nova] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:31:14.396843 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [req-c6e607bf-8f84-48bd-b95e-f5ac87767ede req-54fc821f-90a7-4415-931a-257737237b82 service nova] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:31:14.415783 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.compute.server_external_events [req-c6e607bf-8f84-48bd-b95e-f5ac87767ede req-54fc821f-90a7-4415-931a-257737237b82 service nova] Creating event network-changed:df06620b-cd13-40eb-a7ef-c665dd300756 for instance 82b1aa2d-c36c-4734-b664-0958e6f4d33e on hv-cinder-75998 Feb 17 04:31:14.420509 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [req-c6e607bf-8f84-48bd-b95e-f5ac87767ede req-54fc821f-90a7-4415-931a-257737237b82 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038658 Feb 17 04:31:14.421158 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 253/490] 10.222.0.78 () {64 vars in 1308 bytes} [Wed Feb 17 04:31:14 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:31:14.426287 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-745b57a2-9e03-465c-9ab6-4e85a896259c tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:31:14.427079 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-745b57a2-9e03-465c-9ab6-4e85a896259c tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] [instance: 82b1aa2d-c36c-4734-b664-0958e6f4d33e] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:31:14.436005 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-745b57a2-9e03-465c-9ab6-4e85a896259c tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:31:14.436567 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-745b57a2-9e03-465c-9ab6-4e85a896259c tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:31:14.437419 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-745b57a2-9e03-465c-9ab6-4e85a896259c tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:31:14.437932 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-745b57a2-9e03-465c-9ab6-4e85a896259c tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:31:14.681961 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-5dfc751a-8646-4ea6-a4ab-ae610464b735 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:31:14.682932 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-5dfc751a-8646-4ea6-a4ab-ae610464b735 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] [instance: 20760e77-fe67-4ebe-87f1-34d840495341] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:31:14.691073 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-5dfc751a-8646-4ea6-a4ab-ae610464b735 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:31:14.691600 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-5dfc751a-8646-4ea6-a4ab-ae610464b735 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:31:14.692448 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-5dfc751a-8646-4ea6-a4ab-ae610464b735 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:31:14.692946 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-5dfc751a-8646-4ea6-a4ab-ae610464b735 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:31:14.846249 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-745b57a2-9e03-465c-9ab6-4e85a896259c tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88eaaf0dd96340229d9f519b3489cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0608d586fdf4ba4b2b7f7137d49389a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:31:14.857104 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-745b57a2-9e03-465c-9ab6-4e85a896259c tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] 10.222.0.78 "GET /compute/v2.1/servers/82b1aa2d-c36c-4734-b664-0958e6f4d33e" status: 200 len: 1313 microversion: 2.1 time: 0.435289 Feb 17 04:31:14.858311 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 238/491] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:31:14 2021] GET /compute/v2.1/servers/82b1aa2d-c36c-4734-b664-0958e6f4d33e => generated 1313 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:31:14.922485 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-5dfc751a-8646-4ea6-a4ab-ae610464b735 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1daf9a83b1d24033a3d4c0f531a4eb2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5336afdcf4aa4b46b0655432b7a1323c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:31:14.932598 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-5dfc751a-8646-4ea6-a4ab-ae610464b735 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] 10.222.0.78 "GET /compute/v2.1/servers/20760e77-fe67-4ebe-87f1-34d840495341" status: 200 len: 1521 microversion: 2.1 time: 0.255535 Feb 17 04:31:14.933430 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 254/492] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:31:14 2021] GET /compute/v2.1/servers/20760e77-fe67-4ebe-87f1-34d840495341 => generated 1521 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:31:15.137709 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-7638172b-38cb-4d9d-a12d-5aee622f82d2 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:31:15.138788 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-7638172b-38cb-4d9d-a12d-5aee622f82d2 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] [instance: ad42ab86-4168-46d3-9394-9fb44fc79d18] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:31:15.167687 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-7638172b-38cb-4d9d-a12d-5aee622f82d2 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:31:15.170245 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-7638172b-38cb-4d9d-a12d-5aee622f82d2 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:31:15.171814 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-7638172b-38cb-4d9d-a12d-5aee622f82d2 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:31:15.174422 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-7638172b-38cb-4d9d-a12d-5aee622f82d2 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:31:15.179318 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-e184ae22-6602-4f83-a507-b44705b8c319 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:31:15.181007 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-e184ae22-6602-4f83-a507-b44705b8c319 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: 29d1ce27-f63b-4523-88be-55f65a6a2529] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:31:15.211678 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-e184ae22-6602-4f83-a507-b44705b8c319 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:31:15.212486 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-e184ae22-6602-4f83-a507-b44705b8c319 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:31:15.213604 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-e184ae22-6602-4f83-a507-b44705b8c319 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:31:15.214289 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-e184ae22-6602-4f83-a507-b44705b8c319 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:31:15.402674 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-7638172b-38cb-4d9d-a12d-5aee622f82d2 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d68d4a6c12e4331b8df8191cdd7a669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2a1ca6347d4278899a1cc009d87d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:31:15.411490 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-7638172b-38cb-4d9d-a12d-5aee622f82d2 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] 10.222.0.78 "GET /compute/v2.1/servers/ad42ab86-4168-46d3-9394-9fb44fc79d18" status: 200 len: 1317 microversion: 2.1 time: 0.285242 Feb 17 04:31:15.412094 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 239/493] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:31:15 2021] GET /compute/v2.1/servers/ad42ab86-4168-46d3-9394-9fb44fc79d18 => generated 1317 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:31:15.522734 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-e184ae22-6602-4f83-a507-b44705b8c319 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "POST /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529/action" status: 200 len: 28482 microversion: 2.1 time: 0.347060 Feb 17 04:31:15.524715 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 255/494] 10.222.0.78 () {60 vars in 1268 bytes} [Wed Feb 17 04:31:15 2021] POST /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529/action => generated 28482 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 04:31:15.876701 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-2ebb32df-7583-422b-96dc-2f2245bf86e0 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:31:15.877352 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-2ebb32df-7583-422b-96dc-2f2245bf86e0 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] [instance: 82b1aa2d-c36c-4734-b664-0958e6f4d33e] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:31:15.886656 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-2ebb32df-7583-422b-96dc-2f2245bf86e0 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:31:15.887320 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-2ebb32df-7583-422b-96dc-2f2245bf86e0 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:31:15.888285 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-2ebb32df-7583-422b-96dc-2f2245bf86e0 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:31:15.888952 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-2ebb32df-7583-422b-96dc-2f2245bf86e0 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:31:15.950833 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-627fb4e8-7c53-4a5d-ac1a-eefc0462cf80 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:31:15.951670 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-627fb4e8-7c53-4a5d-ac1a-eefc0462cf80 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] [instance: 20760e77-fe67-4ebe-87f1-34d840495341] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:31:15.960581 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-627fb4e8-7c53-4a5d-ac1a-eefc0462cf80 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:31:15.961315 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-627fb4e8-7c53-4a5d-ac1a-eefc0462cf80 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:31:15.962357 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-627fb4e8-7c53-4a5d-ac1a-eefc0462cf80 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:31:15.963081 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-627fb4e8-7c53-4a5d-ac1a-eefc0462cf80 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:31:16.208278 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-627fb4e8-7c53-4a5d-ac1a-eefc0462cf80 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1daf9a83b1d24033a3d4c0f531a4eb2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5336afdcf4aa4b46b0655432b7a1323c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:31:16.218231 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-627fb4e8-7c53-4a5d-ac1a-eefc0462cf80 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] 10.222.0.78 "GET /compute/v2.1/servers/20760e77-fe67-4ebe-87f1-34d840495341" status: 200 len: 1521 microversion: 2.1 time: 0.271758 Feb 17 04:31:16.219295 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 256/495] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:31:15 2021] GET /compute/v2.1/servers/20760e77-fe67-4ebe-87f1-34d840495341 => generated 1521 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:31:16.383137 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-2ebb32df-7583-422b-96dc-2f2245bf86e0 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88eaaf0dd96340229d9f519b3489cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0608d586fdf4ba4b2b7f7137d49389a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:31:16.408804 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-2ebb32df-7583-422b-96dc-2f2245bf86e0 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] 10.222.0.78 "GET /compute/v2.1/servers/82b1aa2d-c36c-4734-b664-0958e6f4d33e" status: 200 len: 1313 microversion: 2.1 time: 0.535954 Feb 17 04:31:16.410430 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 240/496] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:31:15 2021] GET /compute/v2.1/servers/82b1aa2d-c36c-4734-b664-0958e6f4d33e => generated 1313 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:31:16.433251 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-5a4a4f70-01fc-4dd8-847a-5fcd1c4591cf tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:31:16.433932 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-5a4a4f70-01fc-4dd8-847a-5fcd1c4591cf tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] [instance: ad42ab86-4168-46d3-9394-9fb44fc79d18] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:31:16.442465 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-5a4a4f70-01fc-4dd8-847a-5fcd1c4591cf tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:31:16.443162 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-5a4a4f70-01fc-4dd8-847a-5fcd1c4591cf tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:31:16.444174 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-5a4a4f70-01fc-4dd8-847a-5fcd1c4591cf tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:31:16.444820 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-5a4a4f70-01fc-4dd8-847a-5fcd1c4591cf tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:31:16.536183 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-7b789282-61e1-4a95-8b21-f1bec81065a7 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:31:16.537702 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-7b789282-61e1-4a95-8b21-f1bec81065a7 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: 29d1ce27-f63b-4523-88be-55f65a6a2529] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:31:16.546406 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-7b789282-61e1-4a95-8b21-f1bec81065a7 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:31:16.547258 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-7b789282-61e1-4a95-8b21-f1bec81065a7 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:31:16.548298 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-7b789282-61e1-4a95-8b21-f1bec81065a7 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:31:16.548979 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-7b789282-61e1-4a95-8b21-f1bec81065a7 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:31:16.690404 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-5a4a4f70-01fc-4dd8-847a-5fcd1c4591cf tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d68d4a6c12e4331b8df8191cdd7a669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2a1ca6347d4278899a1cc009d87d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:31:16.701046 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-5a4a4f70-01fc-4dd8-847a-5fcd1c4591cf tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] 10.222.0.78 "GET /compute/v2.1/servers/ad42ab86-4168-46d3-9394-9fb44fc79d18" status: 200 len: 1317 microversion: 2.1 time: 0.274763 Feb 17 04:31:16.701811 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 257/497] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:31:16 2021] GET /compute/v2.1/servers/ad42ab86-4168-46d3-9394-9fb44fc79d18 => generated 1317 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:31:16.708138 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [req-3485bec7-d7df-4039-9b8c-6f9fdfd00502 req-d8095e97-c1b5-4a38-8c63-b14214ab8585 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad42ab86-4168-46d3-9394-9fb44fc79d18", "name": "network-vif-plugged", "status": "completed", "tag": "792b9d8e-6dd8-4b55-a5f2-852e8232b46b"}]} {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:31:16.712047 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:31:16.712047 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: warnings.warn(msg) Feb 17 04:31:16.721148 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [req-3485bec7-d7df-4039-9b8c-6f9fdfd00502 req-d8095e97-c1b5-4a38-8c63-b14214ab8585 service nova] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:31:16.721763 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [req-3485bec7-d7df-4039-9b8c-6f9fdfd00502 req-d8095e97-c1b5-4a38-8c63-b14214ab8585 service nova] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:31:16.735141 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-7b789282-61e1-4a95-8b21-f1bec81065a7 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "POST /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529/action" status: 200 len: 28482 microversion: 2.1 time: 0.202465 Feb 17 04:31:16.736679 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 241/498] 10.222.0.78 () {60 vars in 1268 bytes} [Wed Feb 17 04:31:16 2021] POST /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529/action => generated 28482 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 17 04:31:16.746994 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.compute.server_external_events [req-3485bec7-d7df-4039-9b8c-6f9fdfd00502 req-d8095e97-c1b5-4a38-8c63-b14214ab8585 service nova] Creating event network-vif-plugged:792b9d8e-6dd8-4b55-a5f2-852e8232b46b for instance ad42ab86-4168-46d3-9394-9fb44fc79d18 on hv-cinder-75998 Feb 17 04:31:16.753095 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [req-3485bec7-d7df-4039-9b8c-6f9fdfd00502 req-d8095e97-c1b5-4a38-8c63-b14214ab8585 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049931 Feb 17 04:31:16.755092 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 258/499] 10.222.0.78 () {64 vars in 1308 bytes} [Wed Feb 17 04:31:16 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:31:17.238565 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-6957b27c-c3a6-40e5-8271-f1de2b6b58fb tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:31:17.239388 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-6957b27c-c3a6-40e5-8271-f1de2b6b58fb tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] [instance: 20760e77-fe67-4ebe-87f1-34d840495341] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:31:17.249334 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-6957b27c-c3a6-40e5-8271-f1de2b6b58fb tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:31:17.249891 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-6957b27c-c3a6-40e5-8271-f1de2b6b58fb tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:31:17.250725 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-6957b27c-c3a6-40e5-8271-f1de2b6b58fb tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:31:17.251273 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-6957b27c-c3a6-40e5-8271-f1de2b6b58fb tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:31:17.428527 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-714c093a-3f16-45fe-bab3-98e695dd1f57 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:31:17.429325 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-714c093a-3f16-45fe-bab3-98e695dd1f57 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] [instance: 82b1aa2d-c36c-4734-b664-0958e6f4d33e] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:31:17.439095 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-714c093a-3f16-45fe-bab3-98e695dd1f57 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:31:17.439611 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-714c093a-3f16-45fe-bab3-98e695dd1f57 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:31:17.440461 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-714c093a-3f16-45fe-bab3-98e695dd1f57 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:31:17.441028 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-714c093a-3f16-45fe-bab3-98e695dd1f57 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:31:17.469062 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-6957b27c-c3a6-40e5-8271-f1de2b6b58fb tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1daf9a83b1d24033a3d4c0f531a4eb2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5336afdcf4aa4b46b0655432b7a1323c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:31:17.478527 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-6957b27c-c3a6-40e5-8271-f1de2b6b58fb tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] 10.222.0.78 "GET /compute/v2.1/servers/20760e77-fe67-4ebe-87f1-34d840495341" status: 200 len: 1521 microversion: 2.1 time: 0.244603 Feb 17 04:31:17.479170 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 242/500] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:31:17 2021] GET /compute/v2.1/servers/20760e77-fe67-4ebe-87f1-34d840495341 => generated 1521 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:31:17.682200 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-714c093a-3f16-45fe-bab3-98e695dd1f57 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88eaaf0dd96340229d9f519b3489cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0608d586fdf4ba4b2b7f7137d49389a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:31:17.694052 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-714c093a-3f16-45fe-bab3-98e695dd1f57 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] 10.222.0.78 "GET /compute/v2.1/servers/82b1aa2d-c36c-4734-b664-0958e6f4d33e" status: 200 len: 1313 microversion: 2.1 time: 0.270045 Feb 17 04:31:17.694788 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 259/501] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:31:17 2021] GET /compute/v2.1/servers/82b1aa2d-c36c-4734-b664-0958e6f4d33e => generated 1313 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:31:17.720651 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-80492559-7618-49f1-8926-ccd6bf4c55d8 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:31:17.721305 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-80492559-7618-49f1-8926-ccd6bf4c55d8 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] [instance: ad42ab86-4168-46d3-9394-9fb44fc79d18] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:31:17.730791 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-80492559-7618-49f1-8926-ccd6bf4c55d8 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:31:17.731527 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-80492559-7618-49f1-8926-ccd6bf4c55d8 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:31:17.732412 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-80492559-7618-49f1-8926-ccd6bf4c55d8 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:31:17.732886 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-80492559-7618-49f1-8926-ccd6bf4c55d8 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:31:17.750786 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-6fda43b4-9991-48c3-b1af-0f66c69a3c54 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:31:17.752774 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-6fda43b4-9991-48c3-b1af-0f66c69a3c54 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: 29d1ce27-f63b-4523-88be-55f65a6a2529] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:31:17.761344 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-6fda43b4-9991-48c3-b1af-0f66c69a3c54 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:31:17.761959 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-6fda43b4-9991-48c3-b1af-0f66c69a3c54 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:31:17.762818 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-6fda43b4-9991-48c3-b1af-0f66c69a3c54 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:31:17.763341 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-6fda43b4-9991-48c3-b1af-0f66c69a3c54 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:31:17.966405 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-80492559-7618-49f1-8926-ccd6bf4c55d8 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d68d4a6c12e4331b8df8191cdd7a669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2a1ca6347d4278899a1cc009d87d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:31:17.975067 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-80492559-7618-49f1-8926-ccd6bf4c55d8 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] 10.222.0.78 "GET /compute/v2.1/servers/ad42ab86-4168-46d3-9394-9fb44fc79d18" status: 200 len: 1317 microversion: 2.1 time: 0.258461 Feb 17 04:31:17.975662 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 243/502] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:31:17 2021] GET /compute/v2.1/servers/ad42ab86-4168-46d3-9394-9fb44fc79d18 => generated 1317 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:31:18.086293 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-6fda43b4-9991-48c3-b1af-0f66c69a3c54 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "POST /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529/action" status: 200 len: 28569 microversion: 2.1 time: 0.340747 Feb 17 04:31:18.087622 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 260/503] 10.222.0.78 () {60 vars in 1268 bytes} [Wed Feb 17 04:31:17 2021] POST /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529/action => generated 28569 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 04:31:18.497075 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-9cedc5ee-7e9b-419d-a080-09a93bc84af1 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:31:18.497909 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-9cedc5ee-7e9b-419d-a080-09a93bc84af1 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] [instance: 20760e77-fe67-4ebe-87f1-34d840495341] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:31:18.506351 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-9cedc5ee-7e9b-419d-a080-09a93bc84af1 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:31:18.506862 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-9cedc5ee-7e9b-419d-a080-09a93bc84af1 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:31:18.508386 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-9cedc5ee-7e9b-419d-a080-09a93bc84af1 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:31:18.508891 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-9cedc5ee-7e9b-419d-a080-09a93bc84af1 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:31:18.713875 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-b43d8dc6-b685-422a-b8bb-c88e057b1433 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:31:18.714510 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-b43d8dc6-b685-422a-b8bb-c88e057b1433 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] [instance: 82b1aa2d-c36c-4734-b664-0958e6f4d33e] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:31:18.716319 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-9cedc5ee-7e9b-419d-a080-09a93bc84af1 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1daf9a83b1d24033a3d4c0f531a4eb2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5336afdcf4aa4b46b0655432b7a1323c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:31:18.723326 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-b43d8dc6-b685-422a-b8bb-c88e057b1433 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:31:18.723841 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-b43d8dc6-b685-422a-b8bb-c88e057b1433 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:31:18.724686 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-b43d8dc6-b685-422a-b8bb-c88e057b1433 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:31:18.725170 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-b43d8dc6-b685-422a-b8bb-c88e057b1433 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:31:18.725297 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-9cedc5ee-7e9b-419d-a080-09a93bc84af1 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] 10.222.0.78 "GET /compute/v2.1/servers/20760e77-fe67-4ebe-87f1-34d840495341" status: 200 len: 1521 microversion: 2.1 time: 0.232149 Feb 17 04:31:18.726098 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 244/504] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:31:18 2021] GET /compute/v2.1/servers/20760e77-fe67-4ebe-87f1-34d840495341 => generated 1521 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:31:18.944631 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-b43d8dc6-b685-422a-b8bb-c88e057b1433 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88eaaf0dd96340229d9f519b3489cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0608d586fdf4ba4b2b7f7137d49389a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:31:18.954698 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-b43d8dc6-b685-422a-b8bb-c88e057b1433 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] 10.222.0.78 "GET /compute/v2.1/servers/82b1aa2d-c36c-4734-b664-0958e6f4d33e" status: 200 len: 1313 microversion: 2.1 time: 0.245382 Feb 17 04:31:18.955392 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 261/505] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:31:18 2021] GET /compute/v2.1/servers/82b1aa2d-c36c-4734-b664-0958e6f4d33e => generated 1313 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:31:18.994282 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-3ee4ee44-9078-47bd-b5ab-9c88040f0bf6 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:31:18.995098 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-3ee4ee44-9078-47bd-b5ab-9c88040f0bf6 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] [instance: ad42ab86-4168-46d3-9394-9fb44fc79d18] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:31:19.003010 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-3ee4ee44-9078-47bd-b5ab-9c88040f0bf6 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:31:19.003651 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-3ee4ee44-9078-47bd-b5ab-9c88040f0bf6 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:31:19.004572 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-3ee4ee44-9078-47bd-b5ab-9c88040f0bf6 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:31:19.005160 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-3ee4ee44-9078-47bd-b5ab-9c88040f0bf6 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:31:19.099412 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-d593668a-a9ca-4dbf-8796-eba3540bcee1 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:31:19.100470 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-d593668a-a9ca-4dbf-8796-eba3540bcee1 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: 29d1ce27-f63b-4523-88be-55f65a6a2529] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:31:19.109823 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-d593668a-a9ca-4dbf-8796-eba3540bcee1 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:31:19.110338 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-d593668a-a9ca-4dbf-8796-eba3540bcee1 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:31:19.111220 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-d593668a-a9ca-4dbf-8796-eba3540bcee1 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:31:19.111727 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-d593668a-a9ca-4dbf-8796-eba3540bcee1 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:31:19.246794 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-3ee4ee44-9078-47bd-b5ab-9c88040f0bf6 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d68d4a6c12e4331b8df8191cdd7a669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2a1ca6347d4278899a1cc009d87d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:31:19.255584 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-3ee4ee44-9078-47bd-b5ab-9c88040f0bf6 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] 10.222.0.78 "GET /compute/v2.1/servers/ad42ab86-4168-46d3-9394-9fb44fc79d18" status: 200 len: 1317 microversion: 2.1 time: 0.265387 Feb 17 04:31:19.256183 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 245/506] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:31:18 2021] GET /compute/v2.1/servers/ad42ab86-4168-46d3-9394-9fb44fc79d18 => generated 1317 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:31:19.744185 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-2ca9bc5a-1c96-4663-b847-62ed8ecb3777 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:31:19.744853 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-2ca9bc5a-1c96-4663-b847-62ed8ecb3777 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] [instance: 20760e77-fe67-4ebe-87f1-34d840495341] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:31:19.753057 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-2ca9bc5a-1c96-4663-b847-62ed8ecb3777 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:31:19.753566 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-2ca9bc5a-1c96-4663-b847-62ed8ecb3777 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:31:19.754423 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-2ca9bc5a-1c96-4663-b847-62ed8ecb3777 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:31:19.755237 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-2ca9bc5a-1c96-4663-b847-62ed8ecb3777 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:31:19.970540 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-2ca9bc5a-1c96-4663-b847-62ed8ecb3777 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1daf9a83b1d24033a3d4c0f531a4eb2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5336afdcf4aa4b46b0655432b7a1323c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:31:19.980195 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-2ca9bc5a-1c96-4663-b847-62ed8ecb3777 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] 10.222.0.78 "GET /compute/v2.1/servers/20760e77-fe67-4ebe-87f1-34d840495341" status: 200 len: 1521 microversion: 2.1 time: 0.240563 Feb 17 04:31:19.980798 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 246/507] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:31:19 2021] GET /compute/v2.1/servers/20760e77-fe67-4ebe-87f1-34d840495341 => generated 1521 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:31:19.985361 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-7045f0e6-03b6-4bd2-b697-1c995d303bb5 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:31:19.986031 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-7045f0e6-03b6-4bd2-b697-1c995d303bb5 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] [instance: 82b1aa2d-c36c-4734-b664-0958e6f4d33e] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:31:19.994243 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-7045f0e6-03b6-4bd2-b697-1c995d303bb5 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:31:19.994757 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-7045f0e6-03b6-4bd2-b697-1c995d303bb5 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:31:19.995633 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-7045f0e6-03b6-4bd2-b697-1c995d303bb5 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:31:19.996138 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-7045f0e6-03b6-4bd2-b697-1c995d303bb5 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:31:20.209486 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-7045f0e6-03b6-4bd2-b697-1c995d303bb5 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88eaaf0dd96340229d9f519b3489cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0608d586fdf4ba4b2b7f7137d49389a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:31:20.219463 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-7045f0e6-03b6-4bd2-b697-1c995d303bb5 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] 10.222.0.78 "GET /compute/v2.1/servers/82b1aa2d-c36c-4734-b664-0958e6f4d33e" status: 200 len: 1313 microversion: 2.1 time: 0.237616 Feb 17 04:31:20.220063 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 247/508] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:31:19 2021] GET /compute/v2.1/servers/82b1aa2d-c36c-4734-b664-0958e6f4d33e => generated 1313 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:31:20.274914 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-341d6ff1-28d5-4792-8c9e-5ce54fc87a24 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:31:20.275642 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-341d6ff1-28d5-4792-8c9e-5ce54fc87a24 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] [instance: ad42ab86-4168-46d3-9394-9fb44fc79d18] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:31:20.283554 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-341d6ff1-28d5-4792-8c9e-5ce54fc87a24 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:31:20.284056 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-341d6ff1-28d5-4792-8c9e-5ce54fc87a24 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:31:20.284898 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-341d6ff1-28d5-4792-8c9e-5ce54fc87a24 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:31:20.285391 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-341d6ff1-28d5-4792-8c9e-5ce54fc87a24 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:31:20.503076 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-341d6ff1-28d5-4792-8c9e-5ce54fc87a24 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d68d4a6c12e4331b8df8191cdd7a669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2a1ca6347d4278899a1cc009d87d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:31:20.513259 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-341d6ff1-28d5-4792-8c9e-5ce54fc87a24 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] 10.222.0.78 "GET /compute/v2.1/servers/ad42ab86-4168-46d3-9394-9fb44fc79d18" status: 200 len: 1317 microversion: 2.1 time: 0.242642 Feb 17 04:31:20.513864 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 248/509] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:31:20 2021] GET /compute/v2.1/servers/ad42ab86-4168-46d3-9394-9fb44fc79d18 => generated 1317 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:31:20.998726 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-13cd9abb-f2c4-4b05-985d-011e847fbb42 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:31:20.999418 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-13cd9abb-f2c4-4b05-985d-011e847fbb42 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] [instance: 20760e77-fe67-4ebe-87f1-34d840495341] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:31:21.007398 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-13cd9abb-f2c4-4b05-985d-011e847fbb42 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:31:21.007883 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-13cd9abb-f2c4-4b05-985d-011e847fbb42 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:31:21.009911 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-13cd9abb-f2c4-4b05-985d-011e847fbb42 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:31:21.010414 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-13cd9abb-f2c4-4b05-985d-011e847fbb42 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:31:21.222611 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-13cd9abb-f2c4-4b05-985d-011e847fbb42 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1daf9a83b1d24033a3d4c0f531a4eb2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5336afdcf4aa4b46b0655432b7a1323c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:31:21.232060 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-13cd9abb-f2c4-4b05-985d-011e847fbb42 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] 10.222.0.78 "GET /compute/v2.1/servers/20760e77-fe67-4ebe-87f1-34d840495341" status: 200 len: 1521 microversion: 2.1 time: 0.237275 Feb 17 04:31:21.232641 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 249/510] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:31:20 2021] GET /compute/v2.1/servers/20760e77-fe67-4ebe-87f1-34d840495341 => generated 1521 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:31:21.241399 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-d2698d4f-2d9e-4a55-a2f2-ba88c7b7eadf tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:31:21.242070 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-d2698d4f-2d9e-4a55-a2f2-ba88c7b7eadf tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] [instance: 82b1aa2d-c36c-4734-b664-0958e6f4d33e] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:31:21.250383 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-d2698d4f-2d9e-4a55-a2f2-ba88c7b7eadf tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:31:21.250897 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-d2698d4f-2d9e-4a55-a2f2-ba88c7b7eadf tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:31:21.251777 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-d2698d4f-2d9e-4a55-a2f2-ba88c7b7eadf tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:31:21.252270 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-d2698d4f-2d9e-4a55-a2f2-ba88c7b7eadf tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:31:21.465126 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-d2698d4f-2d9e-4a55-a2f2-ba88c7b7eadf tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88eaaf0dd96340229d9f519b3489cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0608d586fdf4ba4b2b7f7137d49389a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:31:21.473811 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-d2698d4f-2d9e-4a55-a2f2-ba88c7b7eadf tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] 10.222.0.78 "GET /compute/v2.1/servers/82b1aa2d-c36c-4734-b664-0958e6f4d33e" status: 200 len: 1313 microversion: 2.1 time: 0.236119 Feb 17 04:31:21.474409 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 250/511] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:31:21 2021] GET /compute/v2.1/servers/82b1aa2d-c36c-4734-b664-0958e6f4d33e => generated 1313 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:31:21.531104 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-4c5fd427-ecb6-40bf-8c33-5d55e4ab449c tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:31:21.531767 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-4c5fd427-ecb6-40bf-8c33-5d55e4ab449c tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] [instance: ad42ab86-4168-46d3-9394-9fb44fc79d18] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:31:21.539551 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-4c5fd427-ecb6-40bf-8c33-5d55e4ab449c tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:31:21.540141 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-4c5fd427-ecb6-40bf-8c33-5d55e4ab449c tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:31:21.540974 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-4c5fd427-ecb6-40bf-8c33-5d55e4ab449c tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:31:21.541462 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-4c5fd427-ecb6-40bf-8c33-5d55e4ab449c tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:31:21.762966 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-4c5fd427-ecb6-40bf-8c33-5d55e4ab449c tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d68d4a6c12e4331b8df8191cdd7a669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2a1ca6347d4278899a1cc009d87d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:31:21.771895 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-4c5fd427-ecb6-40bf-8c33-5d55e4ab449c tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] 10.222.0.78 "GET /compute/v2.1/servers/ad42ab86-4168-46d3-9394-9fb44fc79d18" status: 200 len: 1317 microversion: 2.1 time: 0.244648 Feb 17 04:31:21.772496 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 251/512] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:31:21 2021] GET /compute/v2.1/servers/ad42ab86-4168-46d3-9394-9fb44fc79d18 => generated 1317 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:31:22.250561 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-adfd8bb1-9cb7-4202-8573-d01cda3fafaf tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:31:22.251286 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-adfd8bb1-9cb7-4202-8573-d01cda3fafaf tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] [instance: 20760e77-fe67-4ebe-87f1-34d840495341] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:31:22.259598 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-adfd8bb1-9cb7-4202-8573-d01cda3fafaf tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:31:22.260110 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-adfd8bb1-9cb7-4202-8573-d01cda3fafaf tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:31:22.260953 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-adfd8bb1-9cb7-4202-8573-d01cda3fafaf tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:31:22.261446 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-adfd8bb1-9cb7-4202-8573-d01cda3fafaf tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:31:22.469525 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-adfd8bb1-9cb7-4202-8573-d01cda3fafaf tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1daf9a83b1d24033a3d4c0f531a4eb2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5336afdcf4aa4b46b0655432b7a1323c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:31:22.478782 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-adfd8bb1-9cb7-4202-8573-d01cda3fafaf tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] 10.222.0.78 "GET /compute/v2.1/servers/20760e77-fe67-4ebe-87f1-34d840495341" status: 200 len: 1521 microversion: 2.1 time: 0.232332 Feb 17 04:31:22.479424 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 252/513] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:31:22 2021] GET /compute/v2.1/servers/20760e77-fe67-4ebe-87f1-34d840495341 => generated 1521 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:31:22.491974 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-fad74248-f565-4d66-8dc4-2aa15aeca13c tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:31:22.493163 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-fad74248-f565-4d66-8dc4-2aa15aeca13c tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] [instance: 82b1aa2d-c36c-4734-b664-0958e6f4d33e] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:31:22.500905 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-fad74248-f565-4d66-8dc4-2aa15aeca13c tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:31:22.501383 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-fad74248-f565-4d66-8dc4-2aa15aeca13c tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:31:22.502208 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-fad74248-f565-4d66-8dc4-2aa15aeca13c tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:31:22.502709 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-fad74248-f565-4d66-8dc4-2aa15aeca13c tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:31:22.714698 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-fad74248-f565-4d66-8dc4-2aa15aeca13c tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88eaaf0dd96340229d9f519b3489cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0608d586fdf4ba4b2b7f7137d49389a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:31:22.723608 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-fad74248-f565-4d66-8dc4-2aa15aeca13c tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] 10.222.0.78 "GET /compute/v2.1/servers/82b1aa2d-c36c-4734-b664-0958e6f4d33e" status: 200 len: 1313 microversion: 2.1 time: 0.235405 Feb 17 04:31:22.724221 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 253/514] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:31:22 2021] GET /compute/v2.1/servers/82b1aa2d-c36c-4734-b664-0958e6f4d33e => generated 1313 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:31:22.790555 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-ede29820-6285-4ccc-b2d8-7fc03f4e69ef tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:31:22.791386 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-ede29820-6285-4ccc-b2d8-7fc03f4e69ef tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] [instance: ad42ab86-4168-46d3-9394-9fb44fc79d18] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:31:22.800503 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-ede29820-6285-4ccc-b2d8-7fc03f4e69ef tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:31:22.801020 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-ede29820-6285-4ccc-b2d8-7fc03f4e69ef tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:31:22.801875 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-ede29820-6285-4ccc-b2d8-7fc03f4e69ef tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:31:22.802385 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-ede29820-6285-4ccc-b2d8-7fc03f4e69ef tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:31:23.156609 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-ede29820-6285-4ccc-b2d8-7fc03f4e69ef tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d68d4a6c12e4331b8df8191cdd7a669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2a1ca6347d4278899a1cc009d87d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:31:23.165667 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-ede29820-6285-4ccc-b2d8-7fc03f4e69ef tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] 10.222.0.78 "GET /compute/v2.1/servers/ad42ab86-4168-46d3-9394-9fb44fc79d18" status: 200 len: 1317 microversion: 2.1 time: 0.379193 Feb 17 04:31:23.166254 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 254/515] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:31:22 2021] GET /compute/v2.1/servers/ad42ab86-4168-46d3-9394-9fb44fc79d18 => generated 1317 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:31:23.497664 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-aec6f767-cd31-4f33-9f40-659c8fa90c03 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:31:23.498606 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-aec6f767-cd31-4f33-9f40-659c8fa90c03 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] [instance: 20760e77-fe67-4ebe-87f1-34d840495341] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:31:23.507019 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-aec6f767-cd31-4f33-9f40-659c8fa90c03 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:31:23.507564 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-aec6f767-cd31-4f33-9f40-659c8fa90c03 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:31:23.509066 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-aec6f767-cd31-4f33-9f40-659c8fa90c03 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:31:23.509640 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-aec6f767-cd31-4f33-9f40-659c8fa90c03 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:31:23.723989 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-aec6f767-cd31-4f33-9f40-659c8fa90c03 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1daf9a83b1d24033a3d4c0f531a4eb2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5336afdcf4aa4b46b0655432b7a1323c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:31:23.732732 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-aec6f767-cd31-4f33-9f40-659c8fa90c03 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] 10.222.0.78 "GET /compute/v2.1/servers/20760e77-fe67-4ebe-87f1-34d840495341" status: 200 len: 1521 microversion: 2.1 time: 0.240662 Feb 17 04:31:23.733320 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 255/516] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:31:23 2021] GET /compute/v2.1/servers/20760e77-fe67-4ebe-87f1-34d840495341 => generated 1521 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:31:23.741674 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-0ad2927f-a31a-418e-a3e8-a62e6bd1f291 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:31:23.742920 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-0ad2927f-a31a-418e-a3e8-a62e6bd1f291 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] [instance: 82b1aa2d-c36c-4734-b664-0958e6f4d33e] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:31:23.750599 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-0ad2927f-a31a-418e-a3e8-a62e6bd1f291 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:31:23.751140 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-0ad2927f-a31a-418e-a3e8-a62e6bd1f291 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:31:23.751983 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-0ad2927f-a31a-418e-a3e8-a62e6bd1f291 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:31:23.752481 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-0ad2927f-a31a-418e-a3e8-a62e6bd1f291 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:31:23.968967 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-0ad2927f-a31a-418e-a3e8-a62e6bd1f291 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88eaaf0dd96340229d9f519b3489cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0608d586fdf4ba4b2b7f7137d49389a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:31:23.977785 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-0ad2927f-a31a-418e-a3e8-a62e6bd1f291 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] 10.222.0.78 "GET /compute/v2.1/servers/82b1aa2d-c36c-4734-b664-0958e6f4d33e" status: 200 len: 1313 microversion: 2.1 time: 0.239836 Feb 17 04:31:23.978374 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 256/517] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:31:23 2021] GET /compute/v2.1/servers/82b1aa2d-c36c-4734-b664-0958e6f4d33e => generated 1313 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:31:24.184482 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-b94dee34-1bce-4dba-832d-65e3b0617ede tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:31:24.185082 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-b94dee34-1bce-4dba-832d-65e3b0617ede tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] [instance: ad42ab86-4168-46d3-9394-9fb44fc79d18] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:31:24.193003 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-b94dee34-1bce-4dba-832d-65e3b0617ede tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:31:24.193525 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-b94dee34-1bce-4dba-832d-65e3b0617ede tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:31:24.194367 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-b94dee34-1bce-4dba-832d-65e3b0617ede tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:31:24.194863 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-b94dee34-1bce-4dba-832d-65e3b0617ede tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:31:24.402699 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-b94dee34-1bce-4dba-832d-65e3b0617ede tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d68d4a6c12e4331b8df8191cdd7a669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2a1ca6347d4278899a1cc009d87d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:31:24.411345 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-b94dee34-1bce-4dba-832d-65e3b0617ede tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] 10.222.0.78 "GET /compute/v2.1/servers/ad42ab86-4168-46d3-9394-9fb44fc79d18" status: 200 len: 1317 microversion: 2.1 time: 0.231519 Feb 17 04:31:24.411936 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 257/518] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:31:24 2021] GET /compute/v2.1/servers/ad42ab86-4168-46d3-9394-9fb44fc79d18 => generated 1317 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:31:24.752347 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-25c4ce5b-726d-4452-9a80-285aba96ec5b tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:31:24.753013 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-25c4ce5b-726d-4452-9a80-285aba96ec5b tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] [instance: 20760e77-fe67-4ebe-87f1-34d840495341] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:31:24.761846 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-25c4ce5b-726d-4452-9a80-285aba96ec5b tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:31:24.762357 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-25c4ce5b-726d-4452-9a80-285aba96ec5b tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:31:24.763219 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-25c4ce5b-726d-4452-9a80-285aba96ec5b tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:31:24.763714 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-25c4ce5b-726d-4452-9a80-285aba96ec5b tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:31:24.931104 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-d593668a-a9ca-4dbf-8796-eba3540bcee1 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "POST /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529/action" status: 200 len: 28650 microversion: 2.1 time: 5.835251 Feb 17 04:31:24.935288 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 262/519] 10.222.0.78 () {60 vars in 1268 bytes} [Wed Feb 17 04:31:19 2021] POST /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529/action => generated 28650 bytes in 5837 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 17 04:31:24.979686 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-25c4ce5b-726d-4452-9a80-285aba96ec5b tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1daf9a83b1d24033a3d4c0f531a4eb2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5336afdcf4aa4b46b0655432b7a1323c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:31:24.988862 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-25c4ce5b-726d-4452-9a80-285aba96ec5b tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] 10.222.0.78 "GET /compute/v2.1/servers/20760e77-fe67-4ebe-87f1-34d840495341" status: 200 len: 1521 microversion: 2.1 time: 0.240440 Feb 17 04:31:24.989643 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 258/520] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:31:24 2021] GET /compute/v2.1/servers/20760e77-fe67-4ebe-87f1-34d840495341 => generated 1521 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:31:24.996295 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-f2c2046d-2adf-4305-be3e-efa9ad1b6d2b tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:31:24.997126 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-f2c2046d-2adf-4305-be3e-efa9ad1b6d2b tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] [instance: 82b1aa2d-c36c-4734-b664-0958e6f4d33e] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:31:25.005712 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-f2c2046d-2adf-4305-be3e-efa9ad1b6d2b tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:31:25.006170 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-f2c2046d-2adf-4305-be3e-efa9ad1b6d2b tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:31:25.007012 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-f2c2046d-2adf-4305-be3e-efa9ad1b6d2b tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:31:25.007538 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-f2c2046d-2adf-4305-be3e-efa9ad1b6d2b tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:31:25.225046 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-f2c2046d-2adf-4305-be3e-efa9ad1b6d2b tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88eaaf0dd96340229d9f519b3489cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0608d586fdf4ba4b2b7f7137d49389a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:31:25.234590 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-f2c2046d-2adf-4305-be3e-efa9ad1b6d2b tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] 10.222.0.78 "GET /compute/v2.1/servers/82b1aa2d-c36c-4734-b664-0958e6f4d33e" status: 200 len: 1313 microversion: 2.1 time: 0.242905 Feb 17 04:31:25.235227 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 263/521] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:31:24 2021] GET /compute/v2.1/servers/82b1aa2d-c36c-4734-b664-0958e6f4d33e => generated 1313 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:31:25.429266 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-94f6e451-ceb0-494b-8d56-c97e23cc67d9 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:31:25.430489 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-94f6e451-ceb0-494b-8d56-c97e23cc67d9 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] [instance: ad42ab86-4168-46d3-9394-9fb44fc79d18] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:31:25.439129 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-94f6e451-ceb0-494b-8d56-c97e23cc67d9 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:31:25.439896 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-94f6e451-ceb0-494b-8d56-c97e23cc67d9 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:31:25.440931 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-94f6e451-ceb0-494b-8d56-c97e23cc67d9 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:31:25.441580 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-94f6e451-ceb0-494b-8d56-c97e23cc67d9 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:31:25.660267 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-94f6e451-ceb0-494b-8d56-c97e23cc67d9 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d68d4a6c12e4331b8df8191cdd7a669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2a1ca6347d4278899a1cc009d87d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:31:25.669674 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-94f6e451-ceb0-494b-8d56-c97e23cc67d9 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] 10.222.0.78 "GET /compute/v2.1/servers/ad42ab86-4168-46d3-9394-9fb44fc79d18" status: 200 len: 1317 microversion: 2.1 time: 0.244604 Feb 17 04:31:25.670276 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 259/522] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:31:25 2021] GET /compute/v2.1/servers/ad42ab86-4168-46d3-9394-9fb44fc79d18 => generated 1317 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:31:25.943548 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-3c46f1ec-5345-49b4-87e5-4302d3d0f155 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:31:25.944587 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-3c46f1ec-5345-49b4-87e5-4302d3d0f155 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: 29d1ce27-f63b-4523-88be-55f65a6a2529] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:31:25.952570 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-3c46f1ec-5345-49b4-87e5-4302d3d0f155 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:31:25.953069 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-3c46f1ec-5345-49b4-87e5-4302d3d0f155 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:31:25.953898 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-3c46f1ec-5345-49b4-87e5-4302d3d0f155 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:31:25.954383 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-3c46f1ec-5345-49b4-87e5-4302d3d0f155 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:31:26.006736 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-cd005f9b-0b36-4d9c-b911-a4f8f2051fa6 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:31:26.007387 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-cd005f9b-0b36-4d9c-b911-a4f8f2051fa6 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] [instance: 20760e77-fe67-4ebe-87f1-34d840495341] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:31:26.015297 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-cd005f9b-0b36-4d9c-b911-a4f8f2051fa6 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:31:26.015811 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-cd005f9b-0b36-4d9c-b911-a4f8f2051fa6 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:31:26.016658 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-cd005f9b-0b36-4d9c-b911-a4f8f2051fa6 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:31:26.017157 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-cd005f9b-0b36-4d9c-b911-a4f8f2051fa6 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:31:26.105253 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-3c46f1ec-5345-49b4-87e5-4302d3d0f155 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "POST /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529/action" status: 200 len: 28650 microversion: 2.1 time: 0.165642 Feb 17 04:31:26.107078 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 264/523] 10.222.0.78 () {60 vars in 1268 bytes} [Wed Feb 17 04:31:25 2021] POST /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529/action => generated 28650 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 04:31:26.256385 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-8d7eb5d8-1f3d-4b4d-9daf-b65d9cb3b897 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:31:26.257636 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-8d7eb5d8-1f3d-4b4d-9daf-b65d9cb3b897 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] [instance: 82b1aa2d-c36c-4734-b664-0958e6f4d33e] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:31:26.267867 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-8d7eb5d8-1f3d-4b4d-9daf-b65d9cb3b897 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:31:26.268605 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-8d7eb5d8-1f3d-4b4d-9daf-b65d9cb3b897 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:31:26.269459 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-8d7eb5d8-1f3d-4b4d-9daf-b65d9cb3b897 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:31:26.269951 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-8d7eb5d8-1f3d-4b4d-9daf-b65d9cb3b897 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:31:26.281661 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-cd005f9b-0b36-4d9c-b911-a4f8f2051fa6 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1daf9a83b1d24033a3d4c0f531a4eb2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5336afdcf4aa4b46b0655432b7a1323c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:31:26.291390 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-cd005f9b-0b36-4d9c-b911-a4f8f2051fa6 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] 10.222.0.78 "GET /compute/v2.1/servers/20760e77-fe67-4ebe-87f1-34d840495341" status: 200 len: 1521 microversion: 2.1 time: 0.288700 Feb 17 04:31:26.299991 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 260/524] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:31:26 2021] GET /compute/v2.1/servers/20760e77-fe67-4ebe-87f1-34d840495341 => generated 1521 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:31:26.513225 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-8d7eb5d8-1f3d-4b4d-9daf-b65d9cb3b897 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88eaaf0dd96340229d9f519b3489cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0608d586fdf4ba4b2b7f7137d49389a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:31:26.522092 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-8d7eb5d8-1f3d-4b4d-9daf-b65d9cb3b897 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] 10.222.0.78 "GET /compute/v2.1/servers/82b1aa2d-c36c-4734-b664-0958e6f4d33e" status: 200 len: 1313 microversion: 2.1 time: 0.271468 Feb 17 04:31:26.531070 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 265/525] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:31:26 2021] GET /compute/v2.1/servers/82b1aa2d-c36c-4734-b664-0958e6f4d33e => generated 1313 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:31:26.688775 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-230298d5-d855-4d39-942e-48c81a495724 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:31:26.689451 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-230298d5-d855-4d39-942e-48c81a495724 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] [instance: ad42ab86-4168-46d3-9394-9fb44fc79d18] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:31:26.709356 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-230298d5-d855-4d39-942e-48c81a495724 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:31:26.709862 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-230298d5-d855-4d39-942e-48c81a495724 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:31:26.710738 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-230298d5-d855-4d39-942e-48c81a495724 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:31:26.712058 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-230298d5-d855-4d39-942e-48c81a495724 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:31:27.119324 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-753417a3-8e9e-47e6-b6d5-66281a30beee tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:31:27.120378 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-753417a3-8e9e-47e6-b6d5-66281a30beee tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: 29d1ce27-f63b-4523-88be-55f65a6a2529] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:31:27.128393 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-753417a3-8e9e-47e6-b6d5-66281a30beee tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:31:27.129512 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-753417a3-8e9e-47e6-b6d5-66281a30beee tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:31:27.129772 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-753417a3-8e9e-47e6-b6d5-66281a30beee tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:31:27.130268 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-753417a3-8e9e-47e6-b6d5-66281a30beee tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:31:27.201000 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-230298d5-d855-4d39-942e-48c81a495724 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d68d4a6c12e4331b8df8191cdd7a669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2a1ca6347d4278899a1cc009d87d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:31:27.215409 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-230298d5-d855-4d39-942e-48c81a495724 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] 10.222.0.78 "GET /compute/v2.1/servers/ad42ab86-4168-46d3-9394-9fb44fc79d18" status: 200 len: 1317 microversion: 2.1 time: 0.530504 Feb 17 04:31:27.216010 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 261/526] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:31:26 2021] GET /compute/v2.1/servers/ad42ab86-4168-46d3-9394-9fb44fc79d18 => generated 1317 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:31:27.270044 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-753417a3-8e9e-47e6-b6d5-66281a30beee tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "POST /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529/action" status: 200 len: 28650 microversion: 2.1 time: 0.155392 Feb 17 04:31:27.271101 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 266/527] 10.222.0.78 () {60 vars in 1268 bytes} [Wed Feb 17 04:31:27 2021] POST /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529/action => generated 28650 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 17 04:31:27.309787 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-a4b114fc-c9ab-4177-9e53-656b2febd067 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:31:27.310457 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-a4b114fc-c9ab-4177-9e53-656b2febd067 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] [instance: 20760e77-fe67-4ebe-87f1-34d840495341] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:31:27.318612 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-a4b114fc-c9ab-4177-9e53-656b2febd067 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:31:27.319315 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-a4b114fc-c9ab-4177-9e53-656b2febd067 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:31:27.320294 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-a4b114fc-c9ab-4177-9e53-656b2febd067 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:31:27.321059 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-a4b114fc-c9ab-4177-9e53-656b2febd067 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:31:27.542889 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-e36858c8-8277-48ed-ad27-18cb840549c9 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:31:27.543702 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-e36858c8-8277-48ed-ad27-18cb840549c9 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] [instance: 82b1aa2d-c36c-4734-b664-0958e6f4d33e] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:31:27.552849 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-e36858c8-8277-48ed-ad27-18cb840549c9 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:31:27.553366 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-e36858c8-8277-48ed-ad27-18cb840549c9 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:31:27.554323 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-e36858c8-8277-48ed-ad27-18cb840549c9 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:31:27.554726 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-e36858c8-8277-48ed-ad27-18cb840549c9 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:31:27.888088 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-a4b114fc-c9ab-4177-9e53-656b2febd067 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1daf9a83b1d24033a3d4c0f531a4eb2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5336afdcf4aa4b46b0655432b7a1323c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:31:27.897311 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-a4b114fc-c9ab-4177-9e53-656b2febd067 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] 10.222.0.78 "GET /compute/v2.1/servers/20760e77-fe67-4ebe-87f1-34d840495341" status: 200 len: 1521 microversion: 2.1 time: 0.591985 Feb 17 04:31:27.898201 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 262/528] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:31:27 2021] GET /compute/v2.1/servers/20760e77-fe67-4ebe-87f1-34d840495341 => generated 1521 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:31:27.970690 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-e36858c8-8277-48ed-ad27-18cb840549c9 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88eaaf0dd96340229d9f519b3489cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0608d586fdf4ba4b2b7f7137d49389a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:31:27.979680 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-e36858c8-8277-48ed-ad27-18cb840549c9 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] 10.222.0.78 "GET /compute/v2.1/servers/82b1aa2d-c36c-4734-b664-0958e6f4d33e" status: 200 len: 1313 microversion: 2.1 time: 0.442321 Feb 17 04:31:27.980277 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 267/529] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:31:27 2021] GET /compute/v2.1/servers/82b1aa2d-c36c-4734-b664-0958e6f4d33e => generated 1313 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:31:28.234067 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-f093aa68-2a9f-43a6-aedd-2c21fc6258c6 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:31:28.234743 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-f093aa68-2a9f-43a6-aedd-2c21fc6258c6 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] [instance: ad42ab86-4168-46d3-9394-9fb44fc79d18] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:31:28.243735 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-f093aa68-2a9f-43a6-aedd-2c21fc6258c6 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:31:28.244244 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-f093aa68-2a9f-43a6-aedd-2c21fc6258c6 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:31:28.245093 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-f093aa68-2a9f-43a6-aedd-2c21fc6258c6 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:31:28.245596 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-f093aa68-2a9f-43a6-aedd-2c21fc6258c6 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:31:28.282389 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-cf816136-237b-4921-8737-c653a259ec7a tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:31:28.283494 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-cf816136-237b-4921-8737-c653a259ec7a tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: 29d1ce27-f63b-4523-88be-55f65a6a2529] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:31:28.291494 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-cf816136-237b-4921-8737-c653a259ec7a tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:31:28.292013 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-cf816136-237b-4921-8737-c653a259ec7a tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:31:28.292860 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-cf816136-237b-4921-8737-c653a259ec7a tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:31:28.293361 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-cf816136-237b-4921-8737-c653a259ec7a tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:31:28.464584 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-f093aa68-2a9f-43a6-aedd-2c21fc6258c6 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d68d4a6c12e4331b8df8191cdd7a669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2a1ca6347d4278899a1cc009d87d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:31:28.473908 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-f093aa68-2a9f-43a6-aedd-2c21fc6258c6 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] 10.222.0.78 "GET /compute/v2.1/servers/ad42ab86-4168-46d3-9394-9fb44fc79d18" status: 200 len: 1507 microversion: 2.1 time: 0.244180 Feb 17 04:31:28.474723 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 263/530] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:31:28 2021] GET /compute/v2.1/servers/ad42ab86-4168-46d3-9394-9fb44fc79d18 => generated 1507 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:31:28.670006 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-cf816136-237b-4921-8737-c653a259ec7a tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "POST /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529/action" status: 200 len: 28650 microversion: 2.1 time: 0.390838 Feb 17 04:31:28.672130 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 268/531] 10.222.0.78 () {60 vars in 1268 bytes} [Wed Feb 17 04:31:28 2021] POST /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529/action => generated 28650 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 17 04:31:28.917649 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-70002aa5-25e4-4ea6-a1d5-2bcde23bec2b tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:31:28.918461 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-70002aa5-25e4-4ea6-a1d5-2bcde23bec2b tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] [instance: 20760e77-fe67-4ebe-87f1-34d840495341] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:31:28.927483 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-70002aa5-25e4-4ea6-a1d5-2bcde23bec2b tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:31:28.928121 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-70002aa5-25e4-4ea6-a1d5-2bcde23bec2b tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:31:28.929064 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-70002aa5-25e4-4ea6-a1d5-2bcde23bec2b tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:31:28.929682 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-70002aa5-25e4-4ea6-a1d5-2bcde23bec2b tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:31:28.999023 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-2f8edd90-438e-4d91-8000-f48f49f48018 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:31:29.000128 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-2f8edd90-438e-4d91-8000-f48f49f48018 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] [instance: 82b1aa2d-c36c-4734-b664-0958e6f4d33e] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:31:29.037999 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-2f8edd90-438e-4d91-8000-f48f49f48018 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:31:29.040613 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-2f8edd90-438e-4d91-8000-f48f49f48018 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:31:29.041645 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-2f8edd90-438e-4d91-8000-f48f49f48018 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:31:29.042494 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-2f8edd90-438e-4d91-8000-f48f49f48018 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:31:29.152607 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-70002aa5-25e4-4ea6-a1d5-2bcde23bec2b tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1daf9a83b1d24033a3d4c0f531a4eb2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5336afdcf4aa4b46b0655432b7a1323c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:31:29.161380 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-70002aa5-25e4-4ea6-a1d5-2bcde23bec2b tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] 10.222.0.78 "GET /compute/v2.1/servers/20760e77-fe67-4ebe-87f1-34d840495341" status: 200 len: 1521 microversion: 2.1 time: 0.248605 Feb 17 04:31:29.162235 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 264/532] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:31:28 2021] GET /compute/v2.1/servers/20760e77-fe67-4ebe-87f1-34d840495341 => generated 1521 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:31:29.266462 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-2f8edd90-438e-4d91-8000-f48f49f48018 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88eaaf0dd96340229d9f519b3489cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0608d586fdf4ba4b2b7f7137d49389a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:31:29.276270 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-2f8edd90-438e-4d91-8000-f48f49f48018 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] 10.222.0.78 "GET /compute/v2.1/servers/82b1aa2d-c36c-4734-b664-0958e6f4d33e" status: 200 len: 1313 microversion: 2.1 time: 0.281643 Feb 17 04:31:29.276916 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 269/533] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:31:28 2021] GET /compute/v2.1/servers/82b1aa2d-c36c-4734-b664-0958e6f4d33e => generated 1313 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:31:29.684905 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-0b6c0de5-4be5-48d8-871a-8a4053f0beaa tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:31:29.685998 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-0b6c0de5-4be5-48d8-871a-8a4053f0beaa tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: 29d1ce27-f63b-4523-88be-55f65a6a2529] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:31:29.693917 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-0b6c0de5-4be5-48d8-871a-8a4053f0beaa tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:31:29.694429 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-0b6c0de5-4be5-48d8-871a-8a4053f0beaa tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:31:29.696337 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-0b6c0de5-4be5-48d8-871a-8a4053f0beaa tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:31:29.696847 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-0b6c0de5-4be5-48d8-871a-8a4053f0beaa tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:31:29.898582 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-0b6c0de5-4be5-48d8-871a-8a4053f0beaa tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "POST /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529/action" status: 200 len: 28650 microversion: 2.1 time: 0.217517 Feb 17 04:31:29.899311 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 265/534] 10.222.0.78 () {60 vars in 1268 bytes} [Wed Feb 17 04:31:29 2021] POST /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529/action => generated 28650 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 04:31:30.181301 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-b415919d-771e-4c36-8a75-19ac69dac40a tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:31:30.182640 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-b415919d-771e-4c36-8a75-19ac69dac40a tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] [instance: 20760e77-fe67-4ebe-87f1-34d840495341] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:31:30.192251 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-b415919d-771e-4c36-8a75-19ac69dac40a tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:31:30.193259 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-b415919d-771e-4c36-8a75-19ac69dac40a tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:31:30.194351 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-b415919d-771e-4c36-8a75-19ac69dac40a tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:31:30.195001 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-b415919d-771e-4c36-8a75-19ac69dac40a tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:31:30.294688 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-1f756bce-3b93-46fb-9971-a6d83c45d380 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:31:30.295603 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-1f756bce-3b93-46fb-9971-a6d83c45d380 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] [instance: 82b1aa2d-c36c-4734-b664-0958e6f4d33e] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:31:30.304235 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-1f756bce-3b93-46fb-9971-a6d83c45d380 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:31:30.304795 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-1f756bce-3b93-46fb-9971-a6d83c45d380 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:31:30.305707 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-1f756bce-3b93-46fb-9971-a6d83c45d380 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:31:30.306211 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-1f756bce-3b93-46fb-9971-a6d83c45d380 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:31:30.415329 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-b415919d-771e-4c36-8a75-19ac69dac40a tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1daf9a83b1d24033a3d4c0f531a4eb2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5336afdcf4aa4b46b0655432b7a1323c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:31:30.424471 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-b415919d-771e-4c36-8a75-19ac69dac40a tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] 10.222.0.78 "GET /compute/v2.1/servers/20760e77-fe67-4ebe-87f1-34d840495341" status: 200 len: 1501 microversion: 2.1 time: 0.248173 Feb 17 04:31:30.425079 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 270/535] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:31:30 2021] GET /compute/v2.1/servers/20760e77-fe67-4ebe-87f1-34d840495341 => generated 1501 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:31:30.442026 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-5eb0e561-d9e7-4d93-b53b-9e10f889f0e5 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "59e5f171-8092-4384-93e0-72b8c4195116"}} {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:31:30.443248 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-5eb0e561-d9e7-4d93-b53b-9e10f889f0e5 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] [instance: 20760e77-fe67-4ebe-87f1-34d840495341] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:31:30.451780 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-5eb0e561-d9e7-4d93-b53b-9e10f889f0e5 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:31:30.452353 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-5eb0e561-d9e7-4d93-b53b-9e10f889f0e5 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:31:30.453184 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-5eb0e561-d9e7-4d93-b53b-9e10f889f0e5 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:31:30.453676 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-5eb0e561-d9e7-4d93-b53b-9e10f889f0e5 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:31:30.517762 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.wsgi [None req-5eb0e561-d9e7-4d93-b53b-9e10f889f0e5 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] HTTP exception thrown: Cannot 'attach_volume' instance 20760e77-fe67-4ebe-87f1-34d840495341 while it is in vm_state rescued Feb 17 04:31:30.518389 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-5eb0e561-d9e7-4d93-b53b-9e10f889f0e5 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Returning 409 to user: Cannot 'attach_volume' instance 20760e77-fe67-4ebe-87f1-34d840495341 while it is in vm_state rescued {{(pid=98179) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 17 04:31:30.519367 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-5eb0e561-d9e7-4d93-b53b-9e10f889f0e5 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] 10.222.0.78 "POST /compute/v2.1/servers/20760e77-fe67-4ebe-87f1-34d840495341/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.081462 Feb 17 04:31:30.520146 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 271/536] 10.222.0.78 () {60 vars in 1313 bytes} [Wed Feb 17 04:31:30 2021] POST /compute/v2.1/servers/20760e77-fe67-4ebe-87f1-34d840495341/os-volume_attachments => generated 152 bytes in 83 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Feb 17 04:31:30.526721 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-1f756bce-3b93-46fb-9971-a6d83c45d380 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88eaaf0dd96340229d9f519b3489cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0608d586fdf4ba4b2b7f7137d49389a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:31:30.528865 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-843181a6-462a-4f62-8299-2be6a8ca3691 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:31:30.529444 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-843181a6-462a-4f62-8299-2be6a8ca3691 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] [instance: 20760e77-fe67-4ebe-87f1-34d840495341] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:31:30.536450 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-1f756bce-3b93-46fb-9971-a6d83c45d380 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] 10.222.0.78 "GET /compute/v2.1/servers/82b1aa2d-c36c-4734-b664-0958e6f4d33e" status: 200 len: 1313 microversion: 2.1 time: 0.246215 Feb 17 04:31:30.537042 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 266/537] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:31:30 2021] GET /compute/v2.1/servers/82b1aa2d-c36c-4734-b664-0958e6f4d33e => generated 1313 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:31:30.539229 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-843181a6-462a-4f62-8299-2be6a8ca3691 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:31:30.539791 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-843181a6-462a-4f62-8299-2be6a8ca3691 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:31:30.540694 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-843181a6-462a-4f62-8299-2be6a8ca3691 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:31:30.541145 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-843181a6-462a-4f62-8299-2be6a8ca3691 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:31:30.603077 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-5741d2be-81de-4b5c-8665-2a8770f9ef43 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a8a1b9ed-1b35-494e-89df-c0caec66e311", "device": "/dev/sdb"}} {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:31:30.604854 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-5741d2be-81de-4b5c-8665-2a8770f9ef43 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] [instance: 8b4ba536-4de5-4f0e-9cb0-cc08d8616e5d] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:31:30.612989 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-5741d2be-81de-4b5c-8665-2a8770f9ef43 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:31:30.613502 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-5741d2be-81de-4b5c-8665-2a8770f9ef43 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:31:30.614354 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-5741d2be-81de-4b5c-8665-2a8770f9ef43 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:31:30.614853 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-5741d2be-81de-4b5c-8665-2a8770f9ef43 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:31:30.685533 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-843181a6-462a-4f62-8299-2be6a8ca3691 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] 10.222.0.78 "POST /compute/v2.1/servers/20760e77-fe67-4ebe-87f1-34d840495341/action" status: 202 len: 0 microversion: 2.1 time: 0.160286 Feb 17 04:31:30.689396 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 272/538] 10.222.0.78 () {60 vars in 1268 bytes} [Wed Feb 17 04:31:30 2021] POST /compute/v2.1/servers/20760e77-fe67-4ebe-87f1-34d840495341/action => generated 0 bytes in 162 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Feb 17 04:31:30.697291 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-1ff9c527-2796-44e0-b024-630c4bd8d9fb tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:31:30.698168 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-1ff9c527-2796-44e0-b024-630c4bd8d9fb tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] [instance: 20760e77-fe67-4ebe-87f1-34d840495341] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:31:30.707846 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-1ff9c527-2796-44e0-b024-630c4bd8d9fb tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:31:30.708358 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-1ff9c527-2796-44e0-b024-630c4bd8d9fb tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:31:30.709213 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-1ff9c527-2796-44e0-b024-630c4bd8d9fb tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:31:30.709708 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-1ff9c527-2796-44e0-b024-630c4bd8d9fb tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:31:30.938050 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-1ff9c527-2796-44e0-b024-630c4bd8d9fb tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1daf9a83b1d24033a3d4c0f531a4eb2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5336afdcf4aa4b46b0655432b7a1323c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:31:30.947868 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-1ff9c527-2796-44e0-b024-630c4bd8d9fb tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] 10.222.0.78 "GET /compute/v2.1/servers/20760e77-fe67-4ebe-87f1-34d840495341" status: 200 len: 1509 microversion: 2.1 time: 0.255635 Feb 17 04:31:30.948797 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 273/539] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:31:30 2021] GET /compute/v2.1/servers/20760e77-fe67-4ebe-87f1-34d840495341 => generated 1509 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:31:30.954433 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-dd85e1c5-08b2-4528-9875-f77b85db9365 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:31:30.955630 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-dd85e1c5-08b2-4528-9875-f77b85db9365 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: 29d1ce27-f63b-4523-88be-55f65a6a2529] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:31:30.964651 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-dd85e1c5-08b2-4528-9875-f77b85db9365 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:31:30.965292 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-dd85e1c5-08b2-4528-9875-f77b85db9365 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:31:30.966254 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-dd85e1c5-08b2-4528-9875-f77b85db9365 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:31:30.966982 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-dd85e1c5-08b2-4528-9875-f77b85db9365 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:31:31.034062 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-5741d2be-81de-4b5c-8665-2a8770f9ef43 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] 10.222.0.78 "POST /compute/v2.1/servers/8b4ba536-4de5-4f0e-9cb0-cc08d8616e5d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.435311 Feb 17 04:31:31.034740 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 267/540] 10.222.0.78 () {60 vars in 1313 bytes} [Wed Feb 17 04:31:30 2021] POST /compute/v2.1/servers/8b4ba536-4de5-4f0e-9cb0-cc08d8616e5d/os-volume_attachments => generated 194 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 17 04:31:31.130266 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-dd85e1c5-08b2-4528-9875-f77b85db9365 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "POST /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529/action" status: 200 len: 28650 microversion: 2.1 time: 0.179862 Feb 17 04:31:31.136488 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 274/541] 10.222.0.78 () {60 vars in 1268 bytes} [Wed Feb 17 04:31:30 2021] POST /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529/action => generated 28650 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 04:31:31.185094 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-598ea93c-7892-4cb5-9fc9-fb3f3a71494a tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5f985a25-e960-42e3-85e9-ba79f4254b21"}} {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:31:31.186665 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-598ea93c-7892-4cb5-9fc9-fb3f3a71494a tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] [instance: ad42ab86-4168-46d3-9394-9fb44fc79d18] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:31:31.197682 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-598ea93c-7892-4cb5-9fc9-fb3f3a71494a tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:31:31.198606 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-598ea93c-7892-4cb5-9fc9-fb3f3a71494a tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:31:31.199745 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-598ea93c-7892-4cb5-9fc9-fb3f3a71494a tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:31:31.200432 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-598ea93c-7892-4cb5-9fc9-fb3f3a71494a tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:31:31.555074 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-3b34f12b-0359-4954-bff7-3465b1b9ddc2 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:31:31.556238 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-3b34f12b-0359-4954-bff7-3465b1b9ddc2 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] [instance: 82b1aa2d-c36c-4734-b664-0958e6f4d33e] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:31:31.568431 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-3b34f12b-0359-4954-bff7-3465b1b9ddc2 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:31:31.569178 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-3b34f12b-0359-4954-bff7-3465b1b9ddc2 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:31:31.570228 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-3b34f12b-0359-4954-bff7-3465b1b9ddc2 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:31:31.571092 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-3b34f12b-0359-4954-bff7-3465b1b9ddc2 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:31:31.732703 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-598ea93c-7892-4cb5-9fc9-fb3f3a71494a tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] 10.222.0.78 "POST /compute/v2.1/servers/ad42ab86-4168-46d3-9394-9fb44fc79d18/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.553139 Feb 17 04:31:31.733498 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 268/542] 10.222.0.78 () {60 vars in 1313 bytes} [Wed Feb 17 04:31:31 2021] POST /compute/v2.1/servers/ad42ab86-4168-46d3-9394-9fb44fc79d18/os-volume_attachments => generated 194 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:31:31.813881 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-3b34f12b-0359-4954-bff7-3465b1b9ddc2 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88eaaf0dd96340229d9f519b3489cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0608d586fdf4ba4b2b7f7137d49389a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:31:31.824600 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-3b34f12b-0359-4954-bff7-3465b1b9ddc2 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] 10.222.0.78 "GET /compute/v2.1/servers/82b1aa2d-c36c-4734-b664-0958e6f4d33e" status: 200 len: 1313 microversion: 2.1 time: 0.274326 Feb 17 04:31:31.825247 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 275/543] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:31:31 2021] GET /compute/v2.1/servers/82b1aa2d-c36c-4734-b664-0958e6f4d33e => generated 1313 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:31:31.967301 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-828b6db9-76b3-4662-9254-f876278c6b40 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:31:31.968085 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-828b6db9-76b3-4662-9254-f876278c6b40 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] [instance: 20760e77-fe67-4ebe-87f1-34d840495341] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:31:31.977883 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-828b6db9-76b3-4662-9254-f876278c6b40 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:31:31.978402 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-828b6db9-76b3-4662-9254-f876278c6b40 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:31:31.979310 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-828b6db9-76b3-4662-9254-f876278c6b40 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:31:31.979809 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-828b6db9-76b3-4662-9254-f876278c6b40 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:31:32.142346 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-b9e16383-eedf-4d2d-ac6f-649aaee115dc tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:31:32.143889 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-b9e16383-eedf-4d2d-ac6f-649aaee115dc tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: 29d1ce27-f63b-4523-88be-55f65a6a2529] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:31:32.165770 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-b9e16383-eedf-4d2d-ac6f-649aaee115dc tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:31:32.166355 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-b9e16383-eedf-4d2d-ac6f-649aaee115dc tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:31:32.167511 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-b9e16383-eedf-4d2d-ac6f-649aaee115dc tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:31:32.169146 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-b9e16383-eedf-4d2d-ac6f-649aaee115dc tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:31:32.214573 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-828b6db9-76b3-4662-9254-f876278c6b40 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1daf9a83b1d24033a3d4c0f531a4eb2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5336afdcf4aa4b46b0655432b7a1323c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:31:32.224790 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-828b6db9-76b3-4662-9254-f876278c6b40 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] 10.222.0.78 "GET /compute/v2.1/servers/20760e77-fe67-4ebe-87f1-34d840495341" status: 200 len: 1509 microversion: 2.1 time: 0.262029 Feb 17 04:31:32.225624 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 269/544] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:31:31 2021] GET /compute/v2.1/servers/20760e77-fe67-4ebe-87f1-34d840495341 => generated 1509 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:31:32.352649 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-b9e16383-eedf-4d2d-ac6f-649aaee115dc tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "POST /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529/action" status: 200 len: 28650 microversion: 2.1 time: 0.213407 Feb 17 04:31:32.361372 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 276/545] 10.222.0.78 () {60 vars in 1268 bytes} [Wed Feb 17 04:31:32 2021] POST /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529/action => generated 28650 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 04:31:32.753574 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [req-9ecec4f9-3b34-4447-91a0-2fa5fce3cb5f req-8a1cba58-9727-422a-bd03-ff56f0cfd853 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82b1aa2d-c36c-4734-b664-0958e6f4d33e", "name": "network-vif-plugged", "status": "completed", "tag": "df06620b-cd13-40eb-a7ef-c665dd300756"}]} {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:31:32.755254 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:31:32.755254 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: warnings.warn(msg) Feb 17 04:31:32.765409 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [req-9ecec4f9-3b34-4447-91a0-2fa5fce3cb5f req-8a1cba58-9727-422a-bd03-ff56f0cfd853 service nova] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:31:32.765912 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [req-9ecec4f9-3b34-4447-91a0-2fa5fce3cb5f req-8a1cba58-9727-422a-bd03-ff56f0cfd853 service nova] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:31:32.786158 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.compute.server_external_events [req-9ecec4f9-3b34-4447-91a0-2fa5fce3cb5f req-8a1cba58-9727-422a-bd03-ff56f0cfd853 service nova] Creating event network-vif-plugged:df06620b-cd13-40eb-a7ef-c665dd300756 for instance 82b1aa2d-c36c-4734-b664-0958e6f4d33e on hv-cinder-75998 Feb 17 04:31:32.791865 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [req-9ecec4f9-3b34-4447-91a0-2fa5fce3cb5f req-8a1cba58-9727-422a-bd03-ff56f0cfd853 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043540 Feb 17 04:31:32.793020 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 270/546] 10.222.0.78 () {64 vars in 1308 bytes} [Wed Feb 17 04:31:32 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:31:32.846127 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-fbccdb68-2d36-442f-8195-1bb102ce7612 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:31:32.846513 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-fbccdb68-2d36-442f-8195-1bb102ce7612 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] [instance: 82b1aa2d-c36c-4734-b664-0958e6f4d33e] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:31:32.858397 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-fbccdb68-2d36-442f-8195-1bb102ce7612 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:31:32.859091 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-fbccdb68-2d36-442f-8195-1bb102ce7612 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:31:32.860021 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-fbccdb68-2d36-442f-8195-1bb102ce7612 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:31:32.860609 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-fbccdb68-2d36-442f-8195-1bb102ce7612 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:31:33.115210 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-fbccdb68-2d36-442f-8195-1bb102ce7612 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88eaaf0dd96340229d9f519b3489cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0608d586fdf4ba4b2b7f7137d49389a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:31:33.124628 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-fbccdb68-2d36-442f-8195-1bb102ce7612 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] 10.222.0.78 "GET /compute/v2.1/servers/82b1aa2d-c36c-4734-b664-0958e6f4d33e" status: 200 len: 1313 microversion: 2.1 time: 0.283592 Feb 17 04:31:33.125529 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 277/547] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:31:32 2021] GET /compute/v2.1/servers/82b1aa2d-c36c-4734-b664-0958e6f4d33e => generated 1313 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:31:33.244554 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-597c883c-fb14-425a-ad78-6c6917e72673 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:31:33.245320 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-597c883c-fb14-425a-ad78-6c6917e72673 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] [instance: 20760e77-fe67-4ebe-87f1-34d840495341] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:31:33.253636 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-597c883c-fb14-425a-ad78-6c6917e72673 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:31:33.253862 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-597c883c-fb14-425a-ad78-6c6917e72673 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:31:33.254702 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-597c883c-fb14-425a-ad78-6c6917e72673 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:31:33.255222 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-597c883c-fb14-425a-ad78-6c6917e72673 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:31:33.365633 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-68816a1f-94b9-4cf5-b1c9-86a65d6e68be tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:31:33.367208 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-68816a1f-94b9-4cf5-b1c9-86a65d6e68be tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: 29d1ce27-f63b-4523-88be-55f65a6a2529] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:31:33.376839 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-68816a1f-94b9-4cf5-b1c9-86a65d6e68be tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:31:33.377581 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-68816a1f-94b9-4cf5-b1c9-86a65d6e68be tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:31:33.378603 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-68816a1f-94b9-4cf5-b1c9-86a65d6e68be tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:31:33.379324 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-68816a1f-94b9-4cf5-b1c9-86a65d6e68be tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:31:33.539936 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-597c883c-fb14-425a-ad78-6c6917e72673 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1daf9a83b1d24033a3d4c0f531a4eb2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5336afdcf4aa4b46b0655432b7a1323c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:31:33.549582 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-597c883c-fb14-425a-ad78-6c6917e72673 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] 10.222.0.78 "GET /compute/v2.1/servers/20760e77-fe67-4ebe-87f1-34d840495341" status: 200 len: 1509 microversion: 2.1 time: 0.309435 Feb 17 04:31:33.550192 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 271/548] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:31:33 2021] GET /compute/v2.1/servers/20760e77-fe67-4ebe-87f1-34d840495341 => generated 1509 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:31:33.887257 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-68816a1f-94b9-4cf5-b1c9-86a65d6e68be tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "POST /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529/action" status: 200 len: 28650 microversion: 2.1 time: 0.525515 Feb 17 04:31:33.888120 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 278/549] 10.222.0.78 () {60 vars in 1268 bytes} [Wed Feb 17 04:31:33 2021] POST /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529/action => generated 28650 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 17 04:31:34.143507 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-fcdde234-d0a0-4a64-851b-c3d39311dce1 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:31:34.144192 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-fcdde234-d0a0-4a64-851b-c3d39311dce1 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] [instance: 82b1aa2d-c36c-4734-b664-0958e6f4d33e] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:31:34.159737 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-fcdde234-d0a0-4a64-851b-c3d39311dce1 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:31:34.160255 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-fcdde234-d0a0-4a64-851b-c3d39311dce1 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:31:34.161189 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-fcdde234-d0a0-4a64-851b-c3d39311dce1 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:31:34.161686 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-fcdde234-d0a0-4a64-851b-c3d39311dce1 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:31:34.393565 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-fcdde234-d0a0-4a64-851b-c3d39311dce1 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88eaaf0dd96340229d9f519b3489cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0608d586fdf4ba4b2b7f7137d49389a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:31:34.403415 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-fcdde234-d0a0-4a64-851b-c3d39311dce1 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] 10.222.0.78 "GET /compute/v2.1/servers/82b1aa2d-c36c-4734-b664-0958e6f4d33e" status: 200 len: 1313 microversion: 2.1 time: 0.264151 Feb 17 04:31:34.404029 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 272/550] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:31:34 2021] GET /compute/v2.1/servers/82b1aa2d-c36c-4734-b664-0958e6f4d33e => generated 1313 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:31:34.574223 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-bba31bd3-041c-4415-9a86-a75e9691873b tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:31:34.575276 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-bba31bd3-041c-4415-9a86-a75e9691873b tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] [instance: 20760e77-fe67-4ebe-87f1-34d840495341] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:31:34.584379 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-bba31bd3-041c-4415-9a86-a75e9691873b tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:31:34.584379 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-bba31bd3-041c-4415-9a86-a75e9691873b tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:31:34.585229 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-bba31bd3-041c-4415-9a86-a75e9691873b tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:31:34.585792 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-bba31bd3-041c-4415-9a86-a75e9691873b tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:31:34.809850 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-bba31bd3-041c-4415-9a86-a75e9691873b tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1daf9a83b1d24033a3d4c0f531a4eb2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5336afdcf4aa4b46b0655432b7a1323c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:31:34.819266 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-bba31bd3-041c-4415-9a86-a75e9691873b tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] 10.222.0.78 "GET /compute/v2.1/servers/20760e77-fe67-4ebe-87f1-34d840495341" status: 200 len: 1509 microversion: 2.1 time: 0.250183 Feb 17 04:31:34.819858 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 279/551] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:31:34 2021] GET /compute/v2.1/servers/20760e77-fe67-4ebe-87f1-34d840495341 => generated 1509 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:31:34.900319 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-7df0626f-1982-40a0-a8eb-ec76fcce445d tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:31:34.901379 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-7df0626f-1982-40a0-a8eb-ec76fcce445d tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: 29d1ce27-f63b-4523-88be-55f65a6a2529] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:31:34.909762 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-7df0626f-1982-40a0-a8eb-ec76fcce445d tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:31:34.910285 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-7df0626f-1982-40a0-a8eb-ec76fcce445d tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:31:34.911164 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-7df0626f-1982-40a0-a8eb-ec76fcce445d tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:31:34.911669 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-7df0626f-1982-40a0-a8eb-ec76fcce445d tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:31:35.093670 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-7df0626f-1982-40a0-a8eb-ec76fcce445d tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "POST /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529/action" status: 200 len: 28650 microversion: 2.1 time: 0.197325 Feb 17 04:31:35.094614 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 273/552] 10.222.0.78 () {60 vars in 1268 bytes} [Wed Feb 17 04:31:34 2021] POST /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529/action => generated 28650 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 04:31:35.421404 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-3509aac7-10be-46c3-87fe-65589025722e tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:31:35.422090 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-3509aac7-10be-46c3-87fe-65589025722e tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] [instance: 82b1aa2d-c36c-4734-b664-0958e6f4d33e] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:31:35.430597 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-3509aac7-10be-46c3-87fe-65589025722e tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:31:35.431250 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-3509aac7-10be-46c3-87fe-65589025722e tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:31:35.432097 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-3509aac7-10be-46c3-87fe-65589025722e tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:31:35.432594 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-3509aac7-10be-46c3-87fe-65589025722e tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:31:35.704082 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-3509aac7-10be-46c3-87fe-65589025722e tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88eaaf0dd96340229d9f519b3489cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0608d586fdf4ba4b2b7f7137d49389a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:31:35.714621 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-3509aac7-10be-46c3-87fe-65589025722e tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] 10.222.0.78 "GET /compute/v2.1/servers/82b1aa2d-c36c-4734-b664-0958e6f4d33e" status: 200 len: 1313 microversion: 2.1 time: 0.296609 Feb 17 04:31:35.715254 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 280/553] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:31:35 2021] GET /compute/v2.1/servers/82b1aa2d-c36c-4734-b664-0958e6f4d33e => generated 1313 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:31:35.839308 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-9aff3e7a-c793-448f-aeeb-66d012b3fc78 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:31:35.845512 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-9aff3e7a-c793-448f-aeeb-66d012b3fc78 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] [instance: 20760e77-fe67-4ebe-87f1-34d840495341] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:31:35.855128 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-9aff3e7a-c793-448f-aeeb-66d012b3fc78 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:31:35.855645 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-9aff3e7a-c793-448f-aeeb-66d012b3fc78 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:31:35.856510 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-9aff3e7a-c793-448f-aeeb-66d012b3fc78 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:31:35.857015 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-9aff3e7a-c793-448f-aeeb-66d012b3fc78 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:31:36.080842 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-9aff3e7a-c793-448f-aeeb-66d012b3fc78 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1daf9a83b1d24033a3d4c0f531a4eb2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5336afdcf4aa4b46b0655432b7a1323c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:31:36.091154 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-9aff3e7a-c793-448f-aeeb-66d012b3fc78 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] 10.222.0.78 "GET /compute/v2.1/servers/20760e77-fe67-4ebe-87f1-34d840495341" status: 200 len: 1509 microversion: 2.1 time: 0.256928 Feb 17 04:31:36.095064 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 274/554] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:31:35 2021] GET /compute/v2.1/servers/20760e77-fe67-4ebe-87f1-34d840495341 => generated 1509 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:31:36.106499 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-c1154287-9d0f-478c-a630-0cb3cbfb606a tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:31:36.107552 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-c1154287-9d0f-478c-a630-0cb3cbfb606a tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: 29d1ce27-f63b-4523-88be-55f65a6a2529] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:31:36.115791 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-c1154287-9d0f-478c-a630-0cb3cbfb606a tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:31:36.116298 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-c1154287-9d0f-478c-a630-0cb3cbfb606a tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:31:36.117125 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-c1154287-9d0f-478c-a630-0cb3cbfb606a tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:31:36.117707 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-c1154287-9d0f-478c-a630-0cb3cbfb606a tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:31:36.291231 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-c1154287-9d0f-478c-a630-0cb3cbfb606a tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "POST /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529/action" status: 200 len: 28650 microversion: 2.1 time: 0.188953 Feb 17 04:31:36.291823 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 281/555] 10.222.0.78 () {60 vars in 1268 bytes} [Wed Feb 17 04:31:36 2021] POST /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529/action => generated 28650 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 04:31:36.733365 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-e839f717-ee4b-4d72-8b67-231509e4e3f0 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:31:36.734046 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-e839f717-ee4b-4d72-8b67-231509e4e3f0 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] [instance: 82b1aa2d-c36c-4734-b664-0958e6f4d33e] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:31:36.742159 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-e839f717-ee4b-4d72-8b67-231509e4e3f0 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:31:36.743097 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-e839f717-ee4b-4d72-8b67-231509e4e3f0 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:31:36.744082 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-e839f717-ee4b-4d72-8b67-231509e4e3f0 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:31:36.744597 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-e839f717-ee4b-4d72-8b67-231509e4e3f0 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:31:36.974988 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-e839f717-ee4b-4d72-8b67-231509e4e3f0 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88eaaf0dd96340229d9f519b3489cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0608d586fdf4ba4b2b7f7137d49389a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:31:36.984452 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-e839f717-ee4b-4d72-8b67-231509e4e3f0 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] 10.222.0.78 "GET /compute/v2.1/servers/82b1aa2d-c36c-4734-b664-0958e6f4d33e" status: 200 len: 1497 microversion: 2.1 time: 0.255277 Feb 17 04:31:36.985056 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 275/556] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:31:36 2021] GET /compute/v2.1/servers/82b1aa2d-c36c-4734-b664-0958e6f4d33e => generated 1497 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:31:37.109963 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-e0d3779a-6030-4b42-9eb4-b711cecc63d2 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:31:37.110773 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-e0d3779a-6030-4b42-9eb4-b711cecc63d2 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] [instance: 20760e77-fe67-4ebe-87f1-34d840495341] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:31:37.120903 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-e0d3779a-6030-4b42-9eb4-b711cecc63d2 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:31:37.121409 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-e0d3779a-6030-4b42-9eb4-b711cecc63d2 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:31:37.122243 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-e0d3779a-6030-4b42-9eb4-b711cecc63d2 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:31:37.122733 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-e0d3779a-6030-4b42-9eb4-b711cecc63d2 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:31:37.304221 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-64b4b277-bc5b-4b45-a8f1-2e1634bceceb tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:31:37.305497 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-64b4b277-bc5b-4b45-a8f1-2e1634bceceb tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: 29d1ce27-f63b-4523-88be-55f65a6a2529] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:31:37.313938 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-64b4b277-bc5b-4b45-a8f1-2e1634bceceb tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:31:37.314452 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-64b4b277-bc5b-4b45-a8f1-2e1634bceceb tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:31:37.315324 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-64b4b277-bc5b-4b45-a8f1-2e1634bceceb tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:31:37.315824 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-64b4b277-bc5b-4b45-a8f1-2e1634bceceb tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:31:37.351018 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-e0d3779a-6030-4b42-9eb4-b711cecc63d2 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1daf9a83b1d24033a3d4c0f531a4eb2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5336afdcf4aa4b46b0655432b7a1323c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:31:37.362267 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-e0d3779a-6030-4b42-9eb4-b711cecc63d2 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] 10.222.0.78 "GET /compute/v2.1/servers/20760e77-fe67-4ebe-87f1-34d840495341" status: 200 len: 1515 microversion: 2.1 time: 0.256700 Feb 17 04:31:37.373109 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 282/557] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:31:37 2021] GET /compute/v2.1/servers/20760e77-fe67-4ebe-87f1-34d840495341 => generated 1515 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:31:37.457245 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-64b4b277-bc5b-4b45-a8f1-2e1634bceceb tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "POST /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529/action" status: 200 len: 28650 microversion: 2.1 time: 0.156773 Feb 17 04:31:37.458285 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 276/558] 10.222.0.78 () {60 vars in 1268 bytes} [Wed Feb 17 04:31:37 2021] POST /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529/action => generated 28650 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 04:31:38.470763 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-95add2ac-574a-4730-bd78-d252d70fcf13 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:31:38.471910 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-95add2ac-574a-4730-bd78-d252d70fcf13 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: 29d1ce27-f63b-4523-88be-55f65a6a2529] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:31:38.481900 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-95add2ac-574a-4730-bd78-d252d70fcf13 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:31:38.482419 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-95add2ac-574a-4730-bd78-d252d70fcf13 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:31:38.483321 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-95add2ac-574a-4730-bd78-d252d70fcf13 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:31:38.483827 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-95add2ac-574a-4730-bd78-d252d70fcf13 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:31:38.507438 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-826fc663-d42b-4710-aa18-0c6693847a2c tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:31:38.508144 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-826fc663-d42b-4710-aa18-0c6693847a2c tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] [instance: 82b1aa2d-c36c-4734-b664-0958e6f4d33e] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:31:38.516776 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-826fc663-d42b-4710-aa18-0c6693847a2c tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:31:38.517291 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-826fc663-d42b-4710-aa18-0c6693847a2c tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:31:38.518143 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-826fc663-d42b-4710-aa18-0c6693847a2c tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:31:38.518639 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-826fc663-d42b-4710-aa18-0c6693847a2c tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:31:38.584883 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-826fc663-d42b-4710-aa18-0c6693847a2c tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] [instance: 82b1aa2d-c36c-4734-b664-0958e6f4d33e] Going to try to terminate instance {{(pid=98178) delete /opt/stack/nova/nova/compute/api.py:2540}} Feb 17 04:31:38.636709 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-95add2ac-574a-4730-bd78-d252d70fcf13 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "POST /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529/action" status: 200 len: 28650 microversion: 2.1 time: 0.169677 Feb 17 04:31:38.640934 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 283/559] 10.222.0.78 () {60 vars in 1268 bytes} [Wed Feb 17 04:31:38 2021] POST /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529/action => generated 28650 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 04:31:38.710929 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-826fc663-d42b-4710-aa18-0c6693847a2c tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] 10.222.0.78 "DELETE /compute/v2.1/servers/82b1aa2d-c36c-4734-b664-0958e6f4d33e" status: 204 len: 0 microversion: 2.1 time: 0.207340 Feb 17 04:31:38.712315 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 277/560] 10.222.0.78 () {58 vars in 1229 bytes} [Wed Feb 17 04:31:38 2021] DELETE /compute/v2.1/servers/82b1aa2d-c36c-4734-b664-0958e6f4d33e => generated 0 bytes in 210 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 17 04:31:38.721367 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-e3e0108b-c455-4a0b-a93d-2385fca79322 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:31:38.722138 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-e3e0108b-c455-4a0b-a93d-2385fca79322 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] [instance: 82b1aa2d-c36c-4734-b664-0958e6f4d33e] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:31:38.730956 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-e3e0108b-c455-4a0b-a93d-2385fca79322 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:31:38.731499 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-e3e0108b-c455-4a0b-a93d-2385fca79322 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:31:38.732340 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-e3e0108b-c455-4a0b-a93d-2385fca79322 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:31:38.732834 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-e3e0108b-c455-4a0b-a93d-2385fca79322 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:31:38.955353 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-e3e0108b-c455-4a0b-a93d-2385fca79322 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88eaaf0dd96340229d9f519b3489cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0608d586fdf4ba4b2b7f7137d49389a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:31:38.965548 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-e3e0108b-c455-4a0b-a93d-2385fca79322 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] 10.222.0.78 "GET /compute/v2.1/servers/82b1aa2d-c36c-4734-b664-0958e6f4d33e" status: 200 len: 1503 microversion: 2.1 time: 0.248580 Feb 17 04:31:38.966385 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 284/561] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:31:38 2021] GET /compute/v2.1/servers/82b1aa2d-c36c-4734-b664-0958e6f4d33e => generated 1503 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:31:39.650660 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-fb1f7566-7688-4097-a5c1-2406e97b66c7 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:31:39.651969 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-fb1f7566-7688-4097-a5c1-2406e97b66c7 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: 29d1ce27-f63b-4523-88be-55f65a6a2529] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:31:39.660985 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-fb1f7566-7688-4097-a5c1-2406e97b66c7 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:31:39.661495 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-fb1f7566-7688-4097-a5c1-2406e97b66c7 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:31:39.662344 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-fb1f7566-7688-4097-a5c1-2406e97b66c7 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:31:39.662842 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-fb1f7566-7688-4097-a5c1-2406e97b66c7 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:31:39.808904 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-fb1f7566-7688-4097-a5c1-2406e97b66c7 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "POST /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529/action" status: 200 len: 28650 microversion: 2.1 time: 0.163285 Feb 17 04:31:39.809908 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 278/562] 10.222.0.78 () {60 vars in 1268 bytes} [Wed Feb 17 04:31:39 2021] POST /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529/action => generated 28650 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 04:31:39.984248 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-406d1193-e34d-4f6c-86f1-c2f3583e17ef tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:31:39.984966 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-406d1193-e34d-4f6c-86f1-c2f3583e17ef tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] [instance: 82b1aa2d-c36c-4734-b664-0958e6f4d33e] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:31:39.994068 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-406d1193-e34d-4f6c-86f1-c2f3583e17ef tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:31:39.994575 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-406d1193-e34d-4f6c-86f1-c2f3583e17ef tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:31:39.995433 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-406d1193-e34d-4f6c-86f1-c2f3583e17ef tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:31:39.995926 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-406d1193-e34d-4f6c-86f1-c2f3583e17ef tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:31:40.142392 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-e330ecaf-257a-47ef-84d6-06b6801debf5 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:31:40.143364 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-e330ecaf-257a-47ef-84d6-06b6801debf5 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] [instance: 20760e77-fe67-4ebe-87f1-34d840495341] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:31:40.152760 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-e330ecaf-257a-47ef-84d6-06b6801debf5 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:31:40.153264 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-e330ecaf-257a-47ef-84d6-06b6801debf5 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:31:40.154113 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-e330ecaf-257a-47ef-84d6-06b6801debf5 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:31:40.154608 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-e330ecaf-257a-47ef-84d6-06b6801debf5 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:31:40.215960 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-406d1193-e34d-4f6c-86f1-c2f3583e17ef tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88eaaf0dd96340229d9f519b3489cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0608d586fdf4ba4b2b7f7137d49389a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:31:40.225206 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-406d1193-e34d-4f6c-86f1-c2f3583e17ef tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] 10.222.0.78 "GET /compute/v2.1/servers/82b1aa2d-c36c-4734-b664-0958e6f4d33e" status: 200 len: 1503 microversion: 2.1 time: 0.245018 Feb 17 04:31:40.225964 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 285/563] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:31:39 2021] GET /compute/v2.1/servers/82b1aa2d-c36c-4734-b664-0958e6f4d33e => generated 1503 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:31:40.368318 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-e330ecaf-257a-47ef-84d6-06b6801debf5 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1daf9a83b1d24033a3d4c0f531a4eb2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5336afdcf4aa4b46b0655432b7a1323c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:31:40.377151 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-e330ecaf-257a-47ef-84d6-06b6801debf5 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] 10.222.0.78 "GET /compute/v2.1/servers/20760e77-fe67-4ebe-87f1-34d840495341" status: 200 len: 1515 microversion: 2.1 time: 0.239409 Feb 17 04:31:40.377775 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 279/564] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:31:40 2021] GET /compute/v2.1/servers/20760e77-fe67-4ebe-87f1-34d840495341 => generated 1515 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:31:40.394547 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-abd6efdb-8da8-4e99-b842-921aea6ed843 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "89dc3d17-5108-44ee-9b6f-94e7d31c33af"}} {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:31:40.395745 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-abd6efdb-8da8-4e99-b842-921aea6ed843 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] [instance: 20760e77-fe67-4ebe-87f1-34d840495341] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:31:40.404249 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-abd6efdb-8da8-4e99-b842-921aea6ed843 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:31:40.404754 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-abd6efdb-8da8-4e99-b842-921aea6ed843 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:31:40.405578 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-abd6efdb-8da8-4e99-b842-921aea6ed843 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:31:40.406059 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-abd6efdb-8da8-4e99-b842-921aea6ed843 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:31:40.821679 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-380f7384-8b48-4bb6-b047-fc2da9d2a3a6 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:31:40.822728 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-380f7384-8b48-4bb6-b047-fc2da9d2a3a6 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: 29d1ce27-f63b-4523-88be-55f65a6a2529] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:31:40.830619 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-380f7384-8b48-4bb6-b047-fc2da9d2a3a6 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:31:40.831201 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-380f7384-8b48-4bb6-b047-fc2da9d2a3a6 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:31:40.832052 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-380f7384-8b48-4bb6-b047-fc2da9d2a3a6 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:31:40.832555 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-380f7384-8b48-4bb6-b047-fc2da9d2a3a6 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:31:44.390776 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-380f7384-8b48-4bb6-b047-fc2da9d2a3a6 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "POST /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529/action" status: 200 len: 28650 microversion: 2.1 time: 3.573252 Feb 17 04:31:44.391516 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 280/565] 10.222.0.78 () {60 vars in 1268 bytes} [Wed Feb 17 04:31:40 2021] POST /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529/action => generated 28650 bytes in 3575 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 04:31:44.397049 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-683824f1-ee4e-4eb6-b372-187dd042ad47 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:31:44.397820 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-683824f1-ee4e-4eb6-b372-187dd042ad47 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] [instance: 82b1aa2d-c36c-4734-b664-0958e6f4d33e] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:31:44.409793 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-683824f1-ee4e-4eb6-b372-187dd042ad47 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:31:44.410334 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-683824f1-ee4e-4eb6-b372-187dd042ad47 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:31:44.411696 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-683824f1-ee4e-4eb6-b372-187dd042ad47 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:31:44.412352 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-683824f1-ee4e-4eb6-b372-187dd042ad47 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:31:44.632117 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-abd6efdb-8da8-4e99-b842-921aea6ed843 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] 10.222.0.78 "POST /compute/v2.1/servers/20760e77-fe67-4ebe-87f1-34d840495341/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 4.240171 Feb 17 04:31:44.633801 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 286/566] 10.222.0.78 () {60 vars in 1313 bytes} [Wed Feb 17 04:31:40 2021] POST /compute/v2.1/servers/20760e77-fe67-4ebe-87f1-34d840495341/os-volume_attachments => generated 194 bytes in 4244 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:31:44.684775 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-683824f1-ee4e-4eb6-b372-187dd042ad47 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88eaaf0dd96340229d9f519b3489cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0608d586fdf4ba4b2b7f7137d49389a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:31:44.693885 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-683824f1-ee4e-4eb6-b372-187dd042ad47 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] 10.222.0.78 "GET /compute/v2.1/servers/82b1aa2d-c36c-4734-b664-0958e6f4d33e" status: 200 len: 1503 microversion: 2.1 time: 0.301116 Feb 17 04:31:44.694517 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 281/567] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:31:44 2021] GET /compute/v2.1/servers/82b1aa2d-c36c-4734-b664-0958e6f4d33e => generated 1503 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:31:45.405145 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-716088a3-e8ea-4268-bae0-e12479abcb6a tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:31:45.405145 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-716088a3-e8ea-4268-bae0-e12479abcb6a tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: 29d1ce27-f63b-4523-88be-55f65a6a2529] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:31:45.414388 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-716088a3-e8ea-4268-bae0-e12479abcb6a tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:31:45.414898 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-716088a3-e8ea-4268-bae0-e12479abcb6a tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:31:45.415887 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-716088a3-e8ea-4268-bae0-e12479abcb6a tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:31:45.416379 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-716088a3-e8ea-4268-bae0-e12479abcb6a tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:31:45.713815 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-c3861a4b-4e00-4a58-9b9b-59a0a47e8e3d tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:31:45.714520 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-c3861a4b-4e00-4a58-9b9b-59a0a47e8e3d tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] [instance: 82b1aa2d-c36c-4734-b664-0958e6f4d33e] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:31:45.722757 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-c3861a4b-4e00-4a58-9b9b-59a0a47e8e3d tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:31:45.723308 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-c3861a4b-4e00-4a58-9b9b-59a0a47e8e3d tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:31:45.724140 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-c3861a4b-4e00-4a58-9b9b-59a0a47e8e3d tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:31:45.724634 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-c3861a4b-4e00-4a58-9b9b-59a0a47e8e3d tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:31:45.948901 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-c3861a4b-4e00-4a58-9b9b-59a0a47e8e3d tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88eaaf0dd96340229d9f519b3489cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0608d586fdf4ba4b2b7f7137d49389a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:31:45.957690 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-c3861a4b-4e00-4a58-9b9b-59a0a47e8e3d tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] 10.222.0.78 "GET /compute/v2.1/servers/82b1aa2d-c36c-4734-b664-0958e6f4d33e" status: 200 len: 1503 microversion: 2.1 time: 0.247947 Feb 17 04:31:45.958292 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 282/568] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:31:45 2021] GET /compute/v2.1/servers/82b1aa2d-c36c-4734-b664-0958e6f4d33e => generated 1503 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:31:46.977419 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-e1f3b65f-9ace-4678-bbdc-2b4f6eac6760 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:31:46.978101 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-e1f3b65f-9ace-4678-bbdc-2b4f6eac6760 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] [instance: 82b1aa2d-c36c-4734-b664-0958e6f4d33e] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:31:46.986010 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-e1f3b65f-9ace-4678-bbdc-2b4f6eac6760 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:31:46.986530 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-e1f3b65f-9ace-4678-bbdc-2b4f6eac6760 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:31:46.987648 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-e1f3b65f-9ace-4678-bbdc-2b4f6eac6760 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:31:46.988145 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-e1f3b65f-9ace-4678-bbdc-2b4f6eac6760 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:31:47.206909 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-e1f3b65f-9ace-4678-bbdc-2b4f6eac6760 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88eaaf0dd96340229d9f519b3489cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0608d586fdf4ba4b2b7f7137d49389a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:31:47.216985 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-e1f3b65f-9ace-4678-bbdc-2b4f6eac6760 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] 10.222.0.78 "GET /compute/v2.1/servers/82b1aa2d-c36c-4734-b664-0958e6f4d33e" status: 200 len: 1503 microversion: 2.1 time: 0.244370 Feb 17 04:31:47.217592 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 283/569] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:31:46 2021] GET /compute/v2.1/servers/82b1aa2d-c36c-4734-b664-0958e6f4d33e => generated 1503 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:31:48.234946 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-91473f55-2cb9-4bb5-9cd3-3b402c5445cc tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:31:48.235607 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-91473f55-2cb9-4bb5-9cd3-3b402c5445cc tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] [instance: 82b1aa2d-c36c-4734-b664-0958e6f4d33e] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:31:48.244398 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-91473f55-2cb9-4bb5-9cd3-3b402c5445cc tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:31:48.244899 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-91473f55-2cb9-4bb5-9cd3-3b402c5445cc tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:31:48.245742 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-91473f55-2cb9-4bb5-9cd3-3b402c5445cc tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:31:48.246233 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-91473f55-2cb9-4bb5-9cd3-3b402c5445cc tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:31:48.454355 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-91473f55-2cb9-4bb5-9cd3-3b402c5445cc tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88eaaf0dd96340229d9f519b3489cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0608d586fdf4ba4b2b7f7137d49389a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:31:48.463749 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-91473f55-2cb9-4bb5-9cd3-3b402c5445cc tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] 10.222.0.78 "GET /compute/v2.1/servers/82b1aa2d-c36c-4734-b664-0958e6f4d33e" status: 200 len: 1503 microversion: 2.1 time: 0.232837 Feb 17 04:31:48.464353 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 284/570] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:31:48 2021] GET /compute/v2.1/servers/82b1aa2d-c36c-4734-b664-0958e6f4d33e => generated 1503 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:31:49.482401 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-003342da-90fa-4ba6-b390-b9b103fa1019 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:31:49.483100 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-003342da-90fa-4ba6-b390-b9b103fa1019 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] [instance: 82b1aa2d-c36c-4734-b664-0958e6f4d33e] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:31:49.491292 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-003342da-90fa-4ba6-b390-b9b103fa1019 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:31:49.491807 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-003342da-90fa-4ba6-b390-b9b103fa1019 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:31:49.493151 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-003342da-90fa-4ba6-b390-b9b103fa1019 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:31:49.493645 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-003342da-90fa-4ba6-b390-b9b103fa1019 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:31:49.707197 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-003342da-90fa-4ba6-b390-b9b103fa1019 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88eaaf0dd96340229d9f519b3489cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0608d586fdf4ba4b2b7f7137d49389a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:31:49.716376 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-003342da-90fa-4ba6-b390-b9b103fa1019 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] 10.222.0.78 "GET /compute/v2.1/servers/82b1aa2d-c36c-4734-b664-0958e6f4d33e" status: 200 len: 1503 microversion: 2.1 time: 0.238036 Feb 17 04:31:49.716978 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 285/571] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:31:49 2021] GET /compute/v2.1/servers/82b1aa2d-c36c-4734-b664-0958e6f4d33e => generated 1503 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:31:50.169394 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-716088a3-e8ea-4268-bae0-e12479abcb6a tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "POST /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529/action" status: 200 len: 28650 microversion: 2.1 time: 4.770787 Feb 17 04:31:50.171127 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 287/572] 10.222.0.78 () {60 vars in 1268 bytes} [Wed Feb 17 04:31:45 2021] POST /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529/action => generated 28650 bytes in 4773 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 17 04:31:50.735067 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-4f342e64-c747-434d-a861-bd831554356a tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:31:50.735779 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-4f342e64-c747-434d-a861-bd831554356a tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] [instance: 82b1aa2d-c36c-4734-b664-0958e6f4d33e] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:31:50.744842 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-4f342e64-c747-434d-a861-bd831554356a tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:31:50.745359 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-4f342e64-c747-434d-a861-bd831554356a tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:31:50.746206 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-4f342e64-c747-434d-a861-bd831554356a tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:31:50.746707 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-4f342e64-c747-434d-a861-bd831554356a tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:31:50.961476 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-4f342e64-c747-434d-a861-bd831554356a tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88eaaf0dd96340229d9f519b3489cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0608d586fdf4ba4b2b7f7137d49389a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:31:50.970255 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-4f342e64-c747-434d-a861-bd831554356a tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] 10.222.0.78 "GET /compute/v2.1/servers/82b1aa2d-c36c-4734-b664-0958e6f4d33e" status: 200 len: 1503 microversion: 2.1 time: 0.239197 Feb 17 04:31:50.970854 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 286/573] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:31:50 2021] GET /compute/v2.1/servers/82b1aa2d-c36c-4734-b664-0958e6f4d33e => generated 1503 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:31:51.183240 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-5a87a526-7b79-45c0-a0ac-8b8edb4e7995 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:31:51.184792 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-5a87a526-7b79-45c0-a0ac-8b8edb4e7995 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: 29d1ce27-f63b-4523-88be-55f65a6a2529] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:31:51.193762 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-5a87a526-7b79-45c0-a0ac-8b8edb4e7995 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:31:51.194312 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-5a87a526-7b79-45c0-a0ac-8b8edb4e7995 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:31:51.195726 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-5a87a526-7b79-45c0-a0ac-8b8edb4e7995 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:31:51.196498 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-5a87a526-7b79-45c0-a0ac-8b8edb4e7995 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:31:51.389054 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-5a87a526-7b79-45c0-a0ac-8b8edb4e7995 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "POST /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529/action" status: 200 len: 28650 microversion: 2.1 time: 0.210610 Feb 17 04:31:51.390428 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 288/574] 10.222.0.78 () {60 vars in 1268 bytes} [Wed Feb 17 04:31:51 2021] POST /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529/action => generated 28650 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 17 04:31:51.989289 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-54196c8c-dd6d-474f-b16b-ae257f9b21ad tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:31:51.989961 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-54196c8c-dd6d-474f-b16b-ae257f9b21ad tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] [instance: 82b1aa2d-c36c-4734-b664-0958e6f4d33e] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:31:51.999796 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-54196c8c-dd6d-474f-b16b-ae257f9b21ad tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:31:52.000340 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-54196c8c-dd6d-474f-b16b-ae257f9b21ad tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:31:52.001204 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-54196c8c-dd6d-474f-b16b-ae257f9b21ad tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:31:52.001694 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-54196c8c-dd6d-474f-b16b-ae257f9b21ad tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:31:52.411350 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-36ec73fc-fd91-454b-bd74-47963253e39d tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:31:52.412699 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-36ec73fc-fd91-454b-bd74-47963253e39d tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: 29d1ce27-f63b-4523-88be-55f65a6a2529] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:31:52.423762 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-36ec73fc-fd91-454b-bd74-47963253e39d tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:31:52.424554 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-36ec73fc-fd91-454b-bd74-47963253e39d tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:31:52.425732 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-36ec73fc-fd91-454b-bd74-47963253e39d tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:31:52.426413 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-36ec73fc-fd91-454b-bd74-47963253e39d tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:31:52.613360 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-36ec73fc-fd91-454b-bd74-47963253e39d tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "POST /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529/action" status: 200 len: 28650 microversion: 2.1 time: 0.215168 Feb 17 04:31:52.615091 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 289/575] 10.222.0.78 () {60 vars in 1268 bytes} [Wed Feb 17 04:31:52 2021] POST /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529/action => generated 28650 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 04:31:52.621787 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [req-eff9e1cd-4f65-4580-b75c-fe02fdb1c633 req-cfe532b4-5abb-468c-826f-bf6175ceb772 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82b1aa2d-c36c-4734-b664-0958e6f4d33e", "name": "network-vif-deleted", "tag": "df06620b-cd13-40eb-a7ef-c665dd300756"}]} {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:31:52.623661 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:31:52.623661 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: warnings.warn(msg) Feb 17 04:31:52.631926 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-54196c8c-dd6d-474f-b16b-ae257f9b21ad tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88eaaf0dd96340229d9f519b3489cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0608d586fdf4ba4b2b7f7137d49389a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:31:52.647702 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-54196c8c-dd6d-474f-b16b-ae257f9b21ad tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] 10.222.0.78 "GET /compute/v2.1/servers/82b1aa2d-c36c-4734-b664-0958e6f4d33e" status: 200 len: 1503 microversion: 2.1 time: 0.662624 Feb 17 04:31:52.648755 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 287/576] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:31:51 2021] GET /compute/v2.1/servers/82b1aa2d-c36c-4734-b664-0958e6f4d33e => generated 1503 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:31:52.650161 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [req-eff9e1cd-4f65-4580-b75c-fe02fdb1c633 req-cfe532b4-5abb-468c-826f-bf6175ceb772 service nova] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:31:52.650882 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [req-eff9e1cd-4f65-4580-b75c-fe02fdb1c633 req-cfe532b4-5abb-468c-826f-bf6175ceb772 service nova] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:31:52.685909 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.compute.server_external_events [req-eff9e1cd-4f65-4580-b75c-fe02fdb1c633 req-cfe532b4-5abb-468c-826f-bf6175ceb772 service nova] Creating event network-vif-deleted:df06620b-cd13-40eb-a7ef-c665dd300756 for instance 82b1aa2d-c36c-4734-b664-0958e6f4d33e on hv-cinder-75998 Feb 17 04:31:52.691354 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [req-eff9e1cd-4f65-4580-b75c-fe02fdb1c633 req-cfe532b4-5abb-468c-826f-bf6175ceb772 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074610 Feb 17 04:31:52.692031 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 290/577] 10.222.0.78 () {64 vars in 1308 bytes} [Wed Feb 17 04:31:52 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:31:53.625963 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-6106a499-ad41-4dd6-8d30-03f2c55c72af tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:31:53.627084 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-6106a499-ad41-4dd6-8d30-03f2c55c72af tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: 29d1ce27-f63b-4523-88be-55f65a6a2529] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:31:53.636371 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-6106a499-ad41-4dd6-8d30-03f2c55c72af tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:31:53.636882 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-6106a499-ad41-4dd6-8d30-03f2c55c72af tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:31:53.637781 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-6106a499-ad41-4dd6-8d30-03f2c55c72af tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:31:53.638285 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-6106a499-ad41-4dd6-8d30-03f2c55c72af tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:31:53.668188 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-eea8d072-0b13-4829-8379-364ee8b812ee tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:31:53.669381 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-eea8d072-0b13-4829-8379-364ee8b812ee tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] [instance: 82b1aa2d-c36c-4734-b664-0958e6f4d33e] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:31:53.679630 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-eea8d072-0b13-4829-8379-364ee8b812ee tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:31:53.680330 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-eea8d072-0b13-4829-8379-364ee8b812ee tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:31:53.681670 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-eea8d072-0b13-4829-8379-364ee8b812ee tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:31:53.682354 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-eea8d072-0b13-4829-8379-364ee8b812ee tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:31:53.762615 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-eea8d072-0b13-4829-8379-364ee8b812ee tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:31:53.763184 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-eea8d072-0b13-4829-8379-364ee8b812ee tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:31:53.763701 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.objects.instance [None req-eea8d072-0b13-4829-8379-364ee8b812ee tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lazy-loading 'fault' on Instance uuid 82b1aa2d-c36c-4734-b664-0958e6f4d33e {{(pid=98179) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Feb 17 04:31:53.829787 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-eea8d072-0b13-4829-8379-364ee8b812ee tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88eaaf0dd96340229d9f519b3489cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0608d586fdf4ba4b2b7f7137d49389a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:31:53.839273 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-eea8d072-0b13-4829-8379-364ee8b812ee tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] 10.222.0.78 "GET /compute/v2.1/servers/82b1aa2d-c36c-4734-b664-0958e6f4d33e" status: 200 len: 1303 microversion: 2.1 time: 0.176648 Feb 17 04:31:53.839870 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 291/578] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:31:53 2021] GET /compute/v2.1/servers/82b1aa2d-c36c-4734-b664-0958e6f4d33e => generated 1303 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:31:54.858031 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-74543dd2-55d7-41f3-87c5-857acf2f8f87 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:31:54.858811 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-74543dd2-55d7-41f3-87c5-857acf2f8f87 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] [instance: 82b1aa2d-c36c-4734-b664-0958e6f4d33e] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:31:54.867612 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-74543dd2-55d7-41f3-87c5-857acf2f8f87 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:31:54.868204 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-74543dd2-55d7-41f3-87c5-857acf2f8f87 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:31:54.869116 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-74543dd2-55d7-41f3-87c5-857acf2f8f87 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:31:54.869682 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-74543dd2-55d7-41f3-87c5-857acf2f8f87 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:31:54.943291 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-74543dd2-55d7-41f3-87c5-857acf2f8f87 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:31:54.943731 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-74543dd2-55d7-41f3-87c5-857acf2f8f87 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:31:54.944246 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.objects.instance [None req-74543dd2-55d7-41f3-87c5-857acf2f8f87 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lazy-loading 'fault' on Instance uuid 82b1aa2d-c36c-4734-b664-0958e6f4d33e {{(pid=98179) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Feb 17 04:31:55.009157 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-74543dd2-55d7-41f3-87c5-857acf2f8f87 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88eaaf0dd96340229d9f519b3489cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0608d586fdf4ba4b2b7f7137d49389a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:31:55.019929 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-74543dd2-55d7-41f3-87c5-857acf2f8f87 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] 10.222.0.78 "GET /compute/v2.1/servers/82b1aa2d-c36c-4734-b664-0958e6f4d33e" status: 200 len: 1303 microversion: 2.1 time: 0.165892 Feb 17 04:31:55.020580 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 292/579] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:31:54 2021] GET /compute/v2.1/servers/82b1aa2d-c36c-4734-b664-0958e6f4d33e => generated 1303 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:31:55.481796 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-6106a499-ad41-4dd6-8d30-03f2c55c72af tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "POST /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529/action" status: 200 len: 28650 microversion: 2.1 time: 1.859232 Feb 17 04:31:55.482667 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 288/580] 10.222.0.78 () {60 vars in 1268 bytes} [Wed Feb 17 04:31:53 2021] POST /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529/action => generated 28650 bytes in 1861 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 04:31:56.038071 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-ec68a594-e604-46ee-b11e-451c43f121ba tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:31:56.038682 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-ec68a594-e604-46ee-b11e-451c43f121ba tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] [instance: 82b1aa2d-c36c-4734-b664-0958e6f4d33e] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:31:56.048209 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-ec68a594-e604-46ee-b11e-451c43f121ba tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:31:56.048720 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-ec68a594-e604-46ee-b11e-451c43f121ba tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:31:56.049591 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-ec68a594-e604-46ee-b11e-451c43f121ba tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:31:56.050089 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-ec68a594-e604-46ee-b11e-451c43f121ba tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:31:56.125994 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-ec68a594-e604-46ee-b11e-451c43f121ba tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:31:56.126510 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-ec68a594-e604-46ee-b11e-451c43f121ba tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:31:56.127075 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.objects.instance [None req-ec68a594-e604-46ee-b11e-451c43f121ba tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lazy-loading 'fault' on Instance uuid 82b1aa2d-c36c-4734-b664-0958e6f4d33e {{(pid=98179) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Feb 17 04:31:56.194409 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-ec68a594-e604-46ee-b11e-451c43f121ba tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88eaaf0dd96340229d9f519b3489cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0608d586fdf4ba4b2b7f7137d49389a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:31:56.203566 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-ec68a594-e604-46ee-b11e-451c43f121ba tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] 10.222.0.78 "GET /compute/v2.1/servers/82b1aa2d-c36c-4734-b664-0958e6f4d33e" status: 200 len: 1303 microversion: 2.1 time: 0.169493 Feb 17 04:31:56.204166 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 293/581] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:31:56 2021] GET /compute/v2.1/servers/82b1aa2d-c36c-4734-b664-0958e6f4d33e => generated 1303 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:31:56.494966 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-8416d3e6-1bc5-44c4-b0be-766e2a8d4fdd tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:31:56.496138 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-8416d3e6-1bc5-44c4-b0be-766e2a8d4fdd tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: 29d1ce27-f63b-4523-88be-55f65a6a2529] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:31:56.504631 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-8416d3e6-1bc5-44c4-b0be-766e2a8d4fdd tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:31:56.505141 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-8416d3e6-1bc5-44c4-b0be-766e2a8d4fdd tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:31:56.505982 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-8416d3e6-1bc5-44c4-b0be-766e2a8d4fdd tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:31:56.506476 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-8416d3e6-1bc5-44c4-b0be-766e2a8d4fdd tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:31:56.681746 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 17 04:31:56.681937 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: Wed Feb 17 04:31:56 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529/action (ip 10.222.0.78) !!! Feb 17 04:31:57.221986 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-98ee41fe-cee5-476c-8f1b-1988760d1926 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:31:57.222668 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-98ee41fe-cee5-476c-8f1b-1988760d1926 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] [instance: 82b1aa2d-c36c-4734-b664-0958e6f4d33e] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:31:57.231992 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-98ee41fe-cee5-476c-8f1b-1988760d1926 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:31:57.232502 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-98ee41fe-cee5-476c-8f1b-1988760d1926 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:31:57.233604 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-98ee41fe-cee5-476c-8f1b-1988760d1926 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:31:57.234093 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-98ee41fe-cee5-476c-8f1b-1988760d1926 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:31:57.308823 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-98ee41fe-cee5-476c-8f1b-1988760d1926 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:31:57.309334 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-98ee41fe-cee5-476c-8f1b-1988760d1926 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:31:57.309843 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.objects.instance [None req-98ee41fe-cee5-476c-8f1b-1988760d1926 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lazy-loading 'fault' on Instance uuid 82b1aa2d-c36c-4734-b664-0958e6f4d33e {{(pid=98179) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Feb 17 04:31:57.377727 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-98ee41fe-cee5-476c-8f1b-1988760d1926 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88eaaf0dd96340229d9f519b3489cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0608d586fdf4ba4b2b7f7137d49389a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:31:57.387148 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-98ee41fe-cee5-476c-8f1b-1988760d1926 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] 10.222.0.78 "GET /compute/v2.1/servers/82b1aa2d-c36c-4734-b664-0958e6f4d33e" status: 200 len: 1303 microversion: 2.1 time: 0.169290 Feb 17 04:31:57.387733 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 294/582] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:31:57 2021] GET /compute/v2.1/servers/82b1aa2d-c36c-4734-b664-0958e6f4d33e => generated 1303 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:31:58.405264 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-12320022-f9eb-4041-a22a-b89b6fd7d826 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:31:58.405936 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-12320022-f9eb-4041-a22a-b89b6fd7d826 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] [instance: 82b1aa2d-c36c-4734-b664-0958e6f4d33e] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:31:58.413894 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-12320022-f9eb-4041-a22a-b89b6fd7d826 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:31:58.414481 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-12320022-f9eb-4041-a22a-b89b6fd7d826 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:31:58.415549 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-12320022-f9eb-4041-a22a-b89b6fd7d826 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:31:58.416088 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-12320022-f9eb-4041-a22a-b89b6fd7d826 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:31:58.509443 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-12320022-f9eb-4041-a22a-b89b6fd7d826 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:31:58.510182 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-12320022-f9eb-4041-a22a-b89b6fd7d826 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:31:58.510549 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.objects.instance [None req-12320022-f9eb-4041-a22a-b89b6fd7d826 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lazy-loading 'fault' on Instance uuid 82b1aa2d-c36c-4734-b664-0958e6f4d33e {{(pid=98179) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Feb 17 04:31:58.577154 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-8416d3e6-1bc5-44c4-b0be-766e2a8d4fdd tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "POST /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529/action" status: 200 len: 28650 microversion: 2.1 time: 2.086540 Feb 17 04:31:58.579134 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 289/583] 10.222.0.78 () {60 vars in 1268 bytes} [Wed Feb 17 04:31:56 2021] POST /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529/action => generated 28650 bytes in 2090 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 04:31:58.581437 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-12320022-f9eb-4041-a22a-b89b6fd7d826 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88eaaf0dd96340229d9f519b3489cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0608d586fdf4ba4b2b7f7137d49389a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:31:58.591139 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-12320022-f9eb-4041-a22a-b89b6fd7d826 tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] 10.222.0.78 "GET /compute/v2.1/servers/82b1aa2d-c36c-4734-b664-0958e6f4d33e" status: 200 len: 1303 microversion: 2.1 time: 0.189885 Feb 17 04:31:58.591790 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 295/584] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:31:58 2021] GET /compute/v2.1/servers/82b1aa2d-c36c-4734-b664-0958e6f4d33e => generated 1303 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:31:59.591991 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-6f786c37-871d-4c52-83e5-223cb491ece6 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:31:59.594576 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-6f786c37-871d-4c52-83e5-223cb491ece6 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: 29d1ce27-f63b-4523-88be-55f65a6a2529] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:31:59.604258 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-6f786c37-871d-4c52-83e5-223cb491ece6 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:31:59.605603 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-6f786c37-871d-4c52-83e5-223cb491ece6 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:31:59.606989 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-6f786c37-871d-4c52-83e5-223cb491ece6 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:31:59.607731 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-6f786c37-871d-4c52-83e5-223cb491ece6 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:31:59.609224 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-319d66ec-1d45-4345-9364-6399d8047cab tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:31:59.609905 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-319d66ec-1d45-4345-9364-6399d8047cab tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] [instance: 82b1aa2d-c36c-4734-b664-0958e6f4d33e] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:31:59.621119 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-319d66ec-1d45-4345-9364-6399d8047cab tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:31:59.621632 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-319d66ec-1d45-4345-9364-6399d8047cab tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:31:59.623862 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-319d66ec-1d45-4345-9364-6399d8047cab tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:31:59.624493 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-319d66ec-1d45-4345-9364-6399d8047cab tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:31:59.702795 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.wsgi [None req-319d66ec-1d45-4345-9364-6399d8047cab tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] HTTP exception thrown: Instance 82b1aa2d-c36c-4734-b664-0958e6f4d33e could not be found. Feb 17 04:31:59.703542 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-319d66ec-1d45-4345-9364-6399d8047cab tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] Returning 404 to user: Instance 82b1aa2d-c36c-4734-b664-0958e6f4d33e could not be found. {{(pid=98179) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 17 04:31:59.704450 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-319d66ec-1d45-4345-9364-6399d8047cab tempest-VolumesActionsTest-711345757 tempest-VolumesActionsTest-711345757-project] 10.222.0.78 "GET /compute/v2.1/servers/82b1aa2d-c36c-4734-b664-0958e6f4d33e" status: 404 len: 111 microversion: 2.1 time: 0.099301 Feb 17 04:31:59.705063 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 296/585] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:31:59 2021] GET /compute/v2.1/servers/82b1aa2d-c36c-4734-b664-0958e6f4d33e => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Feb 17 04:31:59.807645 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-6f786c37-871d-4c52-83e5-223cb491ece6 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "POST /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529/action" status: 200 len: 28650 microversion: 2.1 time: 0.220505 Feb 17 04:31:59.808356 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 290/586] 10.222.0.78 () {60 vars in 1268 bytes} [Wed Feb 17 04:31:59 2021] POST /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529/action => generated 28650 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 04:32:00.821370 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-a30e432a-ef60-46f8-acfe-3d565c5f11b1 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:32:00.822486 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-a30e432a-ef60-46f8-acfe-3d565c5f11b1 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: 29d1ce27-f63b-4523-88be-55f65a6a2529] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:32:00.831363 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-a30e432a-ef60-46f8-acfe-3d565c5f11b1 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:32:00.831880 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-a30e432a-ef60-46f8-acfe-3d565c5f11b1 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:32:00.832736 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-a30e432a-ef60-46f8-acfe-3d565c5f11b1 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:32:00.833238 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-a30e432a-ef60-46f8-acfe-3d565c5f11b1 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:32:01.213392 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-b89ea1a6-7246-4ede-87cf-276de64bc409 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5f985a25-e960-42e3-85e9-ba79f4254b21"}} {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:32:01.214684 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-b89ea1a6-7246-4ede-87cf-276de64bc409 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] [instance: ad42ab86-4168-46d3-9394-9fb44fc79d18] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:32:01.223301 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-b89ea1a6-7246-4ede-87cf-276de64bc409 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:32:01.223824 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-b89ea1a6-7246-4ede-87cf-276de64bc409 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:32:01.224687 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-b89ea1a6-7246-4ede-87cf-276de64bc409 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:32:01.225166 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-b89ea1a6-7246-4ede-87cf-276de64bc409 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:32:01.702263 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.wsgi [None req-b89ea1a6-7246-4ede-87cf-276de64bc409 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] HTTP exception thrown: Invalid volume: volume 5f985a25-e960-42e3-85e9-ba79f4254b21 is already attached to instances: ad42ab86-4168-46d3-9394-9fb44fc79d18 Feb 17 04:32:01.702728 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-b89ea1a6-7246-4ede-87cf-276de64bc409 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Returning 400 to user: Invalid volume: volume 5f985a25-e960-42e3-85e9-ba79f4254b21 is already attached to instances: ad42ab86-4168-46d3-9394-9fb44fc79d18 {{(pid=98178) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 17 04:32:01.704041 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-b89ea1a6-7246-4ede-87cf-276de64bc409 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] 10.222.0.78 "POST /compute/v2.1/servers/ad42ab86-4168-46d3-9394-9fb44fc79d18/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.495827 Feb 17 04:32:01.704865 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 291/587] 10.222.0.78 () {60 vars in 1313 bytes} [Wed Feb 17 04:32:01 2021] POST /compute/v2.1/servers/ad42ab86-4168-46d3-9394-9fb44fc79d18/os-volume_attachments => generated 174 bytes in 497 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Feb 17 04:32:01.944488 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-a89bb1bd-77a7-443e-b7d7-065b1f506c04 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:32:01.945659 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-a89bb1bd-77a7-443e-b7d7-065b1f506c04 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] [instance: ad42ab86-4168-46d3-9394-9fb44fc79d18] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:32:01.953727 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-a89bb1bd-77a7-443e-b7d7-065b1f506c04 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:32:01.954242 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-a89bb1bd-77a7-443e-b7d7-065b1f506c04 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:32:01.955163 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-a89bb1bd-77a7-443e-b7d7-065b1f506c04 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:32:01.955668 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-a89bb1bd-77a7-443e-b7d7-065b1f506c04 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:32:02.141442 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.objects.instance [None req-a89bb1bd-77a7-443e-b7d7-065b1f506c04 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lazy-loading 'services' on Instance uuid ad42ab86-4168-46d3-9394-9fb44fc79d18 {{(pid=98178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Feb 17 04:32:02.334945 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-a89bb1bd-77a7-443e-b7d7-065b1f506c04 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] 10.222.0.78 "DELETE /compute/v2.1/servers/ad42ab86-4168-46d3-9394-9fb44fc79d18/os-volume_attachments/5f985a25-e960-42e3-85e9-ba79f4254b21" status: 202 len: 0 microversion: 2.1 time: 0.394372 Feb 17 04:32:02.335909 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 292/588] 10.222.0.78 () {58 vars in 1406 bytes} [Wed Feb 17 04:32:01 2021] DELETE /compute/v2.1/servers/ad42ab86-4168-46d3-9394-9fb44fc79d18/os-volume_attachments/5f985a25-e960-42e3-85e9-ba79f4254b21 => generated 0 bytes in 396 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Feb 17 04:32:03.687462 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-a30e432a-ef60-46f8-acfe-3d565c5f11b1 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "POST /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529/action" status: 200 len: 28650 microversion: 2.1 time: 2.870695 Feb 17 04:32:03.688160 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 297/589] 10.222.0.78 () {60 vars in 1268 bytes} [Wed Feb 17 04:32:00 2021] POST /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529/action => generated 28650 bytes in 2873 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 04:32:04.701112 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-90373d48-1994-4cc9-af64-8d7c66fae61d tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:32:04.702324 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-90373d48-1994-4cc9-af64-8d7c66fae61d tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: 29d1ce27-f63b-4523-88be-55f65a6a2529] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:32:04.710766 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-90373d48-1994-4cc9-af64-8d7c66fae61d tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:32:04.711440 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-90373d48-1994-4cc9-af64-8d7c66fae61d tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:32:04.712299 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-90373d48-1994-4cc9-af64-8d7c66fae61d tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:32:04.712801 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-90373d48-1994-4cc9-af64-8d7c66fae61d tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:32:05.286441 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-90373d48-1994-4cc9-af64-8d7c66fae61d tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "POST /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529/action" status: 200 len: 28650 microversion: 2.1 time: 0.589979 Feb 17 04:32:05.287366 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 293/590] 10.222.0.78 () {60 vars in 1268 bytes} [Wed Feb 17 04:32:04 2021] POST /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529/action => generated 28650 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 04:32:06.300394 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-df19dacd-c9c0-44f0-b4d9-4da275e750a3 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:32:06.301524 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-df19dacd-c9c0-44f0-b4d9-4da275e750a3 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: 29d1ce27-f63b-4523-88be-55f65a6a2529] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:32:06.310689 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-df19dacd-c9c0-44f0-b4d9-4da275e750a3 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:32:06.311224 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-df19dacd-c9c0-44f0-b4d9-4da275e750a3 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:32:06.312056 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-df19dacd-c9c0-44f0-b4d9-4da275e750a3 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:32:06.312541 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-df19dacd-c9c0-44f0-b4d9-4da275e750a3 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:32:06.464920 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-df19dacd-c9c0-44f0-b4d9-4da275e750a3 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "POST /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529/action" status: 200 len: 28650 microversion: 2.1 time: 0.168885 Feb 17 04:32:06.465846 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 298/591] 10.222.0.78 () {60 vars in 1268 bytes} [Wed Feb 17 04:32:06 2021] POST /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529/action => generated 28650 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 04:32:07.478609 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-97069743-a54c-4f91-b28f-9647d96fa59e tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:32:07.479790 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-97069743-a54c-4f91-b28f-9647d96fa59e tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: 29d1ce27-f63b-4523-88be-55f65a6a2529] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:32:07.488405 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-97069743-a54c-4f91-b28f-9647d96fa59e tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:32:07.488925 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-97069743-a54c-4f91-b28f-9647d96fa59e tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:32:07.489782 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-97069743-a54c-4f91-b28f-9647d96fa59e tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:32:07.490283 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-97069743-a54c-4f91-b28f-9647d96fa59e tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:32:10.737073 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-97069743-a54c-4f91-b28f-9647d96fa59e tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "POST /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529/action" status: 200 len: 28650 microversion: 2.1 time: 3.263106 Feb 17 04:32:10.741335 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 294/592] 10.222.0.78 () {60 vars in 1268 bytes} [Wed Feb 17 04:32:07 2021] POST /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529/action => generated 28650 bytes in 3265 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 04:32:11.749440 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-2e35babb-5b07-4e98-9b63-b53d0a9e33b5 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:32:11.750755 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-2e35babb-5b07-4e98-9b63-b53d0a9e33b5 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: 29d1ce27-f63b-4523-88be-55f65a6a2529] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:32:11.759637 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-2e35babb-5b07-4e98-9b63-b53d0a9e33b5 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:32:11.760193 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-2e35babb-5b07-4e98-9b63-b53d0a9e33b5 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:32:11.761132 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-2e35babb-5b07-4e98-9b63-b53d0a9e33b5 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:32:11.761631 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-2e35babb-5b07-4e98-9b63-b53d0a9e33b5 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:32:11.920532 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-2e35babb-5b07-4e98-9b63-b53d0a9e33b5 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "POST /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529/action" status: 200 len: 28650 microversion: 2.1 time: 0.175385 Feb 17 04:32:11.921280 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 299/593] 10.222.0.78 () {60 vars in 1268 bytes} [Wed Feb 17 04:32:11 2021] POST /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529/action => generated 28650 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 17 04:32:12.934568 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-df189277-5e18-4034-a6a5-698c16018d38 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:32:12.935894 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-df189277-5e18-4034-a6a5-698c16018d38 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: 29d1ce27-f63b-4523-88be-55f65a6a2529] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:32:12.944688 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-df189277-5e18-4034-a6a5-698c16018d38 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:32:12.945199 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-df189277-5e18-4034-a6a5-698c16018d38 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:32:12.946046 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-df189277-5e18-4034-a6a5-698c16018d38 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:32:12.946541 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-df189277-5e18-4034-a6a5-698c16018d38 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:32:13.100509 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-df189277-5e18-4034-a6a5-698c16018d38 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "POST /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529/action" status: 200 len: 28650 microversion: 2.1 time: 0.171181 Feb 17 04:32:13.105068 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 295/594] 10.222.0.78 () {60 vars in 1268 bytes} [Wed Feb 17 04:32:12 2021] POST /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529/action => generated 28650 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 04:32:14.114117 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-a31de141-6a56-425f-82d5-a02cb1505069 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:32:14.115292 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-a31de141-6a56-425f-82d5-a02cb1505069 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: 29d1ce27-f63b-4523-88be-55f65a6a2529] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:32:14.124307 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-a31de141-6a56-425f-82d5-a02cb1505069 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:32:14.124813 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-a31de141-6a56-425f-82d5-a02cb1505069 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:32:14.125655 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-a31de141-6a56-425f-82d5-a02cb1505069 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:32:14.126147 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-a31de141-6a56-425f-82d5-a02cb1505069 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:32:14.276270 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-a31de141-6a56-425f-82d5-a02cb1505069 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "POST /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529/action" status: 200 len: 28650 microversion: 2.1 time: 0.166012 Feb 17 04:32:14.276980 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 300/595] 10.222.0.78 () {60 vars in 1268 bytes} [Wed Feb 17 04:32:14 2021] POST /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529/action => generated 28650 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 04:32:15.290112 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-c8076e98-f3d8-4787-bacb-8d39ba319c54 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:32:15.292797 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-c8076e98-f3d8-4787-bacb-8d39ba319c54 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: 29d1ce27-f63b-4523-88be-55f65a6a2529] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:32:15.302093 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-c8076e98-f3d8-4787-bacb-8d39ba319c54 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:32:15.302933 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-c8076e98-f3d8-4787-bacb-8d39ba319c54 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:32:15.304152 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-c8076e98-f3d8-4787-bacb-8d39ba319c54 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:32:15.304930 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-c8076e98-f3d8-4787-bacb-8d39ba319c54 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:32:15.474915 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-c8076e98-f3d8-4787-bacb-8d39ba319c54 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "POST /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529/action" status: 200 len: 28650 microversion: 2.1 time: 0.189354 Feb 17 04:32:15.479623 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 296/596] 10.222.0.78 () {60 vars in 1268 bytes} [Wed Feb 17 04:32:15 2021] POST /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529/action => generated 28650 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 04:32:16.488571 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-6a6bb613-59d8-41cb-af61-86d084a397c6 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:32:16.489842 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-6a6bb613-59d8-41cb-af61-86d084a397c6 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: 29d1ce27-f63b-4523-88be-55f65a6a2529] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:32:16.498655 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-6a6bb613-59d8-41cb-af61-86d084a397c6 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:32:16.499228 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-6a6bb613-59d8-41cb-af61-86d084a397c6 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:32:16.500104 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-6a6bb613-59d8-41cb-af61-86d084a397c6 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:32:16.500592 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-6a6bb613-59d8-41cb-af61-86d084a397c6 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:32:16.670949 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-6a6bb613-59d8-41cb-af61-86d084a397c6 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "POST /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529/action" status: 200 len: 28650 microversion: 2.1 time: 0.186810 Feb 17 04:32:16.671990 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 301/597] 10.222.0.78 () {60 vars in 1268 bytes} [Wed Feb 17 04:32:16 2021] POST /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529/action => generated 28650 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 04:32:16.893484 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-1f1b349f-93a7-4f1d-8f84-b6a92dbf6517 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:32:16.894406 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-1f1b349f-93a7-4f1d-8f84-b6a92dbf6517 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] [instance: 8b4ba536-4de5-4f0e-9cb0-cc08d8616e5d] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:32:16.909320 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-1f1b349f-93a7-4f1d-8f84-b6a92dbf6517 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:32:16.910217 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-1f1b349f-93a7-4f1d-8f84-b6a92dbf6517 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:32:16.911371 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-1f1b349f-93a7-4f1d-8f84-b6a92dbf6517 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:32:16.912129 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-1f1b349f-93a7-4f1d-8f84-b6a92dbf6517 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:32:17.132743 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.objects.instance [None req-1f1b349f-93a7-4f1d-8f84-b6a92dbf6517 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Lazy-loading 'services' on Instance uuid 8b4ba536-4de5-4f0e-9cb0-cc08d8616e5d {{(pid=98178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Feb 17 04:32:17.366068 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-1f1b349f-93a7-4f1d-8f84-b6a92dbf6517 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] 10.222.0.78 "DELETE /compute/v2.1/servers/8b4ba536-4de5-4f0e-9cb0-cc08d8616e5d/os-volume_attachments/a8a1b9ed-1b35-494e-89df-c0caec66e311" status: 202 len: 0 microversion: 2.1 time: 0.477890 Feb 17 04:32:17.367218 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 297/598] 10.222.0.78 () {58 vars in 1406 bytes} [Wed Feb 17 04:32:16 2021] DELETE /compute/v2.1/servers/8b4ba536-4de5-4f0e-9cb0-cc08d8616e5d/os-volume_attachments/a8a1b9ed-1b35-494e-89df-c0caec66e311 => generated 0 bytes in 481 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:32:17.685965 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-2d376020-45e4-46a9-baab-09f18a1965ab tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:32:17.687283 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-2d376020-45e4-46a9-baab-09f18a1965ab tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: 29d1ce27-f63b-4523-88be-55f65a6a2529] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:32:17.708427 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-2d376020-45e4-46a9-baab-09f18a1965ab tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:32:17.708947 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-2d376020-45e4-46a9-baab-09f18a1965ab tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:32:17.709825 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-2d376020-45e4-46a9-baab-09f18a1965ab tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:32:17.710329 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-2d376020-45e4-46a9-baab-09f18a1965ab tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:32:17.925204 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-2d376020-45e4-46a9-baab-09f18a1965ab tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "POST /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529/action" status: 200 len: 28650 microversion: 2.1 time: 0.244862 Feb 17 04:32:17.926648 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 302/599] 10.222.0.78 () {60 vars in 1268 bytes} [Wed Feb 17 04:32:17 2021] POST /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529/action => generated 28650 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 04:32:18.939280 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-03ae0685-32f1-4b49-bf55-8ce1ab7348b8 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:32:18.941059 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-03ae0685-32f1-4b49-bf55-8ce1ab7348b8 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: 29d1ce27-f63b-4523-88be-55f65a6a2529] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:32:18.951637 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-03ae0685-32f1-4b49-bf55-8ce1ab7348b8 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:32:18.951924 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-03ae0685-32f1-4b49-bf55-8ce1ab7348b8 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:32:18.952990 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-03ae0685-32f1-4b49-bf55-8ce1ab7348b8 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:32:18.953667 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-03ae0685-32f1-4b49-bf55-8ce1ab7348b8 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:32:19.103853 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-03ae0685-32f1-4b49-bf55-8ce1ab7348b8 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "POST /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529/action" status: 200 len: 28650 microversion: 2.1 time: 0.169652 Feb 17 04:32:19.105268 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 298/600] 10.222.0.78 () {60 vars in 1268 bytes} [Wed Feb 17 04:32:18 2021] POST /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529/action => generated 28650 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 04:32:20.118182 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-9a7ef926-dbd6-4c7c-9002-01e2238248ea tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:32:20.119319 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-9a7ef926-dbd6-4c7c-9002-01e2238248ea tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: 29d1ce27-f63b-4523-88be-55f65a6a2529] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:32:20.128565 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-9a7ef926-dbd6-4c7c-9002-01e2238248ea tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:32:20.129075 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-9a7ef926-dbd6-4c7c-9002-01e2238248ea tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:32:20.129922 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-9a7ef926-dbd6-4c7c-9002-01e2238248ea tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:32:20.130410 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-9a7ef926-dbd6-4c7c-9002-01e2238248ea tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:32:20.293921 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-9a7ef926-dbd6-4c7c-9002-01e2238248ea tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "POST /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529/action" status: 200 len: 28650 microversion: 2.1 time: 0.179434 Feb 17 04:32:20.295198 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 303/601] 10.222.0.78 () {60 vars in 1268 bytes} [Wed Feb 17 04:32:20 2021] POST /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529/action => generated 28650 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 04:32:21.315412 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-0ac28e34-b55e-495b-8104-ee7ffaff918e tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:32:21.315412 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-0ac28e34-b55e-495b-8104-ee7ffaff918e tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: 29d1ce27-f63b-4523-88be-55f65a6a2529] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:32:21.333337 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-0ac28e34-b55e-495b-8104-ee7ffaff918e tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:32:21.334058 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-0ac28e34-b55e-495b-8104-ee7ffaff918e tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:32:21.335129 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-0ac28e34-b55e-495b-8104-ee7ffaff918e tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:32:21.335988 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-0ac28e34-b55e-495b-8104-ee7ffaff918e tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:32:21.520389 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-0ac28e34-b55e-495b-8104-ee7ffaff918e tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "POST /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529/action" status: 200 len: 28650 microversion: 2.1 time: 0.217342 Feb 17 04:32:21.521223 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 299/602] 10.222.0.78 () {60 vars in 1268 bytes} [Wed Feb 17 04:32:21 2021] POST /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529/action => generated 28650 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 04:32:22.469144 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-5bd05349-7309-47ce-af77-1179fda5e270 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:32:22.470537 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-5bd05349-7309-47ce-af77-1179fda5e270 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] [instance: 20760e77-fe67-4ebe-87f1-34d840495341] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:32:22.490716 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-5bd05349-7309-47ce-af77-1179fda5e270 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:32:22.491269 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-5bd05349-7309-47ce-af77-1179fda5e270 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:32:22.494902 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-5bd05349-7309-47ce-af77-1179fda5e270 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:32:22.495473 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-5bd05349-7309-47ce-af77-1179fda5e270 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:32:22.535627 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-21a90710-718f-40e9-87e6-234a3b5250e1 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:32:22.538142 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-21a90710-718f-40e9-87e6-234a3b5250e1 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: 29d1ce27-f63b-4523-88be-55f65a6a2529] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:32:22.555745 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-21a90710-718f-40e9-87e6-234a3b5250e1 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:32:22.559667 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-21a90710-718f-40e9-87e6-234a3b5250e1 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:32:22.561716 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-21a90710-718f-40e9-87e6-234a3b5250e1 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:32:22.563604 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-21a90710-718f-40e9-87e6-234a3b5250e1 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:32:22.645608 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.objects.instance [None req-5bd05349-7309-47ce-af77-1179fda5e270 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lazy-loading 'flavor' on Instance uuid 20760e77-fe67-4ebe-87f1-34d840495341 {{(pid=98179) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Feb 17 04:32:22.817795 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-21a90710-718f-40e9-87e6-234a3b5250e1 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "POST /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529/action" status: 200 len: 28650 microversion: 2.1 time: 0.287674 Feb 17 04:32:22.819215 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 300/603] 10.222.0.78 () {60 vars in 1268 bytes} [Wed Feb 17 04:32:22 2021] POST /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529/action => generated 28650 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 04:32:23.122572 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-5bd05349-7309-47ce-af77-1179fda5e270 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] 10.222.0.78 "POST /compute/v2.1/servers/20760e77-fe67-4ebe-87f1-34d840495341/action" status: 200 len: 32 microversion: 2.1 time: 0.660159 Feb 17 04:32:23.128439 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 304/604] 10.222.0.78 () {60 vars in 1268 bytes} [Wed Feb 17 04:32:22 2021] POST /compute/v2.1/servers/20760e77-fe67-4ebe-87f1-34d840495341/action => generated 32 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 17 04:32:23.137918 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-cd86f01b-d2c3-4458-af74-eff6af71b22e tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:32:23.139820 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-cd86f01b-d2c3-4458-af74-eff6af71b22e tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] [instance: 20760e77-fe67-4ebe-87f1-34d840495341] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:32:23.165332 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-cd86f01b-d2c3-4458-af74-eff6af71b22e tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:32:23.166866 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-cd86f01b-d2c3-4458-af74-eff6af71b22e tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:32:23.169786 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-cd86f01b-d2c3-4458-af74-eff6af71b22e tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:32:23.170364 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-cd86f01b-d2c3-4458-af74-eff6af71b22e tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:32:23.701497 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-cd86f01b-d2c3-4458-af74-eff6af71b22e tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1daf9a83b1d24033a3d4c0f531a4eb2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5336afdcf4aa4b46b0655432b7a1323c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:32:23.713305 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-cd86f01b-d2c3-4458-af74-eff6af71b22e tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] 10.222.0.78 "GET /compute/v2.1/servers/20760e77-fe67-4ebe-87f1-34d840495341" status: 200 len: 1567 microversion: 2.1 time: 0.581707 Feb 17 04:32:23.714612 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 301/605] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:32:23 2021] GET /compute/v2.1/servers/20760e77-fe67-4ebe-87f1-34d840495341 => generated 1567 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:32:23.831006 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-2bdc8cb9-afc5-483a-ae0b-0a907a959f4b tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:32:23.832602 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-2bdc8cb9-afc5-483a-ae0b-0a907a959f4b tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: 29d1ce27-f63b-4523-88be-55f65a6a2529] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:32:23.842332 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-2bdc8cb9-afc5-483a-ae0b-0a907a959f4b tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:32:23.843171 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-2bdc8cb9-afc5-483a-ae0b-0a907a959f4b tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:32:23.844483 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-2bdc8cb9-afc5-483a-ae0b-0a907a959f4b tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:32:23.844977 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-2bdc8cb9-afc5-483a-ae0b-0a907a959f4b tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:32:23.979399 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-2bdc8cb9-afc5-483a-ae0b-0a907a959f4b tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "POST /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529/action" status: 200 len: 28650 microversion: 2.1 time: 0.152585 Feb 17 04:32:23.980144 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 305/606] 10.222.0.78 () {60 vars in 1268 bytes} [Wed Feb 17 04:32:23 2021] POST /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529/action => generated 28650 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 04:32:24.666586 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-b6cb5507-b22e-4368-9eed-2a889b142fb0 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-639193637", "imageRef": "b005ed36-a85a-4c46-ba22-9fa8c5ec62e5", "flavorRef": "452", "networks": [{"uuid": "96c670ae-41b0-4a7d-b9a0-1a1a0b99417f"}]}} {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:32:24.734533 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-73cca689-21b2-4dc5-be3b-336ad3f3b3d8 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:32:24.735909 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-73cca689-21b2-4dc5-be3b-336ad3f3b3d8 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] [instance: 20760e77-fe67-4ebe-87f1-34d840495341] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:32:24.763575 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-73cca689-21b2-4dc5-be3b-336ad3f3b3d8 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:32:24.764451 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-73cca689-21b2-4dc5-be3b-336ad3f3b3d8 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:32:24.765769 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-73cca689-21b2-4dc5-be3b-336ad3f3b3d8 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:32:24.766425 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-73cca689-21b2-4dc5-be3b-336ad3f3b3d8 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:32:24.868031 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.network.neutron [None req-b6cb5507-b22e-4368-9eed-2a889b142fb0 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] validate_networks() for [('96c670ae-41b0-4a7d-b9a0-1a1a0b99417f', None, None, None)] {{(pid=98178) validate_networks /opt/stack/nova/nova/network/neutron.py:2345}} Feb 17 04:32:25.266595 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-73cca689-21b2-4dc5-be3b-336ad3f3b3d8 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1daf9a83b1d24033a3d4c0f531a4eb2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5336afdcf4aa4b46b0655432b7a1323c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:32:25.278839 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-73cca689-21b2-4dc5-be3b-336ad3f3b3d8 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] 10.222.0.78 "GET /compute/v2.1/servers/20760e77-fe67-4ebe-87f1-34d840495341" status: 200 len: 1567 microversion: 2.1 time: 0.549528 Feb 17 04:32:25.280088 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 306/607] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:32:24 2021] GET /compute/v2.1/servers/20760e77-fe67-4ebe-87f1-34d840495341 => generated 1567 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:32:25.285688 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-9cf11c3e-2a6e-4848-ba5b-0ed5749dd069 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:32:25.286993 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-9cf11c3e-2a6e-4848-ba5b-0ed5749dd069 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: 29d1ce27-f63b-4523-88be-55f65a6a2529] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:32:25.302050 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-9cf11c3e-2a6e-4848-ba5b-0ed5749dd069 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:32:25.307205 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-9cf11c3e-2a6e-4848-ba5b-0ed5749dd069 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:32:25.309956 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-9cf11c3e-2a6e-4848-ba5b-0ed5749dd069 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:32:25.312292 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-9cf11c3e-2a6e-4848-ba5b-0ed5749dd069 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:32:25.504264 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-9cf11c3e-2a6e-4848-ba5b-0ed5749dd069 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "POST /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529/action" status: 200 len: 28650 microversion: 2.1 time: 0.222027 Feb 17 04:32:25.505253 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 307/608] 10.222.0.78 () {60 vars in 1268 bytes} [Wed Feb 17 04:32:25 2021] POST /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529/action => generated 28650 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 04:32:25.667111 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.virt.hardware [None req-b6cb5507-b22e-4368-9eed-2a889b142fb0 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Flavor limits 0:0:0 {{(pid=98178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 17 04:32:25.667751 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.virt.hardware [None req-b6cb5507-b22e-4368-9eed-2a889b142fb0 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Image limits 0:0:0 {{(pid=98178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Feb 17 04:32:25.669306 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.virt.hardware [None req-b6cb5507-b22e-4368-9eed-2a889b142fb0 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Flavor pref 0:0:0 {{(pid=98178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 17 04:32:25.669881 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.virt.hardware [None req-b6cb5507-b22e-4368-9eed-2a889b142fb0 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Image pref 0:0:0 {{(pid=98178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Feb 17 04:32:25.670558 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.virt.hardware [None req-b6cb5507-b22e-4368-9eed-2a889b142fb0 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Feb 17 04:32:25.682485 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-b6cb5507-b22e-4368-9eed-2a889b142fb0 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:32:25.683083 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-b6cb5507-b22e-4368-9eed-2a889b142fb0 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:32:25.684648 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-b6cb5507-b22e-4368-9eed-2a889b142fb0 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:32:25.685200 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-b6cb5507-b22e-4368-9eed-2a889b142fb0 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:32:25.705854 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.quota [None req-b6cb5507-b22e-4368-9eed-2a889b142fb0 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Getting quotas for project 2f2a1ca6347d4278899a1cc009d87d33. Resources: {'ram', 'cores', 'instances'} {{(pid=98178) _get_quotas /opt/stack/nova/nova/quota.py:388}} Feb 17 04:32:25.710983 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.quota [None req-b6cb5507-b22e-4368-9eed-2a889b142fb0 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Getting quotas for user 6d68d4a6c12e4331b8df8191cdd7a669 and project 2f2a1ca6347d4278899a1cc009d87d33. Resources: {'ram', 'cores', 'instances'} {{(pid=98178) _get_quotas /opt/stack/nova/nova/quota.py:380}} Feb 17 04:32:25.725306 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-b6cb5507-b22e-4368-9eed-2a889b142fb0 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Going to run 1 instances... {{(pid=98178) _provision_instances /opt/stack/nova/nova/compute/api.py:1264}} Feb 17 04:32:25.728329 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-b6cb5507-b22e-4368-9eed-2a889b142fb0 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] [instance: 1ee42b60-a1c0-4b17-9aa4-01d216665df4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b005ed36-a85a-4c46-ba22-9fa8c5ec62e5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98178) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1666}} Feb 17 04:32:25.805555 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-b6cb5507-b22e-4368-9eed-2a889b142fb0 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.144545 Feb 17 04:32:25.810519 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 302/609] 10.222.0.78 () {60 vars in 1137 bytes} [Wed Feb 17 04:32:24 2021] POST /compute/v2.1/servers => generated 380 bytes in 1150 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 17 04:32:25.823724 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-fb43dadf-fb23-4287-b5fd-4e6c7029e2ef tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:32:25.825298 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-fb43dadf-fb23-4287-b5fd-4e6c7029e2ef tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] [instance: 1ee42b60-a1c0-4b17-9aa4-01d216665df4] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:32:25.911510 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-fb43dadf-fb23-4287-b5fd-4e6c7029e2ef tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d68d4a6c12e4331b8df8191cdd7a669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2a1ca6347d4278899a1cc009d87d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:32:25.920645 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-fb43dadf-fb23-4287-b5fd-4e6c7029e2ef tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] 10.222.0.78 "GET /compute/v2.1/servers/1ee42b60-a1c0-4b17-9aa4-01d216665df4" status: 200 len: 1217 microversion: 2.1 time: 0.101308 Feb 17 04:32:25.922658 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 308/610] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:32:25 2021] GET /compute/v2.1/servers/1ee42b60-a1c0-4b17-9aa4-01d216665df4 => generated 1217 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:32:26.301554 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-94fb3580-849e-4448-bbc4-6f1f504bc6dc tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:32:26.302210 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-94fb3580-849e-4448-bbc4-6f1f504bc6dc tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] [instance: 20760e77-fe67-4ebe-87f1-34d840495341] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:32:26.313862 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-94fb3580-849e-4448-bbc4-6f1f504bc6dc tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:32:26.317915 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-94fb3580-849e-4448-bbc4-6f1f504bc6dc tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:32:26.321375 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-94fb3580-849e-4448-bbc4-6f1f504bc6dc tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:32:26.322372 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-94fb3580-849e-4448-bbc4-6f1f504bc6dc tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:32:26.517345 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-abebef86-8da9-4858-97dd-c809f152c6f5 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:32:26.518665 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-abebef86-8da9-4858-97dd-c809f152c6f5 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: 29d1ce27-f63b-4523-88be-55f65a6a2529] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:32:26.542603 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-abebef86-8da9-4858-97dd-c809f152c6f5 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:32:26.544030 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-abebef86-8da9-4858-97dd-c809f152c6f5 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:32:26.554670 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-abebef86-8da9-4858-97dd-c809f152c6f5 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:32:26.555512 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-abebef86-8da9-4858-97dd-c809f152c6f5 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:32:26.840105 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-94fb3580-849e-4448-bbc4-6f1f504bc6dc tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1daf9a83b1d24033a3d4c0f531a4eb2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5336afdcf4aa4b46b0655432b7a1323c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:32:26.852505 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-94fb3580-849e-4448-bbc4-6f1f504bc6dc tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] 10.222.0.78 "GET /compute/v2.1/servers/20760e77-fe67-4ebe-87f1-34d840495341" status: 200 len: 1567 microversion: 2.1 time: 0.557503 Feb 17 04:32:26.853468 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 303/611] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:32:26 2021] GET /compute/v2.1/servers/20760e77-fe67-4ebe-87f1-34d840495341 => generated 1567 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:32:26.864004 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-abebef86-8da9-4858-97dd-c809f152c6f5 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "POST /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529/action" status: 200 len: 28650 microversion: 2.1 time: 0.350246 Feb 17 04:32:26.864696 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 309/612] 10.222.0.78 () {60 vars in 1268 bytes} [Wed Feb 17 04:32:26 2021] POST /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529/action => generated 28650 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 04:32:26.942951 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-7c0f5269-efb6-4293-8c01-080b652774e4 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:32:26.943661 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-7c0f5269-efb6-4293-8c01-080b652774e4 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] [instance: 1ee42b60-a1c0-4b17-9aa4-01d216665df4] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:32:26.960706 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-7c0f5269-efb6-4293-8c01-080b652774e4 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:32:26.963176 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-7c0f5269-efb6-4293-8c01-080b652774e4 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:32:26.964247 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-7c0f5269-efb6-4293-8c01-080b652774e4 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:32:26.966274 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-7c0f5269-efb6-4293-8c01-080b652774e4 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:32:27.241744 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-7c0f5269-efb6-4293-8c01-080b652774e4 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d68d4a6c12e4331b8df8191cdd7a669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2a1ca6347d4278899a1cc009d87d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:32:27.252499 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-7c0f5269-efb6-4293-8c01-080b652774e4 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] 10.222.0.78 "GET /compute/v2.1/servers/1ee42b60-a1c0-4b17-9aa4-01d216665df4" status: 200 len: 1213 microversion: 2.1 time: 0.313508 Feb 17 04:32:27.253103 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 304/613] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:32:26 2021] GET /compute/v2.1/servers/1ee42b60-a1c0-4b17-9aa4-01d216665df4 => generated 1213 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:32:27.318643 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-6024373e-1bd1-449d-9874-fa6d97c49756 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:32:27.319430 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-6024373e-1bd1-449d-9874-fa6d97c49756 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] [instance: 8b4ba536-4de5-4f0e-9cb0-cc08d8616e5d] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:32:27.328919 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-6024373e-1bd1-449d-9874-fa6d97c49756 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:32:27.329708 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-6024373e-1bd1-449d-9874-fa6d97c49756 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:32:27.330694 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-6024373e-1bd1-449d-9874-fa6d97c49756 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:32:27.331456 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-6024373e-1bd1-449d-9874-fa6d97c49756 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:32:27.403472 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-6024373e-1bd1-449d-9874-fa6d97c49756 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] [instance: 8b4ba536-4de5-4f0e-9cb0-cc08d8616e5d] Going to try to terminate instance {{(pid=98179) delete /opt/stack/nova/nova/compute/api.py:2540}} Feb 17 04:32:27.561201 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-6024373e-1bd1-449d-9874-fa6d97c49756 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] 10.222.0.78 "DELETE /compute/v2.1/servers/8b4ba536-4de5-4f0e-9cb0-cc08d8616e5d" status: 204 len: 0 microversion: 2.1 time: 0.246324 Feb 17 04:32:27.561991 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 310/614] 10.222.0.78 () {58 vars in 1229 bytes} [Wed Feb 17 04:32:27 2021] DELETE /compute/v2.1/servers/8b4ba536-4de5-4f0e-9cb0-cc08d8616e5d => generated 0 bytes in 249 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 17 04:32:27.578166 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-5aa46bc1-c99b-4e19-b579-06130ec8405f tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:32:27.578839 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-5aa46bc1-c99b-4e19-b579-06130ec8405f tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] [instance: 8b4ba536-4de5-4f0e-9cb0-cc08d8616e5d] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:32:27.587339 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-5aa46bc1-c99b-4e19-b579-06130ec8405f tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:32:27.587851 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-5aa46bc1-c99b-4e19-b579-06130ec8405f tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:32:27.588783 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-5aa46bc1-c99b-4e19-b579-06130ec8405f tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:32:27.589155 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-5aa46bc1-c99b-4e19-b579-06130ec8405f tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:32:27.875717 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-be9f5438-a3b9-431a-a39f-fb1f2b3eaa23 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:32:27.881913 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-be9f5438-a3b9-431a-a39f-fb1f2b3eaa23 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] [instance: 20760e77-fe67-4ebe-87f1-34d840495341] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:32:27.902692 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-be9f5438-a3b9-431a-a39f-fb1f2b3eaa23 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:32:27.903816 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-be9f5438-a3b9-431a-a39f-fb1f2b3eaa23 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:32:27.908763 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-be9f5438-a3b9-431a-a39f-fb1f2b3eaa23 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:32:27.909445 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-be9f5438-a3b9-431a-a39f-fb1f2b3eaa23 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:32:28.228732 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-be9f5438-a3b9-431a-a39f-fb1f2b3eaa23 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1daf9a83b1d24033a3d4c0f531a4eb2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5336afdcf4aa4b46b0655432b7a1323c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:32:28.240646 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-be9f5438-a3b9-431a-a39f-fb1f2b3eaa23 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] 10.222.0.78 "GET /compute/v2.1/servers/20760e77-fe67-4ebe-87f1-34d840495341" status: 200 len: 1567 microversion: 2.1 time: 0.372371 Feb 17 04:32:28.241219 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 311/615] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:32:27 2021] GET /compute/v2.1/servers/20760e77-fe67-4ebe-87f1-34d840495341 => generated 1567 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:32:28.246487 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-56b8ba7d-d88d-4d37-9b34-589fd49ca877 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:32:28.247635 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-56b8ba7d-d88d-4d37-9b34-589fd49ca877 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: 29d1ce27-f63b-4523-88be-55f65a6a2529] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:32:28.256279 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-56b8ba7d-d88d-4d37-9b34-589fd49ca877 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:32:28.256932 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-56b8ba7d-d88d-4d37-9b34-589fd49ca877 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:32:28.257780 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-56b8ba7d-d88d-4d37-9b34-589fd49ca877 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:32:28.258274 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-56b8ba7d-d88d-4d37-9b34-589fd49ca877 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:32:28.389944 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-5aa46bc1-c99b-4e19-b579-06130ec8405f tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b4f65f82a97499dbb900d523924e946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440d4048a9ad43869a00218c7acb9614', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:32:28.403807 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-5aa46bc1-c99b-4e19-b579-06130ec8405f tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] 10.222.0.78 "GET /compute/v2.1/servers/8b4ba536-4de5-4f0e-9cb0-cc08d8616e5d" status: 200 len: 1514 microversion: 2.1 time: 0.827557 Feb 17 04:32:28.404694 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 305/616] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:32:27 2021] GET /compute/v2.1/servers/8b4ba536-4de5-4f0e-9cb0-cc08d8616e5d => generated 1514 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:32:28.417189 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-67172df7-d868-4fe9-8f54-daf1d5b8fa28 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:32:28.419916 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-67172df7-d868-4fe9-8f54-daf1d5b8fa28 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] [instance: 1ee42b60-a1c0-4b17-9aa4-01d216665df4] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:32:28.443522 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-67172df7-d868-4fe9-8f54-daf1d5b8fa28 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:32:28.444239 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-67172df7-d868-4fe9-8f54-daf1d5b8fa28 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:32:28.445309 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-67172df7-d868-4fe9-8f54-daf1d5b8fa28 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:32:28.446008 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-67172df7-d868-4fe9-8f54-daf1d5b8fa28 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:32:28.531872 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-56b8ba7d-d88d-4d37-9b34-589fd49ca877 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "POST /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529/action" status: 200 len: 28650 microversion: 2.1 time: 0.289347 Feb 17 04:32:28.536001 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 312/617] 10.222.0.78 () {60 vars in 1268 bytes} [Wed Feb 17 04:32:28 2021] POST /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529/action => generated 28650 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 04:32:28.854198 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-67172df7-d868-4fe9-8f54-daf1d5b8fa28 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d68d4a6c12e4331b8df8191cdd7a669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2a1ca6347d4278899a1cc009d87d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:32:28.869460 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-67172df7-d868-4fe9-8f54-daf1d5b8fa28 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] 10.222.0.78 "GET /compute/v2.1/servers/1ee42b60-a1c0-4b17-9aa4-01d216665df4" status: 200 len: 1275 microversion: 2.1 time: 0.459446 Feb 17 04:32:28.880323 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 306/618] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:32:28 2021] GET /compute/v2.1/servers/1ee42b60-a1c0-4b17-9aa4-01d216665df4 => generated 1275 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:32:29.259239 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-ae4b5d07-59fc-4806-90a1-96fd0992a430 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:32:29.260187 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-ae4b5d07-59fc-4806-90a1-96fd0992a430 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] [instance: 20760e77-fe67-4ebe-87f1-34d840495341] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:32:29.270480 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-ae4b5d07-59fc-4806-90a1-96fd0992a430 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:32:29.270996 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-ae4b5d07-59fc-4806-90a1-96fd0992a430 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:32:29.272041 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-ae4b5d07-59fc-4806-90a1-96fd0992a430 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:32:29.272426 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-ae4b5d07-59fc-4806-90a1-96fd0992a430 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:32:29.424950 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-1b7a12a4-da01-4492-8d1b-5200eb94baa2 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:32:29.425635 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-1b7a12a4-da01-4492-8d1b-5200eb94baa2 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] [instance: 8b4ba536-4de5-4f0e-9cb0-cc08d8616e5d] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:32:29.433600 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-1b7a12a4-da01-4492-8d1b-5200eb94baa2 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:32:29.434335 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-1b7a12a4-da01-4492-8d1b-5200eb94baa2 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:32:29.435430 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-1b7a12a4-da01-4492-8d1b-5200eb94baa2 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:32:29.435941 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-1b7a12a4-da01-4492-8d1b-5200eb94baa2 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:32:29.564067 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-ae4b5d07-59fc-4806-90a1-96fd0992a430 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1daf9a83b1d24033a3d4c0f531a4eb2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5336afdcf4aa4b46b0655432b7a1323c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:32:29.585227 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-ae4b5d07-59fc-4806-90a1-96fd0992a430 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] 10.222.0.78 "GET /compute/v2.1/servers/20760e77-fe67-4ebe-87f1-34d840495341" status: 200 len: 1567 microversion: 2.1 time: 0.330807 Feb 17 04:32:29.586038 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 313/619] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:32:29 2021] GET /compute/v2.1/servers/20760e77-fe67-4ebe-87f1-34d840495341 => generated 1567 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:32:29.592758 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-06577d43-4431-4331-9c1f-a5434d40f2c4 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:32:29.593973 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-06577d43-4431-4331-9c1f-a5434d40f2c4 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: 29d1ce27-f63b-4523-88be-55f65a6a2529] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:32:29.603409 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-06577d43-4431-4331-9c1f-a5434d40f2c4 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:32:29.603962 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-06577d43-4431-4331-9c1f-a5434d40f2c4 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:32:29.604949 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-06577d43-4431-4331-9c1f-a5434d40f2c4 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:32:29.605574 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-06577d43-4431-4331-9c1f-a5434d40f2c4 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:32:29.761988 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-06577d43-4431-4331-9c1f-a5434d40f2c4 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "POST /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529/action" status: 200 len: 28650 microversion: 2.1 time: 0.174241 Feb 17 04:32:29.763691 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 314/620] 10.222.0.78 () {60 vars in 1268 bytes} [Wed Feb 17 04:32:29 2021] POST /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529/action => generated 28650 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 04:32:29.889972 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-50f9e2a5-9a49-4a81-b629-47d6ecf8e4de tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:32:29.890932 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-50f9e2a5-9a49-4a81-b629-47d6ecf8e4de tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] [instance: 1ee42b60-a1c0-4b17-9aa4-01d216665df4] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:32:29.906345 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-50f9e2a5-9a49-4a81-b629-47d6ecf8e4de tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:32:29.906345 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-50f9e2a5-9a49-4a81-b629-47d6ecf8e4de tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:32:29.906345 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-50f9e2a5-9a49-4a81-b629-47d6ecf8e4de tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:32:29.906345 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-50f9e2a5-9a49-4a81-b629-47d6ecf8e4de tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:32:29.920218 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-1b7a12a4-da01-4492-8d1b-5200eb94baa2 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b4f65f82a97499dbb900d523924e946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440d4048a9ad43869a00218c7acb9614', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:32:29.934180 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-1b7a12a4-da01-4492-8d1b-5200eb94baa2 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] 10.222.0.78 "GET /compute/v2.1/servers/8b4ba536-4de5-4f0e-9cb0-cc08d8616e5d" status: 200 len: 1514 microversion: 2.1 time: 0.512654 Feb 17 04:32:29.947649 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 307/621] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:32:29 2021] GET /compute/v2.1/servers/8b4ba536-4de5-4f0e-9cb0-cc08d8616e5d => generated 1514 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:32:30.157929 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-50f9e2a5-9a49-4a81-b629-47d6ecf8e4de tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d68d4a6c12e4331b8df8191cdd7a669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2a1ca6347d4278899a1cc009d87d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:32:30.167495 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-50f9e2a5-9a49-4a81-b629-47d6ecf8e4de tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] 10.222.0.78 "GET /compute/v2.1/servers/1ee42b60-a1c0-4b17-9aa4-01d216665df4" status: 200 len: 1317 microversion: 2.1 time: 0.282782 Feb 17 04:32:30.169640 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 315/622] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:32:29 2021] GET /compute/v2.1/servers/1ee42b60-a1c0-4b17-9aa4-01d216665df4 => generated 1317 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:32:30.607391 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-0dd24286-9e70-4621-8612-8f299fef323c tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:32:30.608040 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-0dd24286-9e70-4621-8612-8f299fef323c tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] [instance: 20760e77-fe67-4ebe-87f1-34d840495341] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:32:30.622294 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-0dd24286-9e70-4621-8612-8f299fef323c tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:32:30.623208 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-0dd24286-9e70-4621-8612-8f299fef323c tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:32:30.624362 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-0dd24286-9e70-4621-8612-8f299fef323c tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:32:30.624970 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-0dd24286-9e70-4621-8612-8f299fef323c tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:32:30.774402 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-3d077878-fa5a-49cf-bf9b-90c9643df509 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:32:30.776718 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-3d077878-fa5a-49cf-bf9b-90c9643df509 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: 29d1ce27-f63b-4523-88be-55f65a6a2529] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:32:30.787564 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-3d077878-fa5a-49cf-bf9b-90c9643df509 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:32:30.788523 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-3d077878-fa5a-49cf-bf9b-90c9643df509 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:32:30.789671 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-3d077878-fa5a-49cf-bf9b-90c9643df509 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:32:30.790418 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-3d077878-fa5a-49cf-bf9b-90c9643df509 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:32:30.938002 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-3d077878-fa5a-49cf-bf9b-90c9643df509 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "POST /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529/action" status: 200 len: 28650 microversion: 2.1 time: 0.167372 Feb 17 04:32:30.938834 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 316/623] 10.222.0.78 () {60 vars in 1268 bytes} [Wed Feb 17 04:32:30 2021] POST /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529/action => generated 28650 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 04:32:30.956535 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-5ccab1db-7edf-4192-a02b-44f47eb0be73 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:32:30.957733 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-5ccab1db-7edf-4192-a02b-44f47eb0be73 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] [instance: 8b4ba536-4de5-4f0e-9cb0-cc08d8616e5d] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:32:30.970381 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-5ccab1db-7edf-4192-a02b-44f47eb0be73 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:32:30.970989 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-5ccab1db-7edf-4192-a02b-44f47eb0be73 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:32:30.971965 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-5ccab1db-7edf-4192-a02b-44f47eb0be73 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:32:30.972484 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-5ccab1db-7edf-4192-a02b-44f47eb0be73 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:32:31.209791 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-5ccab1db-7edf-4192-a02b-44f47eb0be73 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b4f65f82a97499dbb900d523924e946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440d4048a9ad43869a00218c7acb9614', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:32:31.220265 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-5ccab1db-7edf-4192-a02b-44f47eb0be73 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] 10.222.0.78 "GET /compute/v2.1/servers/8b4ba536-4de5-4f0e-9cb0-cc08d8616e5d" status: 200 len: 1514 microversion: 2.1 time: 0.268433 Feb 17 04:32:31.221382 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 317/624] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:32:30 2021] GET /compute/v2.1/servers/8b4ba536-4de5-4f0e-9cb0-cc08d8616e5d => generated 1514 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:32:31.226467 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-adfed771-4ddc-4d19-8ae6-d34c9b3a186d tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:32:31.227419 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-adfed771-4ddc-4d19-8ae6-d34c9b3a186d tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] [instance: 1ee42b60-a1c0-4b17-9aa4-01d216665df4] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:32:31.237157 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-adfed771-4ddc-4d19-8ae6-d34c9b3a186d tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:32:31.237866 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-adfed771-4ddc-4d19-8ae6-d34c9b3a186d tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:32:31.238890 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-adfed771-4ddc-4d19-8ae6-d34c9b3a186d tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:32:31.239564 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-adfed771-4ddc-4d19-8ae6-d34c9b3a186d tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:32:31.360798 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-0dd24286-9e70-4621-8612-8f299fef323c tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1daf9a83b1d24033a3d4c0f531a4eb2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5336afdcf4aa4b46b0655432b7a1323c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:32:31.380399 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-0dd24286-9e70-4621-8612-8f299fef323c tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] 10.222.0.78 "GET /compute/v2.1/servers/20760e77-fe67-4ebe-87f1-34d840495341" status: 200 len: 1567 microversion: 2.1 time: 0.780252 Feb 17 04:32:31.381145 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 308/625] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:32:30 2021] GET /compute/v2.1/servers/20760e77-fe67-4ebe-87f1-34d840495341 => generated 1567 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:32:31.561290 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-adfed771-4ddc-4d19-8ae6-d34c9b3a186d tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d68d4a6c12e4331b8df8191cdd7a669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2a1ca6347d4278899a1cc009d87d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:32:31.604948 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-adfed771-4ddc-4d19-8ae6-d34c9b3a186d tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] 10.222.0.78 "GET /compute/v2.1/servers/1ee42b60-a1c0-4b17-9aa4-01d216665df4" status: 200 len: 1317 microversion: 2.1 time: 0.381962 Feb 17 04:32:31.606610 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 318/626] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:32:31 2021] GET /compute/v2.1/servers/1ee42b60-a1c0-4b17-9aa4-01d216665df4 => generated 1317 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:32:31.950619 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-bc7aa599-dcf4-4d5f-aedd-96dbbf0c174b tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:32:31.951883 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-bc7aa599-dcf4-4d5f-aedd-96dbbf0c174b tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: 29d1ce27-f63b-4523-88be-55f65a6a2529] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:32:31.973989 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-bc7aa599-dcf4-4d5f-aedd-96dbbf0c174b tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:32:31.974507 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-bc7aa599-dcf4-4d5f-aedd-96dbbf0c174b tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:32:31.977165 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-bc7aa599-dcf4-4d5f-aedd-96dbbf0c174b tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:32:31.977660 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-bc7aa599-dcf4-4d5f-aedd-96dbbf0c174b tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:32:32.240970 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-f12c8fcb-13df-4d15-929b-95a0718b1696 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:32:32.241943 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-f12c8fcb-13df-4d15-929b-95a0718b1696 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] [instance: 8b4ba536-4de5-4f0e-9cb0-cc08d8616e5d] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:32:32.254608 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-f12c8fcb-13df-4d15-929b-95a0718b1696 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:32:32.255045 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-f12c8fcb-13df-4d15-929b-95a0718b1696 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:32:32.258095 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-f12c8fcb-13df-4d15-929b-95a0718b1696 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:32:32.258609 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-f12c8fcb-13df-4d15-929b-95a0718b1696 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:32:32.361086 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-bc7aa599-dcf4-4d5f-aedd-96dbbf0c174b tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "POST /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529/action" status: 200 len: 28650 microversion: 2.1 time: 0.414592 Feb 17 04:32:32.361974 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 309/627] 10.222.0.78 () {60 vars in 1268 bytes} [Wed Feb 17 04:32:31 2021] POST /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529/action => generated 28650 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 04:32:32.400399 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-01ec502e-7496-41a7-b431-5a5d2a8b0303 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:32:32.401211 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-01ec502e-7496-41a7-b431-5a5d2a8b0303 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] [instance: 20760e77-fe67-4ebe-87f1-34d840495341] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:32:32.425054 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-01ec502e-7496-41a7-b431-5a5d2a8b0303 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:32:32.425767 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-01ec502e-7496-41a7-b431-5a5d2a8b0303 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:32:32.426647 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-01ec502e-7496-41a7-b431-5a5d2a8b0303 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:32:32.428002 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-01ec502e-7496-41a7-b431-5a5d2a8b0303 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:32:32.574987 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-f12c8fcb-13df-4d15-929b-95a0718b1696 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b4f65f82a97499dbb900d523924e946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440d4048a9ad43869a00218c7acb9614', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:32:32.585010 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-f12c8fcb-13df-4d15-929b-95a0718b1696 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] 10.222.0.78 "GET /compute/v2.1/servers/8b4ba536-4de5-4f0e-9cb0-cc08d8616e5d" status: 200 len: 1514 microversion: 2.1 time: 0.348419 Feb 17 04:32:32.595689 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 319/628] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:32:32 2021] GET /compute/v2.1/servers/8b4ba536-4de5-4f0e-9cb0-cc08d8616e5d => generated 1514 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:32:32.595689 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [req-08817cb4-2000-4cba-9406-d324251871a6 req-53d975bb-16fa-49c6-888a-16ca88d8c46d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1ee42b60-a1c0-4b17-9aa4-01d216665df4", "tag": "f38915de-2eaf-408a-aefc-2ed6e07dc1dd"}]} {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:32:32.595689 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:32:32.595689 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: warnings.warn(msg) Feb 17 04:32:32.604228 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [req-08817cb4-2000-4cba-9406-d324251871a6 req-53d975bb-16fa-49c6-888a-16ca88d8c46d service nova] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:32:32.604780 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [req-08817cb4-2000-4cba-9406-d324251871a6 req-53d975bb-16fa-49c6-888a-16ca88d8c46d service nova] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:32:32.643822 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.compute.server_external_events [req-08817cb4-2000-4cba-9406-d324251871a6 req-53d975bb-16fa-49c6-888a-16ca88d8c46d service nova] Creating event network-changed:f38915de-2eaf-408a-aefc-2ed6e07dc1dd for instance 1ee42b60-a1c0-4b17-9aa4-01d216665df4 on hv-cinder-75998 Feb 17 04:32:32.655461 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [req-08817cb4-2000-4cba-9406-d324251871a6 req-53d975bb-16fa-49c6-888a-16ca88d8c46d service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067966 Feb 17 04:32:32.655937 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 320/629] 10.222.0.78 () {64 vars in 1308 bytes} [Wed Feb 17 04:32:32 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:32:32.671347 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-a3894801-c527-4b3c-8a8d-1d1453dc914a tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:32:32.672290 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-a3894801-c527-4b3c-8a8d-1d1453dc914a tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] [instance: 1ee42b60-a1c0-4b17-9aa4-01d216665df4] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:32:32.682091 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-a3894801-c527-4b3c-8a8d-1d1453dc914a tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:32:32.682907 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-a3894801-c527-4b3c-8a8d-1d1453dc914a tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:32:32.684453 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-a3894801-c527-4b3c-8a8d-1d1453dc914a tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:32:32.685118 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-a3894801-c527-4b3c-8a8d-1d1453dc914a tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:32:32.973073 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-a3894801-c527-4b3c-8a8d-1d1453dc914a tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d68d4a6c12e4331b8df8191cdd7a669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2a1ca6347d4278899a1cc009d87d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:32:32.996133 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-a3894801-c527-4b3c-8a8d-1d1453dc914a tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] 10.222.0.78 "GET /compute/v2.1/servers/1ee42b60-a1c0-4b17-9aa4-01d216665df4" status: 200 len: 1317 microversion: 2.1 time: 0.338787 Feb 17 04:32:33.004225 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 321/630] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:32:32 2021] GET /compute/v2.1/servers/1ee42b60-a1c0-4b17-9aa4-01d216665df4 => generated 1317 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:32:33.052798 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-01ec502e-7496-41a7-b431-5a5d2a8b0303 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1daf9a83b1d24033a3d4c0f531a4eb2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5336afdcf4aa4b46b0655432b7a1323c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:32:33.066136 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-01ec502e-7496-41a7-b431-5a5d2a8b0303 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] 10.222.0.78 "GET /compute/v2.1/servers/20760e77-fe67-4ebe-87f1-34d840495341" status: 200 len: 1567 microversion: 2.1 time: 0.670385 Feb 17 04:32:33.079599 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 310/631] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:32:32 2021] GET /compute/v2.1/servers/20760e77-fe67-4ebe-87f1-34d840495341 => generated 1567 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:32:33.374640 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-6541cb0e-0da3-42da-b94a-cc69bf954d65 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:32:33.376143 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-6541cb0e-0da3-42da-b94a-cc69bf954d65 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: 29d1ce27-f63b-4523-88be-55f65a6a2529] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:32:33.395281 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-6541cb0e-0da3-42da-b94a-cc69bf954d65 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:32:33.395794 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-6541cb0e-0da3-42da-b94a-cc69bf954d65 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:32:33.396753 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-6541cb0e-0da3-42da-b94a-cc69bf954d65 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:32:33.397248 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-6541cb0e-0da3-42da-b94a-cc69bf954d65 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:32:33.582853 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-6541cb0e-0da3-42da-b94a-cc69bf954d65 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "POST /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529/action" status: 200 len: 28650 microversion: 2.1 time: 0.213026 Feb 17 04:32:33.583926 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 322/632] 10.222.0.78 () {60 vars in 1268 bytes} [Wed Feb 17 04:32:33 2021] POST /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529/action => generated 28650 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 04:32:33.604333 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-facc4591-cedc-4884-8f42-a80863bf7576 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:32:33.605391 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-facc4591-cedc-4884-8f42-a80863bf7576 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] [instance: 8b4ba536-4de5-4f0e-9cb0-cc08d8616e5d] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:32:33.615056 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-facc4591-cedc-4884-8f42-a80863bf7576 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:32:33.615791 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-facc4591-cedc-4884-8f42-a80863bf7576 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:32:33.616865 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-facc4591-cedc-4884-8f42-a80863bf7576 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:32:33.617381 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-facc4591-cedc-4884-8f42-a80863bf7576 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:32:33.724421 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-facc4591-cedc-4884-8f42-a80863bf7576 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:32:33.724946 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-facc4591-cedc-4884-8f42-a80863bf7576 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:32:33.725824 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.objects.instance [None req-facc4591-cedc-4884-8f42-a80863bf7576 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Lazy-loading 'fault' on Instance uuid 8b4ba536-4de5-4f0e-9cb0-cc08d8616e5d {{(pid=98178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Feb 17 04:32:33.920364 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-facc4591-cedc-4884-8f42-a80863bf7576 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b4f65f82a97499dbb900d523924e946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440d4048a9ad43869a00218c7acb9614', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:32:33.930777 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-facc4591-cedc-4884-8f42-a80863bf7576 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] 10.222.0.78 "GET /compute/v2.1/servers/8b4ba536-4de5-4f0e-9cb0-cc08d8616e5d" status: 200 len: 1309 microversion: 2.1 time: 0.331038 Feb 17 04:32:33.942113 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 311/633] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:32:33 2021] GET /compute/v2.1/servers/8b4ba536-4de5-4f0e-9cb0-cc08d8616e5d => generated 1309 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:32:34.018424 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-77917848-95b3-4972-b89f-6c89f1b48966 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:32:34.019245 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-77917848-95b3-4972-b89f-6c89f1b48966 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] [instance: 1ee42b60-a1c0-4b17-9aa4-01d216665df4] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:32:34.030767 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-77917848-95b3-4972-b89f-6c89f1b48966 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:32:34.032070 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-77917848-95b3-4972-b89f-6c89f1b48966 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:32:34.033320 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-77917848-95b3-4972-b89f-6c89f1b48966 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:32:34.033919 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-77917848-95b3-4972-b89f-6c89f1b48966 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:32:34.099424 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-5cf54b6f-999d-4be6-b1b0-a16254649c45 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:32:34.100479 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-5cf54b6f-999d-4be6-b1b0-a16254649c45 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] [instance: 20760e77-fe67-4ebe-87f1-34d840495341] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:32:34.127739 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-5cf54b6f-999d-4be6-b1b0-a16254649c45 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:32:34.128496 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-5cf54b6f-999d-4be6-b1b0-a16254649c45 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:32:34.129721 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-5cf54b6f-999d-4be6-b1b0-a16254649c45 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:32:34.131593 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-5cf54b6f-999d-4be6-b1b0-a16254649c45 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:32:34.524252 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-77917848-95b3-4972-b89f-6c89f1b48966 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d68d4a6c12e4331b8df8191cdd7a669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2a1ca6347d4278899a1cc009d87d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:32:34.534098 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-77917848-95b3-4972-b89f-6c89f1b48966 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] 10.222.0.78 "GET /compute/v2.1/servers/1ee42b60-a1c0-4b17-9aa4-01d216665df4" status: 200 len: 1317 microversion: 2.1 time: 0.522964 Feb 17 04:32:34.539852 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 323/634] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:32:34 2021] GET /compute/v2.1/servers/1ee42b60-a1c0-4b17-9aa4-01d216665df4 => generated 1317 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:32:34.598543 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-4adfa4d5-d3f9-42f9-9ac3-8860fcba43f0 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:32:34.599697 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-4adfa4d5-d3f9-42f9-9ac3-8860fcba43f0 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: 29d1ce27-f63b-4523-88be-55f65a6a2529] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:32:34.623380 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-4adfa4d5-d3f9-42f9-9ac3-8860fcba43f0 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:32:34.623896 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-4adfa4d5-d3f9-42f9-9ac3-8860fcba43f0 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:32:34.624759 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-4adfa4d5-d3f9-42f9-9ac3-8860fcba43f0 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:32:34.625259 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-4adfa4d5-d3f9-42f9-9ac3-8860fcba43f0 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:32:35.001507 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-4adfa4d5-d3f9-42f9-9ac3-8860fcba43f0 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "POST /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529/action" status: 200 len: 28650 microversion: 2.1 time: 0.409337 Feb 17 04:32:35.002498 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 324/635] 10.222.0.78 () {60 vars in 1268 bytes} [Wed Feb 17 04:32:34 2021] POST /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529/action => generated 28650 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 17 04:32:35.008764 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [req-aa592217-5bcb-44e9-ae83-118953d35c16 req-270c0df3-3aa5-4bb7-a434-0dce0c6545cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b4ba536-4de5-4f0e-9cb0-cc08d8616e5d", "name": "network-vif-deleted", "tag": "e9253754-0efa-4648-94ae-780814a11e89"}]} {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:32:35.018710 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:32:35.018710 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: warnings.warn(msg) Feb 17 04:32:35.040297 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [req-aa592217-5bcb-44e9-ae83-118953d35c16 req-270c0df3-3aa5-4bb7-a434-0dce0c6545cf service nova] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:32:35.043776 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [req-aa592217-5bcb-44e9-ae83-118953d35c16 req-270c0df3-3aa5-4bb7-a434-0dce0c6545cf service nova] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:32:35.077515 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.compute.server_external_events [req-aa592217-5bcb-44e9-ae83-118953d35c16 req-270c0df3-3aa5-4bb7-a434-0dce0c6545cf service nova] Creating event network-vif-deleted:e9253754-0efa-4648-94ae-780814a11e89 for instance 8b4ba536-4de5-4f0e-9cb0-cc08d8616e5d on hv-cinder-75998 Feb 17 04:32:35.082807 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [req-aa592217-5bcb-44e9-ae83-118953d35c16 req-270c0df3-3aa5-4bb7-a434-0dce0c6545cf service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078657 Feb 17 04:32:35.083722 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 325/636] 10.222.0.78 () {64 vars in 1308 bytes} [Wed Feb 17 04:32:35 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:32:35.089221 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-a6aa9b08-a02a-4f89-9853-b057dbb743ef tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:32:35.090804 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-a6aa9b08-a02a-4f89-9853-b057dbb743ef tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] [instance: 8b4ba536-4de5-4f0e-9cb0-cc08d8616e5d] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:32:35.099492 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-a6aa9b08-a02a-4f89-9853-b057dbb743ef tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:32:35.100191 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-a6aa9b08-a02a-4f89-9853-b057dbb743ef tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:32:35.101264 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-a6aa9b08-a02a-4f89-9853-b057dbb743ef tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:32:35.104542 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-a6aa9b08-a02a-4f89-9853-b057dbb743ef tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:32:35.124617 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-5cf54b6f-999d-4be6-b1b0-a16254649c45 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1daf9a83b1d24033a3d4c0f531a4eb2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5336afdcf4aa4b46b0655432b7a1323c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:32:35.134349 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-5cf54b6f-999d-4be6-b1b0-a16254649c45 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] 10.222.0.78 "GET /compute/v2.1/servers/20760e77-fe67-4ebe-87f1-34d840495341" status: 200 len: 1567 microversion: 2.1 time: 1.040673 Feb 17 04:32:35.135294 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 312/637] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:32:34 2021] GET /compute/v2.1/servers/20760e77-fe67-4ebe-87f1-34d840495341 => generated 1567 bytes in 1042 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:32:35.226051 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.wsgi [None req-a6aa9b08-a02a-4f89-9853-b057dbb743ef tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] HTTP exception thrown: Instance 8b4ba536-4de5-4f0e-9cb0-cc08d8616e5d could not be found. Feb 17 04:32:35.227056 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-a6aa9b08-a02a-4f89-9853-b057dbb743ef tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Returning 404 to user: Instance 8b4ba536-4de5-4f0e-9cb0-cc08d8616e5d could not be found. {{(pid=98179) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 17 04:32:35.228169 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-a6aa9b08-a02a-4f89-9853-b057dbb743ef tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] 10.222.0.78 "GET /compute/v2.1/servers/8b4ba536-4de5-4f0e-9cb0-cc08d8616e5d" status: 404 len: 111 microversion: 2.1 time: 0.143152 Feb 17 04:32:35.229280 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 326/638] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:32:35 2021] GET /compute/v2.1/servers/8b4ba536-4de5-4f0e-9cb0-cc08d8616e5d => generated 111 bytes in 145 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 17 04:32:35.563466 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-5a6089d6-4346-444b-a970-449d8d802b5a tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:32:35.564277 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-5a6089d6-4346-444b-a970-449d8d802b5a tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] [instance: 1ee42b60-a1c0-4b17-9aa4-01d216665df4] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:32:35.580405 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-5a6089d6-4346-444b-a970-449d8d802b5a tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:32:35.581023 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-5a6089d6-4346-444b-a970-449d8d802b5a tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:32:35.582437 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-5a6089d6-4346-444b-a970-449d8d802b5a tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:32:35.584791 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-5a6089d6-4346-444b-a970-449d8d802b5a tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:32:35.895572 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-5a6089d6-4346-444b-a970-449d8d802b5a tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d68d4a6c12e4331b8df8191cdd7a669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2a1ca6347d4278899a1cc009d87d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:32:35.910161 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-5a6089d6-4346-444b-a970-449d8d802b5a tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] 10.222.0.78 "GET /compute/v2.1/servers/1ee42b60-a1c0-4b17-9aa4-01d216665df4" status: 200 len: 1317 microversion: 2.1 time: 0.351858 Feb 17 04:32:35.911100 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 313/639] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:32:35 2021] GET /compute/v2.1/servers/1ee42b60-a1c0-4b17-9aa4-01d216665df4 => generated 1317 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:32:36.016548 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-387c6c72-58d9-472f-9977-d260c7a28d7e tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:32:36.017603 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-387c6c72-58d9-472f-9977-d260c7a28d7e tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: 29d1ce27-f63b-4523-88be-55f65a6a2529] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:32:36.028530 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-387c6c72-58d9-472f-9977-d260c7a28d7e tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:32:36.029071 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-387c6c72-58d9-472f-9977-d260c7a28d7e tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:32:36.029854 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-387c6c72-58d9-472f-9977-d260c7a28d7e tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:32:36.030534 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-387c6c72-58d9-472f-9977-d260c7a28d7e tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:32:36.154838 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-cd9d58df-b2a0-417b-83d4-e1e8a8dfe436 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:32:36.156087 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-cd9d58df-b2a0-417b-83d4-e1e8a8dfe436 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] [instance: 20760e77-fe67-4ebe-87f1-34d840495341] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:32:36.171634 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-cd9d58df-b2a0-417b-83d4-e1e8a8dfe436 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:32:36.173592 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-cd9d58df-b2a0-417b-83d4-e1e8a8dfe436 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:32:36.174717 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-cd9d58df-b2a0-417b-83d4-e1e8a8dfe436 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:32:36.176397 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-cd9d58df-b2a0-417b-83d4-e1e8a8dfe436 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:32:36.476954 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-cd9d58df-b2a0-417b-83d4-e1e8a8dfe436 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1daf9a83b1d24033a3d4c0f531a4eb2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5336afdcf4aa4b46b0655432b7a1323c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:32:36.497430 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-cd9d58df-b2a0-417b-83d4-e1e8a8dfe436 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] 10.222.0.78 "GET /compute/v2.1/servers/20760e77-fe67-4ebe-87f1-34d840495341" status: 200 len: 1567 microversion: 2.1 time: 0.347331 Feb 17 04:32:36.503123 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 314/640] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:32:36 2021] GET /compute/v2.1/servers/20760e77-fe67-4ebe-87f1-34d840495341 => generated 1567 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:32:36.929322 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-57dbbc24-2877-4476-b624-6c637397af08 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:32:36.929932 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-57dbbc24-2877-4476-b624-6c637397af08 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] [instance: 1ee42b60-a1c0-4b17-9aa4-01d216665df4] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:32:36.941213 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-57dbbc24-2877-4476-b624-6c637397af08 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:32:36.941949 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-57dbbc24-2877-4476-b624-6c637397af08 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:32:36.943085 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-57dbbc24-2877-4476-b624-6c637397af08 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:32:36.943595 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-57dbbc24-2877-4476-b624-6c637397af08 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:32:37.213551 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-57dbbc24-2877-4476-b624-6c637397af08 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d68d4a6c12e4331b8df8191cdd7a669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2a1ca6347d4278899a1cc009d87d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:32:37.223972 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-57dbbc24-2877-4476-b624-6c637397af08 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] 10.222.0.78 "GET /compute/v2.1/servers/1ee42b60-a1c0-4b17-9aa4-01d216665df4" status: 200 len: 1317 microversion: 2.1 time: 0.299195 Feb 17 04:32:37.224850 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 315/641] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:32:36 2021] GET /compute/v2.1/servers/1ee42b60-a1c0-4b17-9aa4-01d216665df4 => generated 1317 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:32:37.515748 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-0b9421a9-af6c-4ea2-91d7-371a6f76801c tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:32:37.516426 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-0b9421a9-af6c-4ea2-91d7-371a6f76801c tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] [instance: 20760e77-fe67-4ebe-87f1-34d840495341] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:32:37.524790 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-0b9421a9-af6c-4ea2-91d7-371a6f76801c tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:32:37.525293 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-0b9421a9-af6c-4ea2-91d7-371a6f76801c tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:32:37.526148 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-0b9421a9-af6c-4ea2-91d7-371a6f76801c tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:32:37.526637 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-0b9421a9-af6c-4ea2-91d7-371a6f76801c tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:32:37.988634 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-0b9421a9-af6c-4ea2-91d7-371a6f76801c tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1daf9a83b1d24033a3d4c0f531a4eb2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5336afdcf4aa4b46b0655432b7a1323c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:32:38.003376 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-0b9421a9-af6c-4ea2-91d7-371a6f76801c tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] 10.222.0.78 "GET /compute/v2.1/servers/20760e77-fe67-4ebe-87f1-34d840495341" status: 200 len: 1567 microversion: 2.1 time: 0.491549 Feb 17 04:32:38.003980 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 316/642] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:32:37 2021] GET /compute/v2.1/servers/20760e77-fe67-4ebe-87f1-34d840495341 => generated 1567 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:32:38.243518 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-0b8bfcc2-370c-4526-817f-ce81f87434b5 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:32:38.244802 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-0b8bfcc2-370c-4526-817f-ce81f87434b5 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] [instance: 1ee42b60-a1c0-4b17-9aa4-01d216665df4] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:32:38.253971 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-0b8bfcc2-370c-4526-817f-ce81f87434b5 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:32:38.257306 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-0b8bfcc2-370c-4526-817f-ce81f87434b5 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:32:38.258412 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-0b8bfcc2-370c-4526-817f-ce81f87434b5 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:32:38.259094 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-0b8bfcc2-370c-4526-817f-ce81f87434b5 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:32:38.521865 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-0b8bfcc2-370c-4526-817f-ce81f87434b5 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d68d4a6c12e4331b8df8191cdd7a669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2a1ca6347d4278899a1cc009d87d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:32:38.535883 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-0b8bfcc2-370c-4526-817f-ce81f87434b5 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] 10.222.0.78 "GET /compute/v2.1/servers/1ee42b60-a1c0-4b17-9aa4-01d216665df4" status: 200 len: 1317 microversion: 2.1 time: 0.297344 Feb 17 04:32:38.536459 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 317/643] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:32:38 2021] GET /compute/v2.1/servers/1ee42b60-a1c0-4b17-9aa4-01d216665df4 => generated 1317 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:32:39.021942 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-63175060-6d85-4847-8ba2-6abd517d033b tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:32:39.022920 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-63175060-6d85-4847-8ba2-6abd517d033b tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] [instance: 20760e77-fe67-4ebe-87f1-34d840495341] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:32:39.032073 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-63175060-6d85-4847-8ba2-6abd517d033b tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:32:39.032710 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-63175060-6d85-4847-8ba2-6abd517d033b tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:32:39.033719 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-63175060-6d85-4847-8ba2-6abd517d033b tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:32:39.034287 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-63175060-6d85-4847-8ba2-6abd517d033b tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:32:39.060526 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-387c6c72-58d9-472f-9977-d260c7a28d7e tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "POST /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529/action" status: 200 len: 28650 microversion: 2.1 time: 3.049685 Feb 17 04:32:39.061864 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 327/644] 10.222.0.78 () {60 vars in 1268 bytes} [Wed Feb 17 04:32:36 2021] POST /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529/action => generated 28650 bytes in 3052 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 04:32:39.255868 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-63175060-6d85-4847-8ba2-6abd517d033b tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1daf9a83b1d24033a3d4c0f531a4eb2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5336afdcf4aa4b46b0655432b7a1323c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:32:39.265753 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-63175060-6d85-4847-8ba2-6abd517d033b tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] 10.222.0.78 "GET /compute/v2.1/servers/20760e77-fe67-4ebe-87f1-34d840495341" status: 200 len: 1567 microversion: 2.1 time: 0.247977 Feb 17 04:32:39.266352 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 318/645] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:32:39 2021] GET /compute/v2.1/servers/20760e77-fe67-4ebe-87f1-34d840495341 => generated 1567 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:32:39.554998 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-18c31df7-c4bb-4dc4-9059-91facfe74b82 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:32:39.555905 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-18c31df7-c4bb-4dc4-9059-91facfe74b82 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] [instance: 1ee42b60-a1c0-4b17-9aa4-01d216665df4] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:32:39.564626 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-18c31df7-c4bb-4dc4-9059-91facfe74b82 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:32:39.565135 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-18c31df7-c4bb-4dc4-9059-91facfe74b82 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:32:39.565978 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-18c31df7-c4bb-4dc4-9059-91facfe74b82 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:32:39.566477 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-18c31df7-c4bb-4dc4-9059-91facfe74b82 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:32:39.786916 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-18c31df7-c4bb-4dc4-9059-91facfe74b82 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d68d4a6c12e4331b8df8191cdd7a669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2a1ca6347d4278899a1cc009d87d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:32:39.797487 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-18c31df7-c4bb-4dc4-9059-91facfe74b82 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] 10.222.0.78 "GET /compute/v2.1/servers/1ee42b60-a1c0-4b17-9aa4-01d216665df4" status: 200 len: 1317 microversion: 2.1 time: 0.247067 Feb 17 04:32:39.798813 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 328/646] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:32:39 2021] GET /compute/v2.1/servers/1ee42b60-a1c0-4b17-9aa4-01d216665df4 => generated 1317 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:32:40.073615 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-7538c294-1e56-49d7-b88c-672e5ccb87af tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:32:40.075398 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-7538c294-1e56-49d7-b88c-672e5ccb87af tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: 29d1ce27-f63b-4523-88be-55f65a6a2529] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:32:40.087740 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-7538c294-1e56-49d7-b88c-672e5ccb87af tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:32:40.088258 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-7538c294-1e56-49d7-b88c-672e5ccb87af tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:32:40.089113 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-7538c294-1e56-49d7-b88c-672e5ccb87af tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:32:40.090228 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-7538c294-1e56-49d7-b88c-672e5ccb87af tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:32:40.285594 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-19c5c98a-2ccd-4d5b-82ab-b596a63e163b tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:32:40.286944 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-19c5c98a-2ccd-4d5b-82ab-b596a63e163b tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] [instance: 20760e77-fe67-4ebe-87f1-34d840495341] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:32:40.298598 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-19c5c98a-2ccd-4d5b-82ab-b596a63e163b tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:32:40.299139 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-19c5c98a-2ccd-4d5b-82ab-b596a63e163b tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:32:40.300071 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-19c5c98a-2ccd-4d5b-82ab-b596a63e163b tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:32:40.300569 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-19c5c98a-2ccd-4d5b-82ab-b596a63e163b tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:32:40.521263 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-19c5c98a-2ccd-4d5b-82ab-b596a63e163b tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1daf9a83b1d24033a3d4c0f531a4eb2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5336afdcf4aa4b46b0655432b7a1323c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:32:40.532270 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-19c5c98a-2ccd-4d5b-82ab-b596a63e163b tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] 10.222.0.78 "GET /compute/v2.1/servers/20760e77-fe67-4ebe-87f1-34d840495341" status: 200 len: 1567 microversion: 2.1 time: 0.251198 Feb 17 04:32:40.532887 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 329/647] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:32:40 2021] GET /compute/v2.1/servers/20760e77-fe67-4ebe-87f1-34d840495341 => generated 1567 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:32:40.816071 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-134bb02e-6c04-410b-82c6-5bb841cd38a2 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:32:40.816767 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-134bb02e-6c04-410b-82c6-5bb841cd38a2 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] [instance: 1ee42b60-a1c0-4b17-9aa4-01d216665df4] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:32:40.825371 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-134bb02e-6c04-410b-82c6-5bb841cd38a2 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:32:40.825880 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-134bb02e-6c04-410b-82c6-5bb841cd38a2 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:32:40.826734 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-134bb02e-6c04-410b-82c6-5bb841cd38a2 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:32:40.827264 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-134bb02e-6c04-410b-82c6-5bb841cd38a2 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:32:41.052582 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-134bb02e-6c04-410b-82c6-5bb841cd38a2 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d68d4a6c12e4331b8df8191cdd7a669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2a1ca6347d4278899a1cc009d87d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:32:41.062837 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-134bb02e-6c04-410b-82c6-5bb841cd38a2 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] 10.222.0.78 "GET /compute/v2.1/servers/1ee42b60-a1c0-4b17-9aa4-01d216665df4" status: 200 len: 1317 microversion: 2.1 time: 0.250676 Feb 17 04:32:41.063579 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 330/648] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:32:40 2021] GET /compute/v2.1/servers/1ee42b60-a1c0-4b17-9aa4-01d216665df4 => generated 1317 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:32:41.180212 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-7538c294-1e56-49d7-b88c-672e5ccb87af tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "POST /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529/action" status: 200 len: 28650 microversion: 2.1 time: 1.110385 Feb 17 04:32:41.181008 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 319/649] 10.222.0.78 () {60 vars in 1268 bytes} [Wed Feb 17 04:32:40 2021] POST /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529/action => generated 28650 bytes in 1112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 04:32:41.550546 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-bc4829cd-4f82-47d5-89fc-b523253fc3fd tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:32:41.551386 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-bc4829cd-4f82-47d5-89fc-b523253fc3fd tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] [instance: 20760e77-fe67-4ebe-87f1-34d840495341] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:32:41.559819 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-bc4829cd-4f82-47d5-89fc-b523253fc3fd tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:32:41.560368 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-bc4829cd-4f82-47d5-89fc-b523253fc3fd tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:32:41.561221 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-bc4829cd-4f82-47d5-89fc-b523253fc3fd tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:32:41.561735 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-bc4829cd-4f82-47d5-89fc-b523253fc3fd tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:32:41.775843 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-bc4829cd-4f82-47d5-89fc-b523253fc3fd tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1daf9a83b1d24033a3d4c0f531a4eb2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5336afdcf4aa4b46b0655432b7a1323c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:32:41.786184 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-bc4829cd-4f82-47d5-89fc-b523253fc3fd tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] 10.222.0.78 "GET /compute/v2.1/servers/20760e77-fe67-4ebe-87f1-34d840495341" status: 200 len: 1567 microversion: 2.1 time: 0.239606 Feb 17 04:32:41.796070 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 331/650] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:32:41 2021] GET /compute/v2.1/servers/20760e77-fe67-4ebe-87f1-34d840495341 => generated 1567 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:32:42.082113 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-0eff78f3-ef4f-4bc8-aa89-37f80e80fa00 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:32:42.082891 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-0eff78f3-ef4f-4bc8-aa89-37f80e80fa00 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] [instance: 1ee42b60-a1c0-4b17-9aa4-01d216665df4] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:32:42.092731 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-0eff78f3-ef4f-4bc8-aa89-37f80e80fa00 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:32:42.093246 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-0eff78f3-ef4f-4bc8-aa89-37f80e80fa00 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:32:42.094149 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-0eff78f3-ef4f-4bc8-aa89-37f80e80fa00 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:32:42.094648 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-0eff78f3-ef4f-4bc8-aa89-37f80e80fa00 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:32:42.193286 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-3898ed12-d821-4fba-bbf7-158c1da1cc7a tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:32:42.194621 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-3898ed12-d821-4fba-bbf7-158c1da1cc7a tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: 29d1ce27-f63b-4523-88be-55f65a6a2529] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:32:42.205463 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-3898ed12-d821-4fba-bbf7-158c1da1cc7a tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:32:42.206119 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-3898ed12-d821-4fba-bbf7-158c1da1cc7a tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:32:42.207398 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-3898ed12-d821-4fba-bbf7-158c1da1cc7a tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:32:42.208206 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-3898ed12-d821-4fba-bbf7-158c1da1cc7a tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:32:42.340249 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-0eff78f3-ef4f-4bc8-aa89-37f80e80fa00 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d68d4a6c12e4331b8df8191cdd7a669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2a1ca6347d4278899a1cc009d87d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:32:42.350678 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-0eff78f3-ef4f-4bc8-aa89-37f80e80fa00 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] 10.222.0.78 "GET /compute/v2.1/servers/1ee42b60-a1c0-4b17-9aa4-01d216665df4" status: 200 len: 1317 microversion: 2.1 time: 0.273117 Feb 17 04:32:42.351389 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 320/651] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:32:42 2021] GET /compute/v2.1/servers/1ee42b60-a1c0-4b17-9aa4-01d216665df4 => generated 1317 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:32:42.353743 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-3898ed12-d821-4fba-bbf7-158c1da1cc7a tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "POST /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529/action" status: 200 len: 28650 microversion: 2.1 time: 0.164310 Feb 17 04:32:42.355516 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 332/652] 10.222.0.78 () {60 vars in 1268 bytes} [Wed Feb 17 04:32:42 2021] POST /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529/action => generated 28650 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 04:32:42.804892 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-552c2348-3753-4293-95e4-743d7e1c9a9d tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:32:42.805514 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-552c2348-3753-4293-95e4-743d7e1c9a9d tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] [instance: 20760e77-fe67-4ebe-87f1-34d840495341] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:32:42.814120 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-552c2348-3753-4293-95e4-743d7e1c9a9d tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:32:42.814665 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-552c2348-3753-4293-95e4-743d7e1c9a9d tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:32:42.815497 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-552c2348-3753-4293-95e4-743d7e1c9a9d tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:32:42.816039 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-552c2348-3753-4293-95e4-743d7e1c9a9d tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:32:43.118184 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-552c2348-3753-4293-95e4-743d7e1c9a9d tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1daf9a83b1d24033a3d4c0f531a4eb2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5336afdcf4aa4b46b0655432b7a1323c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:32:43.131164 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-552c2348-3753-4293-95e4-743d7e1c9a9d tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] 10.222.0.78 "GET /compute/v2.1/servers/20760e77-fe67-4ebe-87f1-34d840495341" status: 200 len: 1567 microversion: 2.1 time: 0.330264 Feb 17 04:32:43.131990 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 321/653] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:32:42 2021] GET /compute/v2.1/servers/20760e77-fe67-4ebe-87f1-34d840495341 => generated 1567 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:32:43.368296 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-54183c19-3ab1-42f4-bca5-02c476509332 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:32:43.368980 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-54183c19-3ab1-42f4-bca5-02c476509332 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] [instance: 1ee42b60-a1c0-4b17-9aa4-01d216665df4] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:32:43.376244 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-3764a942-6ef2-4454-a6a8-508886d4a5fa tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:32:43.377523 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-3764a942-6ef2-4454-a6a8-508886d4a5fa tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: 29d1ce27-f63b-4523-88be-55f65a6a2529] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:32:43.391911 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-54183c19-3ab1-42f4-bca5-02c476509332 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:32:43.392424 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-54183c19-3ab1-42f4-bca5-02c476509332 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:32:43.393285 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-54183c19-3ab1-42f4-bca5-02c476509332 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:32:43.393787 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-54183c19-3ab1-42f4-bca5-02c476509332 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:32:43.407184 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-3764a942-6ef2-4454-a6a8-508886d4a5fa tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:32:43.407744 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-3764a942-6ef2-4454-a6a8-508886d4a5fa tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:32:43.408640 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-3764a942-6ef2-4454-a6a8-508886d4a5fa tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:32:43.409123 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-3764a942-6ef2-4454-a6a8-508886d4a5fa tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:32:43.735578 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-54183c19-3ab1-42f4-bca5-02c476509332 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d68d4a6c12e4331b8df8191cdd7a669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2a1ca6347d4278899a1cc009d87d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:32:43.745027 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-54183c19-3ab1-42f4-bca5-02c476509332 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] 10.222.0.78 "GET /compute/v2.1/servers/1ee42b60-a1c0-4b17-9aa4-01d216665df4" status: 200 len: 1317 microversion: 2.1 time: 0.380568 Feb 17 04:32:43.745724 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 322/654] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:32:43 2021] GET /compute/v2.1/servers/1ee42b60-a1c0-4b17-9aa4-01d216665df4 => generated 1317 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:32:44.149966 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-0b0ba391-fc83-4e4b-81cd-664dfbe7c35f tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:32:44.150749 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-0b0ba391-fc83-4e4b-81cd-664dfbe7c35f tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] [instance: 20760e77-fe67-4ebe-87f1-34d840495341] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:32:44.160251 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-0b0ba391-fc83-4e4b-81cd-664dfbe7c35f tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:32:44.160761 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-0b0ba391-fc83-4e4b-81cd-664dfbe7c35f tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:32:44.161655 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-0b0ba391-fc83-4e4b-81cd-664dfbe7c35f tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:32:44.162190 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-0b0ba391-fc83-4e4b-81cd-664dfbe7c35f tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:32:44.170222 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-3764a942-6ef2-4454-a6a8-508886d4a5fa tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "POST /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529/action" status: 200 len: 28650 microversion: 2.1 time: 0.807333 Feb 17 04:32:44.171137 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 333/655] 10.222.0.78 () {60 vars in 1268 bytes} [Wed Feb 17 04:32:43 2021] POST /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529/action => generated 28650 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 17 04:32:44.417139 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-0b0ba391-fc83-4e4b-81cd-664dfbe7c35f tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1daf9a83b1d24033a3d4c0f531a4eb2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5336afdcf4aa4b46b0655432b7a1323c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:32:44.428813 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-0b0ba391-fc83-4e4b-81cd-664dfbe7c35f tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] 10.222.0.78 "GET /compute/v2.1/servers/20760e77-fe67-4ebe-87f1-34d840495341" status: 200 len: 1567 microversion: 2.1 time: 0.282751 Feb 17 04:32:44.429421 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 323/656] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:32:44 2021] GET /compute/v2.1/servers/20760e77-fe67-4ebe-87f1-34d840495341 => generated 1567 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:32:44.771329 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-fdfe3cee-d0e7-40c6-abfb-df892dd88411 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:32:44.772934 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-fdfe3cee-d0e7-40c6-abfb-df892dd88411 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] [instance: 1ee42b60-a1c0-4b17-9aa4-01d216665df4] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:32:44.788438 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-fdfe3cee-d0e7-40c6-abfb-df892dd88411 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:32:44.789329 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-fdfe3cee-d0e7-40c6-abfb-df892dd88411 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:32:44.791083 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-fdfe3cee-d0e7-40c6-abfb-df892dd88411 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:32:44.791930 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-fdfe3cee-d0e7-40c6-abfb-df892dd88411 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:32:45.182045 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-cd9b037d-2b0c-4a79-a91c-1ebc426125d9 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:32:45.184083 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-cd9b037d-2b0c-4a79-a91c-1ebc426125d9 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: 29d1ce27-f63b-4523-88be-55f65a6a2529] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:32:45.192810 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-cd9b037d-2b0c-4a79-a91c-1ebc426125d9 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:32:45.193559 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-cd9b037d-2b0c-4a79-a91c-1ebc426125d9 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:32:45.194513 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-cd9b037d-2b0c-4a79-a91c-1ebc426125d9 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:32:45.195010 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-cd9b037d-2b0c-4a79-a91c-1ebc426125d9 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:32:45.396588 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-cd9b037d-2b0c-4a79-a91c-1ebc426125d9 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "POST /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529/action" status: 200 len: 28650 microversion: 2.1 time: 0.218286 Feb 17 04:32:45.400801 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 324/657] 10.222.0.78 () {60 vars in 1268 bytes} [Wed Feb 17 04:32:45 2021] POST /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529/action => generated 28650 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 04:32:45.454864 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-5912b3dd-f704-4964-9c07-d3be18d9b2b0 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:32:45.459531 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-5912b3dd-f704-4964-9c07-d3be18d9b2b0 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] [instance: 20760e77-fe67-4ebe-87f1-34d840495341] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:32:45.474640 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-5912b3dd-f704-4964-9c07-d3be18d9b2b0 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:32:45.475544 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-5912b3dd-f704-4964-9c07-d3be18d9b2b0 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:32:45.476611 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-5912b3dd-f704-4964-9c07-d3be18d9b2b0 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:32:45.477302 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-5912b3dd-f704-4964-9c07-d3be18d9b2b0 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:32:45.499431 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-fdfe3cee-d0e7-40c6-abfb-df892dd88411 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d68d4a6c12e4331b8df8191cdd7a669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2a1ca6347d4278899a1cc009d87d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:32:45.511341 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-fdfe3cee-d0e7-40c6-abfb-df892dd88411 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] 10.222.0.78 "GET /compute/v2.1/servers/1ee42b60-a1c0-4b17-9aa4-01d216665df4" status: 200 len: 1317 microversion: 2.1 time: 0.751159 Feb 17 04:32:45.512887 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 334/658] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:32:44 2021] GET /compute/v2.1/servers/1ee42b60-a1c0-4b17-9aa4-01d216665df4 => generated 1317 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:32:45.711537 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-5912b3dd-f704-4964-9c07-d3be18d9b2b0 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1daf9a83b1d24033a3d4c0f531a4eb2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5336afdcf4aa4b46b0655432b7a1323c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:32:45.721181 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-5912b3dd-f704-4964-9c07-d3be18d9b2b0 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] 10.222.0.78 "GET /compute/v2.1/servers/20760e77-fe67-4ebe-87f1-34d840495341" status: 200 len: 1547 microversion: 2.1 time: 0.270877 Feb 17 04:32:45.721797 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 325/659] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:32:45 2021] GET /compute/v2.1/servers/20760e77-fe67-4ebe-87f1-34d840495341 => generated 1547 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:32:45.739713 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-2362e64b-1b13-4fc9-8e11-c73f3cb9135a tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:32:45.740265 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-2362e64b-1b13-4fc9-8e11-c73f3cb9135a tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] [instance: 20760e77-fe67-4ebe-87f1-34d840495341] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:32:45.748963 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-2362e64b-1b13-4fc9-8e11-c73f3cb9135a tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:32:45.749550 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-2362e64b-1b13-4fc9-8e11-c73f3cb9135a tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:32:45.750402 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-2362e64b-1b13-4fc9-8e11-c73f3cb9135a tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:32:45.750905 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-2362e64b-1b13-4fc9-8e11-c73f3cb9135a tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:32:45.927585 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.wsgi [None req-2362e64b-1b13-4fc9-8e11-c73f3cb9135a tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] HTTP exception thrown: Cannot 'detach_volume' instance 20760e77-fe67-4ebe-87f1-34d840495341 while it is in vm_state rescued Feb 17 04:32:45.928265 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-2362e64b-1b13-4fc9-8e11-c73f3cb9135a tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Returning 409 to user: Cannot 'detach_volume' instance 20760e77-fe67-4ebe-87f1-34d840495341 while it is in vm_state rescued {{(pid=98179) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 17 04:32:45.929173 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-2362e64b-1b13-4fc9-8e11-c73f3cb9135a tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] 10.222.0.78 "DELETE /compute/v2.1/servers/20760e77-fe67-4ebe-87f1-34d840495341/os-volume_attachments/89dc3d17-5108-44ee-9b6f-94e7d31c33af" status: 409 len: 152 microversion: 2.1 time: 0.194035 Feb 17 04:32:45.929793 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 335/660] 10.222.0.78 () {58 vars in 1406 bytes} [Wed Feb 17 04:32:45 2021] DELETE /compute/v2.1/servers/20760e77-fe67-4ebe-87f1-34d840495341/os-volume_attachments/89dc3d17-5108-44ee-9b6f-94e7d31c33af => generated 152 bytes in 195 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Feb 17 04:32:45.939564 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-adba1408-e6a2-44e4-a6dd-66884c555264 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:32:45.940164 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-adba1408-e6a2-44e4-a6dd-66884c555264 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] [instance: 20760e77-fe67-4ebe-87f1-34d840495341] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:32:45.948058 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-adba1408-e6a2-44e4-a6dd-66884c555264 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:32:45.948574 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-adba1408-e6a2-44e4-a6dd-66884c555264 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:32:45.949826 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-adba1408-e6a2-44e4-a6dd-66884c555264 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:32:45.950331 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-adba1408-e6a2-44e4-a6dd-66884c555264 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:32:46.091306 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-adba1408-e6a2-44e4-a6dd-66884c555264 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] 10.222.0.78 "POST /compute/v2.1/servers/20760e77-fe67-4ebe-87f1-34d840495341/action" status: 202 len: 0 microversion: 2.1 time: 0.155198 Feb 17 04:32:46.095248 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 326/661] 10.222.0.78 () {60 vars in 1268 bytes} [Wed Feb 17 04:32:45 2021] POST /compute/v2.1/servers/20760e77-fe67-4ebe-87f1-34d840495341/action => generated 0 bytes in 157 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Feb 17 04:32:46.100754 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-7f2d70e1-b11f-4740-81ee-1fca40a54568 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:32:46.101637 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-7f2d70e1-b11f-4740-81ee-1fca40a54568 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] [instance: 20760e77-fe67-4ebe-87f1-34d840495341] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:32:46.110888 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-7f2d70e1-b11f-4740-81ee-1fca40a54568 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:32:46.112101 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-7f2d70e1-b11f-4740-81ee-1fca40a54568 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:32:46.112709 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-7f2d70e1-b11f-4740-81ee-1fca40a54568 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:32:46.113298 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-7f2d70e1-b11f-4740-81ee-1fca40a54568 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:32:46.409685 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-7e65e042-f029-47da-b467-d1840db18c5a tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:32:46.410829 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-7e65e042-f029-47da-b467-d1840db18c5a tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: 29d1ce27-f63b-4523-88be-55f65a6a2529] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:32:46.419190 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-7e65e042-f029-47da-b467-d1840db18c5a tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:32:46.419701 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-7e65e042-f029-47da-b467-d1840db18c5a tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:32:46.420548 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-7e65e042-f029-47da-b467-d1840db18c5a tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:32:46.421045 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-7e65e042-f029-47da-b467-d1840db18c5a tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:32:46.717112 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-7f2d70e1-b11f-4740-81ee-1fca40a54568 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1daf9a83b1d24033a3d4c0f531a4eb2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5336afdcf4aa4b46b0655432b7a1323c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:32:46.728714 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-7f2d70e1-b11f-4740-81ee-1fca40a54568 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] 10.222.0.78 "GET /compute/v2.1/servers/20760e77-fe67-4ebe-87f1-34d840495341" status: 200 len: 1555 microversion: 2.1 time: 0.631848 Feb 17 04:32:46.730411 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 336/662] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:32:46 2021] GET /compute/v2.1/servers/20760e77-fe67-4ebe-87f1-34d840495341 => generated 1555 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:32:46.736428 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-dd10cdc0-3d69-4bba-b909-a46b13728e22 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:32:46.737366 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-dd10cdc0-3d69-4bba-b909-a46b13728e22 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] [instance: 1ee42b60-a1c0-4b17-9aa4-01d216665df4] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:32:46.751377 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-dd10cdc0-3d69-4bba-b909-a46b13728e22 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:32:46.751896 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-dd10cdc0-3d69-4bba-b909-a46b13728e22 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:32:46.752757 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-dd10cdc0-3d69-4bba-b909-a46b13728e22 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:32:46.753261 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-dd10cdc0-3d69-4bba-b909-a46b13728e22 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:32:46.973561 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-dd10cdc0-3d69-4bba-b909-a46b13728e22 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d68d4a6c12e4331b8df8191cdd7a669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2a1ca6347d4278899a1cc009d87d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:32:46.983442 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-dd10cdc0-3d69-4bba-b909-a46b13728e22 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] 10.222.0.78 "GET /compute/v2.1/servers/1ee42b60-a1c0-4b17-9aa4-01d216665df4" status: 200 len: 1317 microversion: 2.1 time: 0.251718 Feb 17 04:32:46.984199 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 337/663] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:32:46 2021] GET /compute/v2.1/servers/1ee42b60-a1c0-4b17-9aa4-01d216665df4 => generated 1317 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:32:47.748211 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-5c8bca48-b886-4772-9839-b1d20c95f467 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:32:47.749003 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-5c8bca48-b886-4772-9839-b1d20c95f467 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] [instance: 20760e77-fe67-4ebe-87f1-34d840495341] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:32:47.757035 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-5c8bca48-b886-4772-9839-b1d20c95f467 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:32:47.757648 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-5c8bca48-b886-4772-9839-b1d20c95f467 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:32:47.758589 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-5c8bca48-b886-4772-9839-b1d20c95f467 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:32:47.759126 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-5c8bca48-b886-4772-9839-b1d20c95f467 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:32:47.976342 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-5c8bca48-b886-4772-9839-b1d20c95f467 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1daf9a83b1d24033a3d4c0f531a4eb2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5336afdcf4aa4b46b0655432b7a1323c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:32:47.986916 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-5c8bca48-b886-4772-9839-b1d20c95f467 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] 10.222.0.78 "GET /compute/v2.1/servers/20760e77-fe67-4ebe-87f1-34d840495341" status: 200 len: 1555 microversion: 2.1 time: 0.243064 Feb 17 04:32:47.987639 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 338/664] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:32:47 2021] GET /compute/v2.1/servers/20760e77-fe67-4ebe-87f1-34d840495341 => generated 1555 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:32:48.002415 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-01c6e1ee-1adb-436b-86ec-54d6198fb146 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:32:48.003023 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-01c6e1ee-1adb-436b-86ec-54d6198fb146 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] [instance: 1ee42b60-a1c0-4b17-9aa4-01d216665df4] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:32:48.010784 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-01c6e1ee-1adb-436b-86ec-54d6198fb146 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:32:48.011381 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-01c6e1ee-1adb-436b-86ec-54d6198fb146 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:32:48.012427 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-01c6e1ee-1adb-436b-86ec-54d6198fb146 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:32:48.012925 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-01c6e1ee-1adb-436b-86ec-54d6198fb146 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:32:48.246687 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-01c6e1ee-1adb-436b-86ec-54d6198fb146 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d68d4a6c12e4331b8df8191cdd7a669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2a1ca6347d4278899a1cc009d87d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:32:48.256406 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-01c6e1ee-1adb-436b-86ec-54d6198fb146 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] 10.222.0.78 "GET /compute/v2.1/servers/1ee42b60-a1c0-4b17-9aa4-01d216665df4" status: 200 len: 1317 microversion: 2.1 time: 0.257757 Feb 17 04:32:48.257443 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 339/665] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:32:47 2021] GET /compute/v2.1/servers/1ee42b60-a1c0-4b17-9aa4-01d216665df4 => generated 1317 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:32:49.013667 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-20dd6e3d-2e21-4cd2-847e-70d85ecb7ee1 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:32:49.013667 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-20dd6e3d-2e21-4cd2-847e-70d85ecb7ee1 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] [instance: 20760e77-fe67-4ebe-87f1-34d840495341] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:32:49.014464 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-20dd6e3d-2e21-4cd2-847e-70d85ecb7ee1 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:32:49.014978 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-20dd6e3d-2e21-4cd2-847e-70d85ecb7ee1 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:32:49.015867 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-20dd6e3d-2e21-4cd2-847e-70d85ecb7ee1 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:32:49.016383 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-20dd6e3d-2e21-4cd2-847e-70d85ecb7ee1 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:32:49.264761 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-20dd6e3d-2e21-4cd2-847e-70d85ecb7ee1 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1daf9a83b1d24033a3d4c0f531a4eb2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5336afdcf4aa4b46b0655432b7a1323c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:32:49.274138 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-20dd6e3d-2e21-4cd2-847e-70d85ecb7ee1 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] 10.222.0.78 "GET /compute/v2.1/servers/20760e77-fe67-4ebe-87f1-34d840495341" status: 200 len: 1555 microversion: 2.1 time: 0.272388 Feb 17 04:32:49.274747 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 340/666] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:32:49 2021] GET /compute/v2.1/servers/20760e77-fe67-4ebe-87f1-34d840495341 => generated 1555 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:32:49.280161 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-d144263a-a262-4a92-9dc5-b3ef989f7f63 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:32:49.280798 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-d144263a-a262-4a92-9dc5-b3ef989f7f63 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] [instance: 1ee42b60-a1c0-4b17-9aa4-01d216665df4] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:32:49.288519 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-d144263a-a262-4a92-9dc5-b3ef989f7f63 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:32:49.289020 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-d144263a-a262-4a92-9dc5-b3ef989f7f63 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:32:49.289892 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-d144263a-a262-4a92-9dc5-b3ef989f7f63 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:32:49.290379 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-d144263a-a262-4a92-9dc5-b3ef989f7f63 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:32:49.519710 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-d144263a-a262-4a92-9dc5-b3ef989f7f63 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d68d4a6c12e4331b8df8191cdd7a669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2a1ca6347d4278899a1cc009d87d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:32:49.529411 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-d144263a-a262-4a92-9dc5-b3ef989f7f63 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] 10.222.0.78 "GET /compute/v2.1/servers/1ee42b60-a1c0-4b17-9aa4-01d216665df4" status: 200 len: 1317 microversion: 2.1 time: 0.253546 Feb 17 04:32:49.530364 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 341/667] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:32:49 2021] GET /compute/v2.1/servers/1ee42b60-a1c0-4b17-9aa4-01d216665df4 => generated 1317 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:32:49.773672 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-7e65e042-f029-47da-b467-d1840db18c5a tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "POST /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529/action" status: 200 len: 28650 microversion: 2.1 time: 3.368302 Feb 17 04:32:49.774582 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 327/668] 10.222.0.78 () {60 vars in 1268 bytes} [Wed Feb 17 04:32:46 2021] POST /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529/action => generated 28650 bytes in 3370 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 17 04:32:50.293910 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-fe0c02a0-135d-4cad-860a-8a691b67f8fd tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:32:50.295253 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-fe0c02a0-135d-4cad-860a-8a691b67f8fd tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] [instance: 20760e77-fe67-4ebe-87f1-34d840495341] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:32:50.304316 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-fe0c02a0-135d-4cad-860a-8a691b67f8fd tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:32:50.305047 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-fe0c02a0-135d-4cad-860a-8a691b67f8fd tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:32:50.306120 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-fe0c02a0-135d-4cad-860a-8a691b67f8fd tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:32:50.306774 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-fe0c02a0-135d-4cad-860a-8a691b67f8fd tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:32:50.362970 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-cc26e108-af03-440e-8411-bf2c89b47b65 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1723407933", "imageRef": "b005ed36-a85a-4c46-ba22-9fa8c5ec62e5", "flavorRef": "452", "networks": [{"uuid": "b5f1ca89-bbfb-4608-86a7-7b5d61122317"}]}} {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:32:50.443826 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.network.neutron [None req-cc26e108-af03-440e-8411-bf2c89b47b65 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] validate_networks() for [('b5f1ca89-bbfb-4608-86a7-7b5d61122317', None, None, None)] {{(pid=98178) validate_networks /opt/stack/nova/nova/network/neutron.py:2345}} Feb 17 04:32:50.591587 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-fe0c02a0-135d-4cad-860a-8a691b67f8fd tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1daf9a83b1d24033a3d4c0f531a4eb2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5336afdcf4aa4b46b0655432b7a1323c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:32:50.601685 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-fe0c02a0-135d-4cad-860a-8a691b67f8fd tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] 10.222.0.78 "GET /compute/v2.1/servers/20760e77-fe67-4ebe-87f1-34d840495341" status: 200 len: 1555 microversion: 2.1 time: 0.312619 Feb 17 04:32:50.602524 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 342/669] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:32:50 2021] GET /compute/v2.1/servers/20760e77-fe67-4ebe-87f1-34d840495341 => generated 1555 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:32:50.608656 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-e34309d7-b871-4b5c-9a8b-5aaf06b13a07 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:32:50.610451 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-e34309d7-b871-4b5c-9a8b-5aaf06b13a07 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] [instance: 1ee42b60-a1c0-4b17-9aa4-01d216665df4] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:32:50.624224 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-e34309d7-b871-4b5c-9a8b-5aaf06b13a07 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:32:50.624748 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-e34309d7-b871-4b5c-9a8b-5aaf06b13a07 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:32:50.625612 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-e34309d7-b871-4b5c-9a8b-5aaf06b13a07 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:32:50.626120 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-e34309d7-b871-4b5c-9a8b-5aaf06b13a07 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:32:50.847416 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-e34309d7-b871-4b5c-9a8b-5aaf06b13a07 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d68d4a6c12e4331b8df8191cdd7a669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2a1ca6347d4278899a1cc009d87d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:32:50.869767 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-e34309d7-b871-4b5c-9a8b-5aaf06b13a07 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] 10.222.0.78 "GET /compute/v2.1/servers/1ee42b60-a1c0-4b17-9aa4-01d216665df4" status: 200 len: 1317 microversion: 2.1 time: 0.265867 Feb 17 04:32:50.874962 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 343/670] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:32:50 2021] GET /compute/v2.1/servers/1ee42b60-a1c0-4b17-9aa4-01d216665df4 => generated 1317 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:32:50.879745 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-dffd1730-6e2c-4e68-add6-f047813b5db9 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:32:50.882410 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-dffd1730-6e2c-4e68-add6-f047813b5db9 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: 29d1ce27-f63b-4523-88be-55f65a6a2529] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:32:50.891062 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-dffd1730-6e2c-4e68-add6-f047813b5db9 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:32:50.891704 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-dffd1730-6e2c-4e68-add6-f047813b5db9 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:32:50.892683 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-dffd1730-6e2c-4e68-add6-f047813b5db9 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:32:50.893220 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-dffd1730-6e2c-4e68-add6-f047813b5db9 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:32:51.048329 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-dffd1730-6e2c-4e68-add6-f047813b5db9 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "POST /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529/action" status: 200 len: 28650 microversion: 2.1 time: 0.173768 Feb 17 04:32:51.050773 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 344/671] 10.222.0.78 () {60 vars in 1268 bytes} [Wed Feb 17 04:32:50 2021] POST /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529/action => generated 28650 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 04:32:51.623724 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-5f5fa8ab-301d-4818-ad28-b5d1a2e7c274 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:32:51.624455 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-5f5fa8ab-301d-4818-ad28-b5d1a2e7c274 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] [instance: 20760e77-fe67-4ebe-87f1-34d840495341] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:32:51.634770 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-5f5fa8ab-301d-4818-ad28-b5d1a2e7c274 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:32:51.635567 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-5f5fa8ab-301d-4818-ad28-b5d1a2e7c274 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:32:51.637067 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-5f5fa8ab-301d-4818-ad28-b5d1a2e7c274 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:32:51.637570 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-5f5fa8ab-301d-4818-ad28-b5d1a2e7c274 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:32:51.878315 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-5f5fa8ab-301d-4818-ad28-b5d1a2e7c274 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1daf9a83b1d24033a3d4c0f531a4eb2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5336afdcf4aa4b46b0655432b7a1323c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:32:51.888816 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-5f5fa8ab-301d-4818-ad28-b5d1a2e7c274 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] 10.222.0.78 "GET /compute/v2.1/servers/20760e77-fe67-4ebe-87f1-34d840495341" status: 200 len: 1555 microversion: 2.1 time: 0.271395 Feb 17 04:32:51.889431 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 345/672] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:32:51 2021] GET /compute/v2.1/servers/20760e77-fe67-4ebe-87f1-34d840495341 => generated 1555 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:32:51.894314 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-769f6285-7e17-4ac5-b965-b6045ccace22 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:32:51.894986 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-769f6285-7e17-4ac5-b965-b6045ccace22 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] [instance: 1ee42b60-a1c0-4b17-9aa4-01d216665df4] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:32:51.904284 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-769f6285-7e17-4ac5-b965-b6045ccace22 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:32:51.904803 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-769f6285-7e17-4ac5-b965-b6045ccace22 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:32:51.905939 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-769f6285-7e17-4ac5-b965-b6045ccace22 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:32:51.906490 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-769f6285-7e17-4ac5-b965-b6045ccace22 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:32:52.026140 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.virt.hardware [None req-cc26e108-af03-440e-8411-bf2c89b47b65 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Flavor limits 0:0:0 {{(pid=98178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 17 04:32:52.026621 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.virt.hardware [None req-cc26e108-af03-440e-8411-bf2c89b47b65 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Image limits 0:0:0 {{(pid=98178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Feb 17 04:32:52.028613 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.virt.hardware [None req-cc26e108-af03-440e-8411-bf2c89b47b65 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Flavor pref 0:0:0 {{(pid=98178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 17 04:32:52.029116 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.virt.hardware [None req-cc26e108-af03-440e-8411-bf2c89b47b65 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Image pref 0:0:0 {{(pid=98178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Feb 17 04:32:52.029812 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.virt.hardware [None req-cc26e108-af03-440e-8411-bf2c89b47b65 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Feb 17 04:32:52.039321 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-cc26e108-af03-440e-8411-bf2c89b47b65 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:32:52.040195 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-cc26e108-af03-440e-8411-bf2c89b47b65 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:32:52.041092 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-cc26e108-af03-440e-8411-bf2c89b47b65 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:32:52.041593 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-cc26e108-af03-440e-8411-bf2c89b47b65 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:32:52.064143 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.quota [None req-cc26e108-af03-440e-8411-bf2c89b47b65 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Getting quotas for project 440d4048a9ad43869a00218c7acb9614. Resources: {'ram', 'cores', 'instances'} {{(pid=98178) _get_quotas /opt/stack/nova/nova/quota.py:388}} Feb 17 04:32:52.068468 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.quota [None req-cc26e108-af03-440e-8411-bf2c89b47b65 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Getting quotas for user 9b4f65f82a97499dbb900d523924e946 and project 440d4048a9ad43869a00218c7acb9614. Resources: {'ram', 'cores', 'instances'} {{(pid=98178) _get_quotas /opt/stack/nova/nova/quota.py:380}} Feb 17 04:32:52.081083 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-cc26e108-af03-440e-8411-bf2c89b47b65 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Going to run 1 instances... {{(pid=98178) _provision_instances /opt/stack/nova/nova/compute/api.py:1264}} Feb 17 04:32:52.083998 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-cc26e108-af03-440e-8411-bf2c89b47b65 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] [instance: c115a692-885c-492c-a345-4bda25cab425] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b005ed36-a85a-4c46-ba22-9fa8c5ec62e5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98178) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1666}} Feb 17 04:32:52.168541 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-cc26e108-af03-440e-8411-bf2c89b47b65 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.809418 Feb 17 04:32:52.169283 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 328/673] 10.222.0.78 () {60 vars in 1137 bytes} [Wed Feb 17 04:32:50 2021] POST /compute/v2.1/servers => generated 380 bytes in 1812 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 17 04:32:52.175081 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-826d4aba-1363-4e22-b6e6-6666ae8f1f15 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:32:52.175352 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-826d4aba-1363-4e22-b6e6-6666ae8f1f15 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: 29d1ce27-f63b-4523-88be-55f65a6a2529] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:32:52.195420 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-826d4aba-1363-4e22-b6e6-6666ae8f1f15 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:32:52.196256 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-826d4aba-1363-4e22-b6e6-6666ae8f1f15 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:32:52.197126 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-826d4aba-1363-4e22-b6e6-6666ae8f1f15 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:32:52.197627 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-826d4aba-1363-4e22-b6e6-6666ae8f1f15 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:32:52.390169 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-769f6285-7e17-4ac5-b965-b6045ccace22 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d68d4a6c12e4331b8df8191cdd7a669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2a1ca6347d4278899a1cc009d87d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:32:52.404649 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-769f6285-7e17-4ac5-b965-b6045ccace22 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] 10.222.0.78 "GET /compute/v2.1/servers/1ee42b60-a1c0-4b17-9aa4-01d216665df4" status: 200 len: 1317 microversion: 2.1 time: 0.513991 Feb 17 04:32:52.414811 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 346/674] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:32:51 2021] GET /compute/v2.1/servers/1ee42b60-a1c0-4b17-9aa4-01d216665df4 => generated 1317 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:32:52.414811 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-5cb763ec-f13b-42ac-9548-f62c63e43042 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:32:52.414811 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-5cb763ec-f13b-42ac-9548-f62c63e43042 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] [instance: c115a692-885c-492c-a345-4bda25cab425] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:32:52.542001 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-826d4aba-1363-4e22-b6e6-6666ae8f1f15 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "POST /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529/action" status: 200 len: 28650 microversion: 2.1 time: 0.371328 Feb 17 04:32:52.543798 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 329/675] 10.222.0.78 () {60 vars in 1268 bytes} [Wed Feb 17 04:32:52 2021] POST /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529/action => generated 28650 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 04:32:52.553238 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-5cb763ec-f13b-42ac-9548-f62c63e43042 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b4f65f82a97499dbb900d523924e946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440d4048a9ad43869a00218c7acb9614', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:32:52.563716 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-5cb763ec-f13b-42ac-9548-f62c63e43042 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] 10.222.0.78 "GET /compute/v2.1/servers/c115a692-885c-492c-a345-4bda25cab425" status: 200 len: 1219 microversion: 2.1 time: 0.156392 Feb 17 04:32:52.564559 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 347/676] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:32:52 2021] GET /compute/v2.1/servers/c115a692-885c-492c-a345-4bda25cab425 => generated 1219 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:32:52.889599 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [req-87fef960-1d2d-4106-aeef-6510d697b0ac req-6cd2cc14-7e34-497e-8c4a-a6faa8e66727 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ee42b60-a1c0-4b17-9aa4-01d216665df4", "name": "network-vif-plugged", "status": "completed", "tag": "f38915de-2eaf-408a-aefc-2ed6e07dc1dd"}]} {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:32:52.891284 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:32:52.891284 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: warnings.warn(msg) Feb 17 04:32:52.901327 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [req-87fef960-1d2d-4106-aeef-6510d697b0ac req-6cd2cc14-7e34-497e-8c4a-a6faa8e66727 service nova] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:32:52.902706 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [req-87fef960-1d2d-4106-aeef-6510d697b0ac req-6cd2cc14-7e34-497e-8c4a-a6faa8e66727 service nova] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:32:52.908110 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-6905c82f-7cbc-4fd3-a64f-291a3cc0e793 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:32:52.909073 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-6905c82f-7cbc-4fd3-a64f-291a3cc0e793 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] [instance: 20760e77-fe67-4ebe-87f1-34d840495341] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:32:52.923800 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-6905c82f-7cbc-4fd3-a64f-291a3cc0e793 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:32:52.927607 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-6905c82f-7cbc-4fd3-a64f-291a3cc0e793 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:32:52.928795 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-6905c82f-7cbc-4fd3-a64f-291a3cc0e793 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:32:52.936163 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-6905c82f-7cbc-4fd3-a64f-291a3cc0e793 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:32:52.973229 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.compute.server_external_events [req-87fef960-1d2d-4106-aeef-6510d697b0ac req-6cd2cc14-7e34-497e-8c4a-a6faa8e66727 service nova] Creating event network-vif-plugged:f38915de-2eaf-408a-aefc-2ed6e07dc1dd for instance 1ee42b60-a1c0-4b17-9aa4-01d216665df4 on hv-cinder-75998 Feb 17 04:32:52.985655 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [req-87fef960-1d2d-4106-aeef-6510d697b0ac req-6cd2cc14-7e34-497e-8c4a-a6faa8e66727 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100779 Feb 17 04:32:52.987216 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 330/677] 10.222.0.78 () {64 vars in 1308 bytes} [Wed Feb 17 04:32:52 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 17 04:32:53.245170 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-6905c82f-7cbc-4fd3-a64f-291a3cc0e793 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1daf9a83b1d24033a3d4c0f531a4eb2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5336afdcf4aa4b46b0655432b7a1323c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:32:53.255919 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-6905c82f-7cbc-4fd3-a64f-291a3cc0e793 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] 10.222.0.78 "GET /compute/v2.1/servers/20760e77-fe67-4ebe-87f1-34d840495341" status: 200 len: 1555 microversion: 2.1 time: 0.351571 Feb 17 04:32:53.273379 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 348/678] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:32:52 2021] GET /compute/v2.1/servers/20760e77-fe67-4ebe-87f1-34d840495341 => generated 1555 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:32:53.424570 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-c41898c8-60f5-423a-b92a-8587ee4cb350 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:32:53.426034 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-c41898c8-60f5-423a-b92a-8587ee4cb350 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] [instance: 1ee42b60-a1c0-4b17-9aa4-01d216665df4] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:32:53.434836 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-c41898c8-60f5-423a-b92a-8587ee4cb350 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:32:53.435463 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-c41898c8-60f5-423a-b92a-8587ee4cb350 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:32:53.436537 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-c41898c8-60f5-423a-b92a-8587ee4cb350 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:32:53.437246 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-c41898c8-60f5-423a-b92a-8587ee4cb350 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:32:53.555619 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-68dc13dc-a253-4409-a721-4346122e777b tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:32:53.556739 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-68dc13dc-a253-4409-a721-4346122e777b tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: 29d1ce27-f63b-4523-88be-55f65a6a2529] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:32:53.575343 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-68dc13dc-a253-4409-a721-4346122e777b tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:32:53.576132 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-68dc13dc-a253-4409-a721-4346122e777b tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:32:53.576682 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-68dc13dc-a253-4409-a721-4346122e777b tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:32:53.577171 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-68dc13dc-a253-4409-a721-4346122e777b tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:32:53.880286 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-68dc13dc-a253-4409-a721-4346122e777b tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "POST /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529/action" status: 200 len: 28650 microversion: 2.1 time: 0.328066 Feb 17 04:32:53.881011 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 349/679] 10.222.0.78 () {60 vars in 1268 bytes} [Wed Feb 17 04:32:53 2021] POST /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529/action => generated 28650 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 04:32:53.891503 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-967457f2-3529-465f-9f10-c0d3c40a1688 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:32:53.892288 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-967457f2-3529-465f-9f10-c0d3c40a1688 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] [instance: c115a692-885c-492c-a345-4bda25cab425] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:32:53.902388 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-967457f2-3529-465f-9f10-c0d3c40a1688 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:32:53.903477 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-967457f2-3529-465f-9f10-c0d3c40a1688 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:32:53.904443 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-967457f2-3529-465f-9f10-c0d3c40a1688 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:32:53.905156 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-967457f2-3529-465f-9f10-c0d3c40a1688 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:32:54.061124 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-967457f2-3529-465f-9f10-c0d3c40a1688 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b4f65f82a97499dbb900d523924e946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440d4048a9ad43869a00218c7acb9614', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:32:54.083611 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-967457f2-3529-465f-9f10-c0d3c40a1688 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] 10.222.0.78 "GET /compute/v2.1/servers/c115a692-885c-492c-a345-4bda25cab425" status: 200 len: 1279 microversion: 2.1 time: 0.194495 Feb 17 04:32:54.088255 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 350/680] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:32:53 2021] GET /compute/v2.1/servers/c115a692-885c-492c-a345-4bda25cab425 => generated 1279 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:32:54.282600 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-76a1e045-edd6-4469-9894-d831157fbb3d tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:32:54.283312 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-76a1e045-edd6-4469-9894-d831157fbb3d tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] [instance: 20760e77-fe67-4ebe-87f1-34d840495341] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:32:54.295556 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-76a1e045-edd6-4469-9894-d831157fbb3d tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:32:54.296070 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-76a1e045-edd6-4469-9894-d831157fbb3d tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:32:54.296901 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-76a1e045-edd6-4469-9894-d831157fbb3d tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:32:54.297573 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-76a1e045-edd6-4469-9894-d831157fbb3d tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:32:54.488862 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-c41898c8-60f5-423a-b92a-8587ee4cb350 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d68d4a6c12e4331b8df8191cdd7a669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2a1ca6347d4278899a1cc009d87d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:32:54.503360 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-c41898c8-60f5-423a-b92a-8587ee4cb350 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] 10.222.0.78 "GET /compute/v2.1/servers/1ee42b60-a1c0-4b17-9aa4-01d216665df4" status: 200 len: 1317 microversion: 2.1 time: 1.083095 Feb 17 04:32:54.512524 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 331/681] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:32:53 2021] GET /compute/v2.1/servers/1ee42b60-a1c0-4b17-9aa4-01d216665df4 => generated 1317 bytes in 1093 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:32:54.532952 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-76a1e045-edd6-4469-9894-d831157fbb3d tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1daf9a83b1d24033a3d4c0f531a4eb2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5336afdcf4aa4b46b0655432b7a1323c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:32:54.544507 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-76a1e045-edd6-4469-9894-d831157fbb3d tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] 10.222.0.78 "GET /compute/v2.1/servers/20760e77-fe67-4ebe-87f1-34d840495341" status: 200 len: 1555 microversion: 2.1 time: 0.269085 Feb 17 04:32:54.545346 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 351/682] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:32:54 2021] GET /compute/v2.1/servers/20760e77-fe67-4ebe-87f1-34d840495341 => generated 1555 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:32:54.893735 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-996ac583-682b-4cf6-a683-db0c4a41aff8 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:32:54.895490 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-996ac583-682b-4cf6-a683-db0c4a41aff8 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: 29d1ce27-f63b-4523-88be-55f65a6a2529] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:32:54.905841 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-996ac583-682b-4cf6-a683-db0c4a41aff8 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:32:54.906659 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-996ac583-682b-4cf6-a683-db0c4a41aff8 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:32:54.907767 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-996ac583-682b-4cf6-a683-db0c4a41aff8 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:32:54.908464 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-996ac583-682b-4cf6-a683-db0c4a41aff8 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:32:55.106928 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-5fd58175-7432-41ce-984f-fd7c9bd90963 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:32:55.108000 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-5fd58175-7432-41ce-984f-fd7c9bd90963 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] [instance: c115a692-885c-492c-a345-4bda25cab425] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:32:55.117249 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-5fd58175-7432-41ce-984f-fd7c9bd90963 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:32:55.118102 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-5fd58175-7432-41ce-984f-fd7c9bd90963 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:32:55.119257 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-5fd58175-7432-41ce-984f-fd7c9bd90963 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:32:55.119966 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-5fd58175-7432-41ce-984f-fd7c9bd90963 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:32:55.297546 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-996ac583-682b-4cf6-a683-db0c4a41aff8 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "POST /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529/action" status: 200 len: 28650 microversion: 2.1 time: 0.407669 Feb 17 04:32:55.299884 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 332/683] 10.222.0.78 () {60 vars in 1268 bytes} [Wed Feb 17 04:32:54 2021] POST /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529/action => generated 28650 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 04:32:55.506673 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-5fd58175-7432-41ce-984f-fd7c9bd90963 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b4f65f82a97499dbb900d523924e946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440d4048a9ad43869a00218c7acb9614', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:32:55.517818 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-5fd58175-7432-41ce-984f-fd7c9bd90963 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] 10.222.0.78 "GET /compute/v2.1/servers/c115a692-885c-492c-a345-4bda25cab425" status: 200 len: 1277 microversion: 2.1 time: 0.415481 Feb 17 04:32:55.519093 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 352/684] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:32:55 2021] GET /compute/v2.1/servers/c115a692-885c-492c-a345-4bda25cab425 => generated 1277 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:32:55.522568 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-addae2d0-4d8f-4a43-9e8c-c39740ba6b98 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:32:55.523377 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-addae2d0-4d8f-4a43-9e8c-c39740ba6b98 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] [instance: 1ee42b60-a1c0-4b17-9aa4-01d216665df4] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:32:55.540175 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-addae2d0-4d8f-4a43-9e8c-c39740ba6b98 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:32:55.541006 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-addae2d0-4d8f-4a43-9e8c-c39740ba6b98 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:32:55.542056 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-addae2d0-4d8f-4a43-9e8c-c39740ba6b98 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:32:55.543482 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-addae2d0-4d8f-4a43-9e8c-c39740ba6b98 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:32:55.562495 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-ab8b4749-7980-400b-9fe6-3ece5a1dfc4d tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:32:55.563196 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-ab8b4749-7980-400b-9fe6-3ece5a1dfc4d tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] [instance: 20760e77-fe67-4ebe-87f1-34d840495341] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:32:55.577962 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-ab8b4749-7980-400b-9fe6-3ece5a1dfc4d tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:32:55.578469 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-ab8b4749-7980-400b-9fe6-3ece5a1dfc4d tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:32:55.579348 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-ab8b4749-7980-400b-9fe6-3ece5a1dfc4d tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:32:55.583957 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-ab8b4749-7980-400b-9fe6-3ece5a1dfc4d tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:32:55.952251 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-ab8b4749-7980-400b-9fe6-3ece5a1dfc4d tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1daf9a83b1d24033a3d4c0f531a4eb2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5336afdcf4aa4b46b0655432b7a1323c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:32:55.963687 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-ab8b4749-7980-400b-9fe6-3ece5a1dfc4d tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] 10.222.0.78 "GET /compute/v2.1/servers/20760e77-fe67-4ebe-87f1-34d840495341" status: 200 len: 1555 microversion: 2.1 time: 0.405330 Feb 17 04:32:55.965656 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 353/685] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:32:55 2021] GET /compute/v2.1/servers/20760e77-fe67-4ebe-87f1-34d840495341 => generated 1555 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:32:56.009652 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-addae2d0-4d8f-4a43-9e8c-c39740ba6b98 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d68d4a6c12e4331b8df8191cdd7a669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2a1ca6347d4278899a1cc009d87d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:32:56.021283 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-addae2d0-4d8f-4a43-9e8c-c39740ba6b98 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] 10.222.0.78 "GET /compute/v2.1/servers/1ee42b60-a1c0-4b17-9aa4-01d216665df4" status: 200 len: 1317 microversion: 2.1 time: 0.503090 Feb 17 04:32:56.023018 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 333/686] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:32:55 2021] GET /compute/v2.1/servers/1ee42b60-a1c0-4b17-9aa4-01d216665df4 => generated 1317 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:32:56.312421 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-4631c13b-ee43-4616-8c3a-2dbcb39f23ec tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:32:56.314849 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-4631c13b-ee43-4616-8c3a-2dbcb39f23ec tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: 29d1ce27-f63b-4523-88be-55f65a6a2529] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:32:56.327971 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-4631c13b-ee43-4616-8c3a-2dbcb39f23ec tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:32:56.328791 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-4631c13b-ee43-4616-8c3a-2dbcb39f23ec tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:32:56.330588 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-4631c13b-ee43-4616-8c3a-2dbcb39f23ec tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:32:56.331704 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-4631c13b-ee43-4616-8c3a-2dbcb39f23ec tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:32:56.539290 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-8a2d6f01-53a1-4b90-a65f-159c9df76f87 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:32:56.540352 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-8a2d6f01-53a1-4b90-a65f-159c9df76f87 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] [instance: c115a692-885c-492c-a345-4bda25cab425] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:32:56.546567 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-4631c13b-ee43-4616-8c3a-2dbcb39f23ec tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "POST /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529/action" status: 200 len: 28650 microversion: 2.1 time: 0.239943 Feb 17 04:32:56.547994 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 354/687] 10.222.0.78 () {60 vars in 1268 bytes} [Wed Feb 17 04:32:56 2021] POST /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529/action => generated 28650 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 04:32:56.552421 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-8a2d6f01-53a1-4b90-a65f-159c9df76f87 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:32:56.553287 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-8a2d6f01-53a1-4b90-a65f-159c9df76f87 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:32:56.554636 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-8a2d6f01-53a1-4b90-a65f-159c9df76f87 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:32:56.555402 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-8a2d6f01-53a1-4b90-a65f-159c9df76f87 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:32:56.984893 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-2082f457-ce54-4ebd-9ebb-44c370472d14 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:32:56.985741 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-2082f457-ce54-4ebd-9ebb-44c370472d14 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] [instance: 20760e77-fe67-4ebe-87f1-34d840495341] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:32:56.999707 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-2082f457-ce54-4ebd-9ebb-44c370472d14 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:32:57.000639 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-2082f457-ce54-4ebd-9ebb-44c370472d14 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:32:57.001668 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-2082f457-ce54-4ebd-9ebb-44c370472d14 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:32:57.002263 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-2082f457-ce54-4ebd-9ebb-44c370472d14 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:32:57.374111 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-8a2d6f01-53a1-4b90-a65f-159c9df76f87 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b4f65f82a97499dbb900d523924e946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440d4048a9ad43869a00218c7acb9614', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:32:57.391567 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-8a2d6f01-53a1-4b90-a65f-159c9df76f87 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] 10.222.0.78 "GET /compute/v2.1/servers/c115a692-885c-492c-a345-4bda25cab425" status: 200 len: 1319 microversion: 2.1 time: 0.856324 Feb 17 04:32:57.396435 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 334/688] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:32:56 2021] GET /compute/v2.1/servers/c115a692-885c-492c-a345-4bda25cab425 => generated 1319 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:32:57.404375 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-77187046-d689-4038-9fa6-e19c0856d605 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:32:57.411490 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-77187046-d689-4038-9fa6-e19c0856d605 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] [instance: 1ee42b60-a1c0-4b17-9aa4-01d216665df4] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:32:57.430168 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-77187046-d689-4038-9fa6-e19c0856d605 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:32:57.436400 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-77187046-d689-4038-9fa6-e19c0856d605 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:32:57.437584 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-77187046-d689-4038-9fa6-e19c0856d605 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:32:57.438218 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-77187046-d689-4038-9fa6-e19c0856d605 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:32:57.648148 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-2082f457-ce54-4ebd-9ebb-44c370472d14 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1daf9a83b1d24033a3d4c0f531a4eb2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5336afdcf4aa4b46b0655432b7a1323c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:32:57.664646 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-2082f457-ce54-4ebd-9ebb-44c370472d14 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] 10.222.0.78 "GET /compute/v2.1/servers/20760e77-fe67-4ebe-87f1-34d840495341" status: 200 len: 1555 microversion: 2.1 time: 0.685033 Feb 17 04:32:57.665608 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 355/689] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:32:56 2021] GET /compute/v2.1/servers/20760e77-fe67-4ebe-87f1-34d840495341 => generated 1555 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:32:57.670688 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-1b838920-072d-4690-b64c-73c9188885b1 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:32:57.671926 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-1b838920-072d-4690-b64c-73c9188885b1 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: 29d1ce27-f63b-4523-88be-55f65a6a2529] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:32:57.685010 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-1b838920-072d-4690-b64c-73c9188885b1 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:32:57.685545 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-1b838920-072d-4690-b64c-73c9188885b1 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:32:57.686436 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-1b838920-072d-4690-b64c-73c9188885b1 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:32:57.686939 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-1b838920-072d-4690-b64c-73c9188885b1 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:32:57.868141 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-1b838920-072d-4690-b64c-73c9188885b1 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "POST /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529/action" status: 200 len: 28650 microversion: 2.1 time: 0.201041 Feb 17 04:32:57.869196 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 356/690] 10.222.0.78 () {60 vars in 1268 bytes} [Wed Feb 17 04:32:57 2021] POST /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529/action => generated 28650 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 04:32:58.079864 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-77187046-d689-4038-9fa6-e19c0856d605 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d68d4a6c12e4331b8df8191cdd7a669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2a1ca6347d4278899a1cc009d87d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:32:58.102324 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-77187046-d689-4038-9fa6-e19c0856d605 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] 10.222.0.78 "GET /compute/v2.1/servers/1ee42b60-a1c0-4b17-9aa4-01d216665df4" status: 200 len: 1508 microversion: 2.1 time: 0.704532 Feb 17 04:32:58.103201 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 335/691] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:32:57 2021] GET /compute/v2.1/servers/1ee42b60-a1c0-4b17-9aa4-01d216665df4 => generated 1508 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:32:58.411955 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-683ecc5a-d396-4d34-8b1b-d899dffa387e tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:32:58.413016 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-683ecc5a-d396-4d34-8b1b-d899dffa387e tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] [instance: c115a692-885c-492c-a345-4bda25cab425] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:32:58.447764 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-683ecc5a-d396-4d34-8b1b-d899dffa387e tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:32:58.448415 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-683ecc5a-d396-4d34-8b1b-d899dffa387e tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:32:58.450089 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-683ecc5a-d396-4d34-8b1b-d899dffa387e tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:32:58.450666 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-683ecc5a-d396-4d34-8b1b-d899dffa387e tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:32:58.682186 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-b047feb8-633d-46b9-9c34-55b1057670ab tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:32:58.683379 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-b047feb8-633d-46b9-9c34-55b1057670ab tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] [instance: 20760e77-fe67-4ebe-87f1-34d840495341] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:32:58.706392 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-b047feb8-633d-46b9-9c34-55b1057670ab tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:32:58.711219 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-b047feb8-633d-46b9-9c34-55b1057670ab tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:32:58.712509 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-b047feb8-633d-46b9-9c34-55b1057670ab tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:32:58.713217 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-b047feb8-633d-46b9-9c34-55b1057670ab tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:32:58.892318 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-683ecc5a-d396-4d34-8b1b-d899dffa387e tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b4f65f82a97499dbb900d523924e946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440d4048a9ad43869a00218c7acb9614', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:32:58.924160 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-683ecc5a-d396-4d34-8b1b-d899dffa387e tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] 10.222.0.78 "GET /compute/v2.1/servers/c115a692-885c-492c-a345-4bda25cab425" status: 200 len: 1319 microversion: 2.1 time: 0.517813 Feb 17 04:32:58.925126 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 357/692] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:32:58 2021] GET /compute/v2.1/servers/c115a692-885c-492c-a345-4bda25cab425 => generated 1319 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:32:58.940112 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-46b5cdec-29c2-4840-bbd5-40ec59899ad3 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:32:58.941195 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-46b5cdec-29c2-4840-bbd5-40ec59899ad3 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: 29d1ce27-f63b-4523-88be-55f65a6a2529] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:32:58.972810 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-46b5cdec-29c2-4840-bbd5-40ec59899ad3 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:32:58.973324 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-46b5cdec-29c2-4840-bbd5-40ec59899ad3 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:32:58.974187 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-46b5cdec-29c2-4840-bbd5-40ec59899ad3 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:32:58.974690 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-46b5cdec-29c2-4840-bbd5-40ec59899ad3 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:32:59.109011 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-b047feb8-633d-46b9-9c34-55b1057670ab tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1daf9a83b1d24033a3d4c0f531a4eb2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5336afdcf4aa4b46b0655432b7a1323c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:32:59.123446 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-b047feb8-633d-46b9-9c34-55b1057670ab tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] 10.222.0.78 "GET /compute/v2.1/servers/20760e77-fe67-4ebe-87f1-34d840495341" status: 200 len: 1561 microversion: 2.1 time: 0.445355 Feb 17 04:32:59.131451 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 336/693] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:32:58 2021] GET /compute/v2.1/servers/20760e77-fe67-4ebe-87f1-34d840495341 => generated 1561 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:32:59.136752 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [req-91e14f81-b3f4-48b5-9bc0-92b5d9a7d15b req-f19b37c3-33c2-4822-aaf9-2697da637a69 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c115a692-885c-492c-a345-4bda25cab425", "tag": "3b5d6b78-08fe-4167-befa-eaa4e9d6c970"}]} {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:32:59.160313 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:32:59.160313 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: warnings.warn(msg) Feb 17 04:32:59.181907 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [req-91e14f81-b3f4-48b5-9bc0-92b5d9a7d15b req-f19b37c3-33c2-4822-aaf9-2697da637a69 service nova] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:32:59.183459 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [req-91e14f81-b3f4-48b5-9bc0-92b5d9a7d15b req-f19b37c3-33c2-4822-aaf9-2697da637a69 service nova] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:32:59.225558 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.compute.server_external_events [req-91e14f81-b3f4-48b5-9bc0-92b5d9a7d15b req-f19b37c3-33c2-4822-aaf9-2697da637a69 service nova] Creating event network-changed:3b5d6b78-08fe-4167-befa-eaa4e9d6c970 for instance c115a692-885c-492c-a345-4bda25cab425 on hv-cinder-75998 Feb 17 04:32:59.233550 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [req-91e14f81-b3f4-48b5-9bc0-92b5d9a7d15b req-f19b37c3-33c2-4822-aaf9-2697da637a69 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100367 Feb 17 04:32:59.234518 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 337/694] 10.222.0.78 () {64 vars in 1308 bytes} [Wed Feb 17 04:32:59 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:32:59.234657 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-46b5cdec-29c2-4840-bbd5-40ec59899ad3 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "POST /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529/action" status: 200 len: 28650 microversion: 2.1 time: 0.293370 Feb 17 04:32:59.235657 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 358/695] 10.222.0.78 () {60 vars in 1268 bytes} [Wed Feb 17 04:32:58 2021] POST /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529/action => generated 28650 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 04:32:59.308300 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-1e393c0e-4507-4143-8684-83782b27875c tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:32:59.309012 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-1e393c0e-4507-4143-8684-83782b27875c tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] [instance: 20760e77-fe67-4ebe-87f1-34d840495341] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:32:59.318298 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-1e393c0e-4507-4143-8684-83782b27875c tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:32:59.318816 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-1e393c0e-4507-4143-8684-83782b27875c tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:32:59.319789 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-1e393c0e-4507-4143-8684-83782b27875c tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:32:59.320280 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-1e393c0e-4507-4143-8684-83782b27875c tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:32:59.519445 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.objects.instance [None req-1e393c0e-4507-4143-8684-83782b27875c tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lazy-loading 'services' on Instance uuid 20760e77-fe67-4ebe-87f1-34d840495341 {{(pid=98178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Feb 17 04:32:59.682066 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-1e393c0e-4507-4143-8684-83782b27875c tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] 10.222.0.78 "DELETE /compute/v2.1/servers/20760e77-fe67-4ebe-87f1-34d840495341/os-volume_attachments/89dc3d17-5108-44ee-9b6f-94e7d31c33af" status: 202 len: 0 microversion: 2.1 time: 0.382099 Feb 17 04:32:59.687066 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 338/696] 10.222.0.78 () {58 vars in 1406 bytes} [Wed Feb 17 04:32:59 2021] DELETE /compute/v2.1/servers/20760e77-fe67-4ebe-87f1-34d840495341/os-volume_attachments/89dc3d17-5108-44ee-9b6f-94e7d31c33af => generated 0 bytes in 388 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:32:59.942723 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-f271271d-666a-463e-9e87-9716a1e5a76a tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:32:59.943513 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-f271271d-666a-463e-9e87-9716a1e5a76a tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] [instance: c115a692-885c-492c-a345-4bda25cab425] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:32:59.955910 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-f271271d-666a-463e-9e87-9716a1e5a76a tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:32:59.956682 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-f271271d-666a-463e-9e87-9716a1e5a76a tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:32:59.957695 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-f271271d-666a-463e-9e87-9716a1e5a76a tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:32:59.958342 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-f271271d-666a-463e-9e87-9716a1e5a76a tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:00.206033 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-de11a792-1803-4372-b357-d972170582b8 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "695020b9-9dcf-490e-91ed-c6e4945929aa"}} {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:33:00.208141 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-de11a792-1803-4372-b357-d972170582b8 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] [instance: 1ee42b60-a1c0-4b17-9aa4-01d216665df4] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:33:00.218091 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-de11a792-1803-4372-b357-d972170582b8 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:00.218911 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-de11a792-1803-4372-b357-d972170582b8 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:00.220020 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-de11a792-1803-4372-b357-d972170582b8 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:00.220703 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-de11a792-1803-4372-b357-d972170582b8 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:00.341429 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-f271271d-666a-463e-9e87-9716a1e5a76a tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b4f65f82a97499dbb900d523924e946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440d4048a9ad43869a00218c7acb9614', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:33:00.360385 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-f271271d-666a-463e-9e87-9716a1e5a76a tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] 10.222.0.78 "GET /compute/v2.1/servers/c115a692-885c-492c-a345-4bda25cab425" status: 200 len: 1319 microversion: 2.1 time: 0.422117 Feb 17 04:33:00.361796 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 359/697] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:32:59 2021] GET /compute/v2.1/servers/c115a692-885c-492c-a345-4bda25cab425 => generated 1319 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:33:00.367351 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-866f6854-0331-4595-8d36-9764abf052a7 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:33:00.368655 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-866f6854-0331-4595-8d36-9764abf052a7 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: 29d1ce27-f63b-4523-88be-55f65a6a2529] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:33:00.377951 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-866f6854-0331-4595-8d36-9764abf052a7 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:00.378755 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-866f6854-0331-4595-8d36-9764abf052a7 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:00.379863 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-866f6854-0331-4595-8d36-9764abf052a7 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:00.380565 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-866f6854-0331-4595-8d36-9764abf052a7 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:00.945688 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-de11a792-1803-4372-b357-d972170582b8 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] 10.222.0.78 "POST /compute/v2.1/servers/1ee42b60-a1c0-4b17-9aa4-01d216665df4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.745354 Feb 17 04:33:00.953200 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 339/698] 10.222.0.78 () {60 vars in 1313 bytes} [Wed Feb 17 04:33:00 2021] POST /compute/v2.1/servers/1ee42b60-a1c0-4b17-9aa4-01d216665df4/os-volume_attachments => generated 194 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:33:00.969351 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-866f6854-0331-4595-8d36-9764abf052a7 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "POST /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529/action" status: 200 len: 28650 microversion: 2.1 time: 0.605947 Feb 17 04:33:00.970358 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 360/699] 10.222.0.78 () {60 vars in 1268 bytes} [Wed Feb 17 04:33:00 2021] POST /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529/action => generated 28650 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 04:33:01.397460 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-a1a52ac7-beb9-4915-a518-acb3c4031f29 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:33:01.409269 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-a1a52ac7-beb9-4915-a518-acb3c4031f29 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] [instance: c115a692-885c-492c-a345-4bda25cab425] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:33:01.440926 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-a1a52ac7-beb9-4915-a518-acb3c4031f29 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:01.444474 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-a1a52ac7-beb9-4915-a518-acb3c4031f29 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:01.448270 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-a1a52ac7-beb9-4915-a518-acb3c4031f29 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:01.449594 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-a1a52ac7-beb9-4915-a518-acb3c4031f29 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:01.790090 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-a1a52ac7-beb9-4915-a518-acb3c4031f29 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b4f65f82a97499dbb900d523924e946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440d4048a9ad43869a00218c7acb9614', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:33:01.810978 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-a1a52ac7-beb9-4915-a518-acb3c4031f29 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] 10.222.0.78 "GET /compute/v2.1/servers/c115a692-885c-492c-a345-4bda25cab425" status: 200 len: 1319 microversion: 2.1 time: 0.429922 Feb 17 04:33:01.812960 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 340/700] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:33:01 2021] GET /compute/v2.1/servers/c115a692-885c-492c-a345-4bda25cab425 => generated 1319 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:33:01.994690 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-81dc50e3-048f-4336-890d-2714bf350ce5 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:33:01.996860 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-81dc50e3-048f-4336-890d-2714bf350ce5 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: 29d1ce27-f63b-4523-88be-55f65a6a2529] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:33:02.023137 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-81dc50e3-048f-4336-890d-2714bf350ce5 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:02.026284 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-81dc50e3-048f-4336-890d-2714bf350ce5 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:02.030261 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-81dc50e3-048f-4336-890d-2714bf350ce5 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:02.030772 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-81dc50e3-048f-4336-890d-2714bf350ce5 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:02.313860 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-81dc50e3-048f-4336-890d-2714bf350ce5 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "POST /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529/action" status: 200 len: 28650 microversion: 2.1 time: 0.332086 Feb 17 04:33:02.317960 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 361/701] 10.222.0.78 () {60 vars in 1268 bytes} [Wed Feb 17 04:33:01 2021] POST /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529/action => generated 28650 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 04:33:02.833567 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-96570be9-7d72-478f-b137-13b22863119a tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:33:02.834493 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-96570be9-7d72-478f-b137-13b22863119a tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] [instance: c115a692-885c-492c-a345-4bda25cab425] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:33:02.844778 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-96570be9-7d72-478f-b137-13b22863119a tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:02.846646 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-96570be9-7d72-478f-b137-13b22863119a tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:02.850247 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-96570be9-7d72-478f-b137-13b22863119a tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:02.851052 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-96570be9-7d72-478f-b137-13b22863119a tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:03.193356 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-96570be9-7d72-478f-b137-13b22863119a tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b4f65f82a97499dbb900d523924e946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440d4048a9ad43869a00218c7acb9614', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:33:03.203680 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-96570be9-7d72-478f-b137-13b22863119a tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] 10.222.0.78 "GET /compute/v2.1/servers/c115a692-885c-492c-a345-4bda25cab425" status: 200 len: 1319 microversion: 2.1 time: 0.376951 Feb 17 04:33:03.205391 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 341/702] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:33:02 2021] GET /compute/v2.1/servers/c115a692-885c-492c-a345-4bda25cab425 => generated 1319 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:33:03.327505 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-01d35056-39b5-4843-aeea-055a7c9fac3a tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:33:03.329077 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-01d35056-39b5-4843-aeea-055a7c9fac3a tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: 29d1ce27-f63b-4523-88be-55f65a6a2529] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:33:03.343708 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-01d35056-39b5-4843-aeea-055a7c9fac3a tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:03.344591 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-01d35056-39b5-4843-aeea-055a7c9fac3a tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:03.345735 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-01d35056-39b5-4843-aeea-055a7c9fac3a tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:03.346471 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-01d35056-39b5-4843-aeea-055a7c9fac3a tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:03.517682 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-01d35056-39b5-4843-aeea-055a7c9fac3a tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "POST /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529/action" status: 200 len: 28650 microversion: 2.1 time: 0.194616 Feb 17 04:33:03.518932 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 362/703] 10.222.0.78 () {60 vars in 1268 bytes} [Wed Feb 17 04:33:03 2021] POST /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529/action => generated 28650 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 04:33:04.223892 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-8d928b82-bb3e-40bf-a77d-3e59700ecdce tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:33:04.225856 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-8d928b82-bb3e-40bf-a77d-3e59700ecdce tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] [instance: c115a692-885c-492c-a345-4bda25cab425] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:33:04.242979 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-8d928b82-bb3e-40bf-a77d-3e59700ecdce tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:04.243773 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-8d928b82-bb3e-40bf-a77d-3e59700ecdce tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:04.244816 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-8d928b82-bb3e-40bf-a77d-3e59700ecdce tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:04.250021 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-8d928b82-bb3e-40bf-a77d-3e59700ecdce tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:04.515668 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-8d928b82-bb3e-40bf-a77d-3e59700ecdce tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b4f65f82a97499dbb900d523924e946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440d4048a9ad43869a00218c7acb9614', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:33:04.530987 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-d8a89985-b6a4-4ad9-8159-780703179e8b tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:33:04.532208 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-d8a89985-b6a4-4ad9-8159-780703179e8b tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: 29d1ce27-f63b-4523-88be-55f65a6a2529] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:33:04.539546 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-8d928b82-bb3e-40bf-a77d-3e59700ecdce tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] 10.222.0.78 "GET /compute/v2.1/servers/c115a692-885c-492c-a345-4bda25cab425" status: 200 len: 1319 microversion: 2.1 time: 0.320154 Feb 17 04:33:04.546662 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-d8a89985-b6a4-4ad9-8159-780703179e8b tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:04.558176 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 342/704] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:33:04 2021] GET /compute/v2.1/servers/c115a692-885c-492c-a345-4bda25cab425 => generated 1319 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:33:04.562344 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-d8a89985-b6a4-4ad9-8159-780703179e8b tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:04.563614 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-d8a89985-b6a4-4ad9-8159-780703179e8b tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:04.564315 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-d8a89985-b6a4-4ad9-8159-780703179e8b tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:04.746723 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-d8a89985-b6a4-4ad9-8159-780703179e8b tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "POST /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529/action" status: 200 len: 28650 microversion: 2.1 time: 0.220155 Feb 17 04:33:04.748356 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 363/705] 10.222.0.78 () {60 vars in 1268 bytes} [Wed Feb 17 04:33:04 2021] POST /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529/action => generated 28650 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 04:33:05.060574 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-a44dee87-82a6-4a88-96af-5d5f18a0ca3e tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:33:05.061136 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-a44dee87-82a6-4a88-96af-5d5f18a0ca3e tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] [instance: 2fe5b190-5679-4b9d-8d5f-fac1a1c407d9] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:33:05.075574 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-a44dee87-82a6-4a88-96af-5d5f18a0ca3e tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:05.079213 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-a44dee87-82a6-4a88-96af-5d5f18a0ca3e tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:05.080002 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-a44dee87-82a6-4a88-96af-5d5f18a0ca3e tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:05.080495 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-a44dee87-82a6-4a88-96af-5d5f18a0ca3e tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:05.252101 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-a44dee87-82a6-4a88-96af-5d5f18a0ca3e tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] [instance: 2fe5b190-5679-4b9d-8d5f-fac1a1c407d9] Going to try to terminate instance {{(pid=98178) delete /opt/stack/nova/nova/compute/api.py:2540}} Feb 17 04:33:05.438036 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-a44dee87-82a6-4a88-96af-5d5f18a0ca3e tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] 10.222.0.78 "DELETE /compute/v2.1/servers/2fe5b190-5679-4b9d-8d5f-fac1a1c407d9" status: 204 len: 0 microversion: 2.1 time: 0.382707 Feb 17 04:33:05.441312 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 343/706] 10.222.0.78 () {58 vars in 1229 bytes} [Wed Feb 17 04:33:05 2021] DELETE /compute/v2.1/servers/2fe5b190-5679-4b9d-8d5f-fac1a1c407d9 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 17 04:33:05.454222 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-fd09113a-a408-4a20-8bf5-8524293c4e13 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:33:05.457676 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-fd09113a-a408-4a20-8bf5-8524293c4e13 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] [instance: 2fe5b190-5679-4b9d-8d5f-fac1a1c407d9] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:33:05.471927 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-fd09113a-a408-4a20-8bf5-8524293c4e13 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:05.472868 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-fd09113a-a408-4a20-8bf5-8524293c4e13 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:05.474078 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-fd09113a-a408-4a20-8bf5-8524293c4e13 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:05.474779 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-fd09113a-a408-4a20-8bf5-8524293c4e13 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:05.567340 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-0c56dafa-d6f6-4609-9819-a22e76028905 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:33:05.568451 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-0c56dafa-d6f6-4609-9819-a22e76028905 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] [instance: c115a692-885c-492c-a345-4bda25cab425] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:33:05.584452 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-0c56dafa-d6f6-4609-9819-a22e76028905 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:05.585187 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-0c56dafa-d6f6-4609-9819-a22e76028905 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:05.587960 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-0c56dafa-d6f6-4609-9819-a22e76028905 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:05.588735 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-0c56dafa-d6f6-4609-9819-a22e76028905 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:05.840516 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-fd09113a-a408-4a20-8bf5-8524293c4e13 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1daf9a83b1d24033a3d4c0f531a4eb2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5336afdcf4aa4b46b0655432b7a1323c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:33:05.850542 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-fd09113a-a408-4a20-8bf5-8524293c4e13 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] 10.222.0.78 "GET /compute/v2.1/servers/2fe5b190-5679-4b9d-8d5f-fac1a1c407d9" status: 200 len: 1506 microversion: 2.1 time: 0.403451 Feb 17 04:33:05.851411 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 364/707] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:33:05 2021] GET /compute/v2.1/servers/2fe5b190-5679-4b9d-8d5f-fac1a1c407d9 => generated 1506 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:33:05.870955 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-1a75a291-b9d9-4425-bd74-65f3183baac8 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:33:05.880691 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-1a75a291-b9d9-4425-bd74-65f3183baac8 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: 29d1ce27-f63b-4523-88be-55f65a6a2529] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:33:05.890307 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-1a75a291-b9d9-4425-bd74-65f3183baac8 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:05.891081 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-1a75a291-b9d9-4425-bd74-65f3183baac8 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:05.891679 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-1a75a291-b9d9-4425-bd74-65f3183baac8 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:05.892168 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-1a75a291-b9d9-4425-bd74-65f3183baac8 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:05.947218 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-0c56dafa-d6f6-4609-9819-a22e76028905 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b4f65f82a97499dbb900d523924e946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440d4048a9ad43869a00218c7acb9614', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:33:05.956903 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-0c56dafa-d6f6-4609-9819-a22e76028905 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] 10.222.0.78 "GET /compute/v2.1/servers/c115a692-885c-492c-a345-4bda25cab425" status: 200 len: 1319 microversion: 2.1 time: 0.395675 Feb 17 04:33:05.968509 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 344/708] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:33:05 2021] GET /compute/v2.1/servers/c115a692-885c-492c-a345-4bda25cab425 => generated 1319 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:33:06.084004 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-1a75a291-b9d9-4425-bd74-65f3183baac8 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "POST /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529/action" status: 200 len: 28939 microversion: 2.1 time: 0.218600 Feb 17 04:33:06.084945 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 365/709] 10.222.0.78 () {60 vars in 1268 bytes} [Wed Feb 17 04:33:05 2021] POST /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529/action => generated 28939 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 04:33:06.872703 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-2d1ec319-12d6-4e0a-abd7-0b7428bbabc3 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:33:06.873605 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-2d1ec319-12d6-4e0a-abd7-0b7428bbabc3 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] [instance: 2fe5b190-5679-4b9d-8d5f-fac1a1c407d9] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:33:06.892081 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-2d1ec319-12d6-4e0a-abd7-0b7428bbabc3 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:06.893253 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-2d1ec319-12d6-4e0a-abd7-0b7428bbabc3 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:06.894408 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-2d1ec319-12d6-4e0a-abd7-0b7428bbabc3 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:06.894912 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-2d1ec319-12d6-4e0a-abd7-0b7428bbabc3 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:06.981880 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-054da467-7824-4600-bc81-beb3bfaba1fd tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:33:06.988185 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-054da467-7824-4600-bc81-beb3bfaba1fd tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] [instance: c115a692-885c-492c-a345-4bda25cab425] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:33:07.013786 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-054da467-7824-4600-bc81-beb3bfaba1fd tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:07.014297 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-054da467-7824-4600-bc81-beb3bfaba1fd tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:07.015182 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-054da467-7824-4600-bc81-beb3bfaba1fd tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:07.015685 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-054da467-7824-4600-bc81-beb3bfaba1fd tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:07.213472 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-2d1ec319-12d6-4e0a-abd7-0b7428bbabc3 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1daf9a83b1d24033a3d4c0f531a4eb2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5336afdcf4aa4b46b0655432b7a1323c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:33:07.229999 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-2d1ec319-12d6-4e0a-abd7-0b7428bbabc3 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] 10.222.0.78 "GET /compute/v2.1/servers/2fe5b190-5679-4b9d-8d5f-fac1a1c407d9" status: 200 len: 1506 microversion: 2.1 time: 0.358595 Feb 17 04:33:07.230806 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 345/710] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:33:06 2021] GET /compute/v2.1/servers/2fe5b190-5679-4b9d-8d5f-fac1a1c407d9 => generated 1506 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:33:07.250827 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-6f6fba85-1c88-4708-b663-db143aa3eb1a tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:33:07.254129 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-6f6fba85-1c88-4708-b663-db143aa3eb1a tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: 29d1ce27-f63b-4523-88be-55f65a6a2529] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:33:07.278900 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-6f6fba85-1c88-4708-b663-db143aa3eb1a tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:07.279742 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-6f6fba85-1c88-4708-b663-db143aa3eb1a tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:07.280804 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-6f6fba85-1c88-4708-b663-db143aa3eb1a tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:07.281500 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-6f6fba85-1c88-4708-b663-db143aa3eb1a tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:07.327263 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-054da467-7824-4600-bc81-beb3bfaba1fd tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b4f65f82a97499dbb900d523924e946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440d4048a9ad43869a00218c7acb9614', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:33:07.340732 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-054da467-7824-4600-bc81-beb3bfaba1fd tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] 10.222.0.78 "GET /compute/v2.1/servers/c115a692-885c-492c-a345-4bda25cab425" status: 200 len: 1319 microversion: 2.1 time: 0.368030 Feb 17 04:33:07.341514 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 366/711] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:33:06 2021] GET /compute/v2.1/servers/c115a692-885c-492c-a345-4bda25cab425 => generated 1319 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:33:07.514062 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-6f6fba85-1c88-4708-b663-db143aa3eb1a tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "POST /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529/action" status: 200 len: 30724 microversion: 2.1 time: 0.279065 Feb 17 04:33:07.515440 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 346/712] 10.222.0.78 () {60 vars in 1268 bytes} [Wed Feb 17 04:33:07 2021] POST /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529/action => generated 30724 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 04:33:08.150653 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [req-384e8b8a-2a1c-486f-8a2d-3b5fd1069f88 req-d9f00caa-428a-4c22-a0d2-4cd56d330685 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c115a692-885c-492c-a345-4bda25cab425", "name": "network-vif-plugged", "status": "completed", "tag": "3b5d6b78-08fe-4167-befa-eaa4e9d6c970"}]} {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:33:08.154255 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:33:08.154255 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: warnings.warn(msg) Feb 17 04:33:08.173115 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [req-384e8b8a-2a1c-486f-8a2d-3b5fd1069f88 req-d9f00caa-428a-4c22-a0d2-4cd56d330685 service nova] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:08.174380 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [req-384e8b8a-2a1c-486f-8a2d-3b5fd1069f88 req-d9f00caa-428a-4c22-a0d2-4cd56d330685 service nova] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:08.211950 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.compute.server_external_events [req-384e8b8a-2a1c-486f-8a2d-3b5fd1069f88 req-d9f00caa-428a-4c22-a0d2-4cd56d330685 service nova] Creating event network-vif-plugged:3b5d6b78-08fe-4167-befa-eaa4e9d6c970 for instance c115a692-885c-492c-a345-4bda25cab425 on hv-cinder-75998 Feb 17 04:33:08.217579 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [req-384e8b8a-2a1c-486f-8a2d-3b5fd1069f88 req-d9f00caa-428a-4c22-a0d2-4cd56d330685 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070959 Feb 17 04:33:08.218321 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 367/713] 10.222.0.78 () {64 vars in 1308 bytes} [Wed Feb 17 04:33:08 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:33:08.252306 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-1c57acee-d1a5-4d27-b583-598a96849820 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:33:08.253449 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-1c57acee-d1a5-4d27-b583-598a96849820 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] [instance: 2fe5b190-5679-4b9d-8d5f-fac1a1c407d9] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:33:08.263956 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-1c57acee-d1a5-4d27-b583-598a96849820 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:08.265143 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-1c57acee-d1a5-4d27-b583-598a96849820 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:08.266217 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-1c57acee-d1a5-4d27-b583-598a96849820 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:08.267416 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-1c57acee-d1a5-4d27-b583-598a96849820 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:08.360446 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-c3ecade0-4ad0-451d-be4c-ee10256935ef tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:33:08.361664 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-c3ecade0-4ad0-451d-be4c-ee10256935ef tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] [instance: c115a692-885c-492c-a345-4bda25cab425] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:33:08.375932 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-c3ecade0-4ad0-451d-be4c-ee10256935ef tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:08.376725 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-c3ecade0-4ad0-451d-be4c-ee10256935ef tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:08.378156 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-c3ecade0-4ad0-451d-be4c-ee10256935ef tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:08.378826 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-c3ecade0-4ad0-451d-be4c-ee10256935ef tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:08.510498 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-1c57acee-d1a5-4d27-b583-598a96849820 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1daf9a83b1d24033a3d4c0f531a4eb2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5336afdcf4aa4b46b0655432b7a1323c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:33:08.520845 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-1c57acee-d1a5-4d27-b583-598a96849820 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] 10.222.0.78 "GET /compute/v2.1/servers/2fe5b190-5679-4b9d-8d5f-fac1a1c407d9" status: 200 len: 1506 microversion: 2.1 time: 0.275265 Feb 17 04:33:08.521547 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 347/714] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:33:08 2021] GET /compute/v2.1/servers/2fe5b190-5679-4b9d-8d5f-fac1a1c407d9 => generated 1506 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:33:08.526322 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-f2f03476-5939-4f90-a294-6503c231b89a tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:33:08.527463 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-f2f03476-5939-4f90-a294-6503c231b89a tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: 29d1ce27-f63b-4523-88be-55f65a6a2529] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:33:08.535396 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-f2f03476-5939-4f90-a294-6503c231b89a tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:08.536004 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-f2f03476-5939-4f90-a294-6503c231b89a tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:08.536705 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-f2f03476-5939-4f90-a294-6503c231b89a tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:08.537217 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-f2f03476-5939-4f90-a294-6503c231b89a tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:08.884567 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-f2f03476-5939-4f90-a294-6503c231b89a tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "POST /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529/action" status: 200 len: 31968 microversion: 2.1 time: 0.361485 Feb 17 04:33:08.890167 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 348/715] 10.222.0.78 () {60 vars in 1268 bytes} [Wed Feb 17 04:33:08 2021] POST /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529/action => generated 31968 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 04:33:08.891771 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-c3ecade0-4ad0-451d-be4c-ee10256935ef tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b4f65f82a97499dbb900d523924e946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440d4048a9ad43869a00218c7acb9614', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:33:08.902437 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-c3ecade0-4ad0-451d-be4c-ee10256935ef tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] 10.222.0.78 "GET /compute/v2.1/servers/c115a692-885c-492c-a345-4bda25cab425" status: 200 len: 1319 microversion: 2.1 time: 0.545658 Feb 17 04:33:08.903290 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 368/716] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:33:08 2021] GET /compute/v2.1/servers/c115a692-885c-492c-a345-4bda25cab425 => generated 1319 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:33:09.540771 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-f11cbe71-69c6-455e-a633-9b5b304e52e9 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:33:09.541722 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-f11cbe71-69c6-455e-a633-9b5b304e52e9 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] [instance: 2fe5b190-5679-4b9d-8d5f-fac1a1c407d9] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:33:09.552492 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-f11cbe71-69c6-455e-a633-9b5b304e52e9 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:09.553764 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-f11cbe71-69c6-455e-a633-9b5b304e52e9 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:09.554411 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-f11cbe71-69c6-455e-a633-9b5b304e52e9 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:09.555123 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-f11cbe71-69c6-455e-a633-9b5b304e52e9 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:09.778627 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-f11cbe71-69c6-455e-a633-9b5b304e52e9 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1daf9a83b1d24033a3d4c0f531a4eb2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5336afdcf4aa4b46b0655432b7a1323c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:33:09.789646 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-f11cbe71-69c6-455e-a633-9b5b304e52e9 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] 10.222.0.78 "GET /compute/v2.1/servers/2fe5b190-5679-4b9d-8d5f-fac1a1c407d9" status: 200 len: 1506 microversion: 2.1 time: 0.255187 Feb 17 04:33:09.790564 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 349/717] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:33:09 2021] GET /compute/v2.1/servers/2fe5b190-5679-4b9d-8d5f-fac1a1c407d9 => generated 1506 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:33:09.898561 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-4ee6c565-ebea-416f-87ba-3a8660ab8d65 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:33:09.899816 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-4ee6c565-ebea-416f-87ba-3a8660ab8d65 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: 29d1ce27-f63b-4523-88be-55f65a6a2529] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:33:09.909166 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-4ee6c565-ebea-416f-87ba-3a8660ab8d65 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:09.909795 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-4ee6c565-ebea-416f-87ba-3a8660ab8d65 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:09.910777 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-4ee6c565-ebea-416f-87ba-3a8660ab8d65 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:09.911391 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-4ee6c565-ebea-416f-87ba-3a8660ab8d65 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:09.921743 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-59e90bcc-039c-457b-ad41-a1c6cee9d08c tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:33:09.922580 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-59e90bcc-039c-457b-ad41-a1c6cee9d08c tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] [instance: c115a692-885c-492c-a345-4bda25cab425] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:33:09.931928 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-59e90bcc-039c-457b-ad41-a1c6cee9d08c tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:09.932448 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-59e90bcc-039c-457b-ad41-a1c6cee9d08c tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:09.933488 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-59e90bcc-039c-457b-ad41-a1c6cee9d08c tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:09.933988 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-59e90bcc-039c-457b-ad41-a1c6cee9d08c tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:10.165229 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-4ee6c565-ebea-416f-87ba-3a8660ab8d65 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "POST /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529/action" status: 200 len: 33122 microversion: 2.1 time: 0.270687 Feb 17 04:33:10.165907 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 369/718] 10.222.0.78 () {60 vars in 1268 bytes} [Wed Feb 17 04:33:09 2021] POST /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529/action => generated 33122 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 04:33:10.205253 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-59e90bcc-039c-457b-ad41-a1c6cee9d08c tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b4f65f82a97499dbb900d523924e946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440d4048a9ad43869a00218c7acb9614', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:33:10.218249 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-59e90bcc-039c-457b-ad41-a1c6cee9d08c tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] 10.222.0.78 "GET /compute/v2.1/servers/c115a692-885c-492c-a345-4bda25cab425" status: 200 len: 1319 microversion: 2.1 time: 0.301089 Feb 17 04:33:10.218988 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 350/719] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:33:09 2021] GET /compute/v2.1/servers/c115a692-885c-492c-a345-4bda25cab425 => generated 1319 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:33:10.668788 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-118f426d-ec64-42b5-a1c7-7a02eea4baba tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Action: 'create', calling method: .version_select at 0x7f57c93d3158>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1612377343"}} {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:33:10.693794 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.quota [None req-118f426d-ec64-42b5-a1c7-7a02eea4baba tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Getting quotas for project 0d5b2911946848de81be8f9741faa90f. Resources: {'key_pairs'} {{(pid=98179) _get_quotas /opt/stack/nova/nova/quota.py:388}} Feb 17 04:33:10.697867 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.quota [None req-118f426d-ec64-42b5-a1c7-7a02eea4baba tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Getting quotas for user 4f3e4c3c174942c492405c9b112667de and project 0d5b2911946848de81be8f9741faa90f. Resources: {'key_pairs'} {{(pid=98179) _get_quotas /opt/stack/nova/nova/quota.py:380}} Feb 17 04:33:10.808678 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-f34bdb11-9f0b-4c19-b34c-23582f448f42 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:33:10.809518 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-f34bdb11-9f0b-4c19-b34c-23582f448f42 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] [instance: 2fe5b190-5679-4b9d-8d5f-fac1a1c407d9] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:33:10.817899 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-f34bdb11-9f0b-4c19-b34c-23582f448f42 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:10.818411 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-f34bdb11-9f0b-4c19-b34c-23582f448f42 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:10.819289 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-f34bdb11-9f0b-4c19-b34c-23582f448f42 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:10.819791 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-f34bdb11-9f0b-4c19-b34c-23582f448f42 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:10.900787 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.quota [None req-118f426d-ec64-42b5-a1c7-7a02eea4baba tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Getting quotas for project 0d5b2911946848de81be8f9741faa90f. Resources: {'key_pairs'} {{(pid=98179) _get_quotas /opt/stack/nova/nova/quota.py:388}} Feb 17 04:33:10.905628 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.quota [None req-118f426d-ec64-42b5-a1c7-7a02eea4baba tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Getting quotas for user 4f3e4c3c174942c492405c9b112667de and project 0d5b2911946848de81be8f9741faa90f. Resources: {'key_pairs'} {{(pid=98179) _get_quotas /opt/stack/nova/nova/quota.py:380}} Feb 17 04:33:10.919759 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-118f426d-ec64-42b5-a1c7-7a02eea4baba tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 2318 microversion: 2.1 time: 0.255549 Feb 17 04:33:10.920436 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 370/720] 10.222.0.78 () {60 vars in 1148 bytes} [Wed Feb 17 04:33:10 2021] POST /compute/v2.1/os-keypairs => generated 2318 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:33:10.976198 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-19d82dc9-bb87-4463-99a4-19934cc1e32a tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-461920565", "imageRef": "d5297a45-351b-47b6-87d8-5bebefa2e79e", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1612377343", "networks": [{"uuid": "10e65970-91b2-49d9-93cf-ec97654274a6"}]}} {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:33:11.041392 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.network.neutron [None req-19d82dc9-bb87-4463-99a4-19934cc1e32a tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] validate_networks() for [('10e65970-91b2-49d9-93cf-ec97654274a6', None, None, None)] {{(pid=98179) validate_networks /opt/stack/nova/nova/network/neutron.py:2345}} Feb 17 04:33:11.241215 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-f34bdb11-9f0b-4c19-b34c-23582f448f42 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1daf9a83b1d24033a3d4c0f531a4eb2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5336afdcf4aa4b46b0655432b7a1323c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:33:11.252529 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-f34bdb11-9f0b-4c19-b34c-23582f448f42 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] 10.222.0.78 "GET /compute/v2.1/servers/2fe5b190-5679-4b9d-8d5f-fac1a1c407d9" status: 200 len: 1506 microversion: 2.1 time: 0.447923 Feb 17 04:33:11.264617 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 351/721] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:33:10 2021] GET /compute/v2.1/servers/2fe5b190-5679-4b9d-8d5f-fac1a1c407d9 => generated 1506 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:33:11.269822 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-0330fd61-f206-4f12-8c92-96059afef3c0 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:33:11.271056 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-0330fd61-f206-4f12-8c92-96059afef3c0 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: 29d1ce27-f63b-4523-88be-55f65a6a2529] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:33:11.279751 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-0330fd61-f206-4f12-8c92-96059afef3c0 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:11.280477 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-0330fd61-f206-4f12-8c92-96059afef3c0 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:11.281507 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-0330fd61-f206-4f12-8c92-96059afef3c0 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:11.282180 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-0330fd61-f206-4f12-8c92-96059afef3c0 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:11.508607 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-0330fd61-f206-4f12-8c92-96059afef3c0 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "POST /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529/action" status: 200 len: 33825 microversion: 2.1 time: 0.242290 Feb 17 04:33:11.510073 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 352/722] 10.222.0.78 () {60 vars in 1268 bytes} [Wed Feb 17 04:33:11 2021] POST /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529/action => generated 33825 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 04:33:11.515654 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-263a32dd-5bb2-45d9-80ff-975c17fc2658 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:33:11.516570 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-263a32dd-5bb2-45d9-80ff-975c17fc2658 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] [instance: c115a692-885c-492c-a345-4bda25cab425] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:33:11.525623 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-263a32dd-5bb2-45d9-80ff-975c17fc2658 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:11.526888 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-263a32dd-5bb2-45d9-80ff-975c17fc2658 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:11.527929 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-263a32dd-5bb2-45d9-80ff-975c17fc2658 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:11.528801 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-263a32dd-5bb2-45d9-80ff-975c17fc2658 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:11.689093 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.virt.hardware [None req-19d82dc9-bb87-4463-99a4-19934cc1e32a tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Flavor limits 0:0:0 {{(pid=98179) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 17 04:33:11.690275 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.virt.hardware [None req-19d82dc9-bb87-4463-99a4-19934cc1e32a tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Image limits 0:0:0 {{(pid=98179) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Feb 17 04:33:11.690999 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.virt.hardware [None req-19d82dc9-bb87-4463-99a4-19934cc1e32a tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Flavor pref 0:0:0 {{(pid=98179) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 17 04:33:11.691511 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.virt.hardware [None req-19d82dc9-bb87-4463-99a4-19934cc1e32a tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Image pref 0:0:0 {{(pid=98179) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Feb 17 04:33:11.691977 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.virt.hardware [None req-19d82dc9-bb87-4463-99a4-19934cc1e32a tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98179) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Feb 17 04:33:11.703650 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-19d82dc9-bb87-4463-99a4-19934cc1e32a tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:11.704035 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-19d82dc9-bb87-4463-99a4-19934cc1e32a tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:11.704915 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-19d82dc9-bb87-4463-99a4-19934cc1e32a tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:11.705407 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-19d82dc9-bb87-4463-99a4-19934cc1e32a tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:11.741477 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.quota [None req-19d82dc9-bb87-4463-99a4-19934cc1e32a tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Getting quotas for project 0d5b2911946848de81be8f9741faa90f. Resources: {'ram', 'cores', 'instances'} {{(pid=98179) _get_quotas /opt/stack/nova/nova/quota.py:388}} Feb 17 04:33:11.747632 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.quota [None req-19d82dc9-bb87-4463-99a4-19934cc1e32a tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Getting quotas for user 4f3e4c3c174942c492405c9b112667de and project 0d5b2911946848de81be8f9741faa90f. Resources: {'ram', 'cores', 'instances'} {{(pid=98179) _get_quotas /opt/stack/nova/nova/quota.py:380}} Feb 17 04:33:11.760929 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-19d82dc9-bb87-4463-99a4-19934cc1e32a tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Going to run 1 instances... {{(pid=98179) _provision_instances /opt/stack/nova/nova/compute/api.py:1264}} Feb 17 04:33:11.767334 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-19d82dc9-bb87-4463-99a4-19934cc1e32a tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] [instance: b195626c-7ee1-4679-b956-f7ef7d6328f6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d5297a45-351b-47b6-87d8-5bebefa2e79e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98179) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1666}} Feb 17 04:33:11.829082 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-19d82dc9-bb87-4463-99a4-19934cc1e32a tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.856910 Feb 17 04:33:11.829809 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 371/723] 10.222.0.78 () {60 vars in 1137 bytes} [Wed Feb 17 04:33:10 2021] POST /compute/v2.1/servers => generated 380 bytes in 858 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Feb 17 04:33:11.834693 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-1b58a659-e99f-4bd9-97cf-343001ff031a tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:33:11.835261 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-1b58a659-e99f-4bd9-97cf-343001ff031a tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] [instance: 1ee42b60-a1c0-4b17-9aa4-01d216665df4] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:33:11.844242 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-1b58a659-e99f-4bd9-97cf-343001ff031a tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:11.844753 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-1b58a659-e99f-4bd9-97cf-343001ff031a tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:11.845611 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-1b58a659-e99f-4bd9-97cf-343001ff031a tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:11.846107 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-1b58a659-e99f-4bd9-97cf-343001ff031a tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:11.892954 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-263a32dd-5bb2-45d9-80ff-975c17fc2658 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b4f65f82a97499dbb900d523924e946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440d4048a9ad43869a00218c7acb9614', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:33:11.905728 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-263a32dd-5bb2-45d9-80ff-975c17fc2658 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] 10.222.0.78 "GET /compute/v2.1/servers/c115a692-885c-492c-a345-4bda25cab425" status: 200 len: 1319 microversion: 2.1 time: 0.395047 Feb 17 04:33:11.917856 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 353/724] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:33:11 2021] GET /compute/v2.1/servers/c115a692-885c-492c-a345-4bda25cab425 => generated 1319 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:33:11.924558 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-787f9270-7d45-4a60-a37a-16702d307c12 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:33:11.925421 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-787f9270-7d45-4a60-a37a-16702d307c12 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] [instance: b195626c-7ee1-4679-b956-f7ef7d6328f6] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:33:12.041014 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.objects.instance [None req-1b58a659-e99f-4bd9-97cf-343001ff031a tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lazy-loading 'services' on Instance uuid 1ee42b60-a1c0-4b17-9aa4-01d216665df4 {{(pid=98179) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Feb 17 04:33:12.241362 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-1b58a659-e99f-4bd9-97cf-343001ff031a tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] 10.222.0.78 "DELETE /compute/v2.1/servers/1ee42b60-a1c0-4b17-9aa4-01d216665df4/os-volume_attachments/695020b9-9dcf-490e-91ed-c6e4945929aa" status: 202 len: 0 microversion: 2.1 time: 0.410140 Feb 17 04:33:12.242018 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 372/725] 10.222.0.78 () {58 vars in 1406 bytes} [Wed Feb 17 04:33:11 2021] DELETE /compute/v2.1/servers/1ee42b60-a1c0-4b17-9aa4-01d216665df4/os-volume_attachments/695020b9-9dcf-490e-91ed-c6e4945929aa => generated 0 bytes in 412 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:33:12.242436 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-787f9270-7d45-4a60-a37a-16702d307c12 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f3e4c3c174942c492405c9b112667de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5b2911946848de81be8f9741faa90f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:33:12.264281 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-787f9270-7d45-4a60-a37a-16702d307c12 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] 10.222.0.78 "GET /compute/v2.1/servers/b195626c-7ee1-4679-b956-f7ef7d6328f6" status: 200 len: 1258 microversion: 2.1 time: 0.344236 Feb 17 04:33:12.265149 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 354/726] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:33:11 2021] GET /compute/v2.1/servers/b195626c-7ee1-4679-b956-f7ef7d6328f6 => generated 1258 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:33:12.274745 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-7a343a4f-9653-45cc-b3b2-9c4fe8ac3a38 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:33:12.275602 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-7a343a4f-9653-45cc-b3b2-9c4fe8ac3a38 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] [instance: 2fe5b190-5679-4b9d-8d5f-fac1a1c407d9] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:33:12.284713 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-7a343a4f-9653-45cc-b3b2-9c4fe8ac3a38 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:12.285212 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-7a343a4f-9653-45cc-b3b2-9c4fe8ac3a38 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:12.286373 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-7a343a4f-9653-45cc-b3b2-9c4fe8ac3a38 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:12.286720 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-7a343a4f-9653-45cc-b3b2-9c4fe8ac3a38 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:12.303593 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [req-2b068361-6c1d-411a-9f8d-21f0cf9bf1f2 req-88f64a85-d5c3-4c5c-bd06-7ee5c388192b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2fe5b190-5679-4b9d-8d5f-fac1a1c407d9", "name": "network-vif-deleted", "tag": "c06f3049-4f07-4c51-9968-0a06c58bb377"}]} {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:33:12.305346 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:33:12.305346 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: warnings.warn(msg) Feb 17 04:33:12.325373 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [req-2b068361-6c1d-411a-9f8d-21f0cf9bf1f2 req-88f64a85-d5c3-4c5c-bd06-7ee5c388192b service nova] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:12.325889 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [req-2b068361-6c1d-411a-9f8d-21f0cf9bf1f2 req-88f64a85-d5c3-4c5c-bd06-7ee5c388192b service nova] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:12.357605 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.compute.server_external_events [req-2b068361-6c1d-411a-9f8d-21f0cf9bf1f2 req-88f64a85-d5c3-4c5c-bd06-7ee5c388192b service nova] Creating event network-vif-deleted:c06f3049-4f07-4c51-9968-0a06c58bb377 for instance 2fe5b190-5679-4b9d-8d5f-fac1a1c407d9 on hv-cinder-75998 Feb 17 04:33:12.372912 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [req-2b068361-6c1d-411a-9f8d-21f0cf9bf1f2 req-88f64a85-d5c3-4c5c-bd06-7ee5c388192b service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073064 Feb 17 04:33:12.373578 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 355/727] 10.222.0.78 () {64 vars in 1308 bytes} [Wed Feb 17 04:33:12 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:33:12.445929 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-7a343a4f-9653-45cc-b3b2-9c4fe8ac3a38 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1daf9a83b1d24033a3d4c0f531a4eb2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5336afdcf4aa4b46b0655432b7a1323c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:33:12.455715 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-7a343a4f-9653-45cc-b3b2-9c4fe8ac3a38 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] 10.222.0.78 "GET /compute/v2.1/servers/2fe5b190-5679-4b9d-8d5f-fac1a1c407d9" status: 200 len: 1464 microversion: 2.1 time: 0.187125 Feb 17 04:33:12.456324 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 373/728] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:33:12 2021] GET /compute/v2.1/servers/2fe5b190-5679-4b9d-8d5f-fac1a1c407d9 => generated 1464 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:33:12.522858 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-f302d5ab-4719-4313-9622-20436aef6ba1 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:33:12.524175 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-f302d5ab-4719-4313-9622-20436aef6ba1 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: 29d1ce27-f63b-4523-88be-55f65a6a2529] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:33:12.534031 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-f302d5ab-4719-4313-9622-20436aef6ba1 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:12.534674 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-f302d5ab-4719-4313-9622-20436aef6ba1 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:12.535660 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-f302d5ab-4719-4313-9622-20436aef6ba1 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:12.536262 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-f302d5ab-4719-4313-9622-20436aef6ba1 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:12.776769 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-f302d5ab-4719-4313-9622-20436aef6ba1 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "POST /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529/action" status: 200 len: 34290 microversion: 2.1 time: 0.258143 Feb 17 04:33:12.777483 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 356/729] 10.222.0.78 () {60 vars in 1268 bytes} [Wed Feb 17 04:33:12 2021] POST /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529/action => generated 34290 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 04:33:12.924610 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-dd05fa30-b187-4d8d-af1b-9a6a286ee463 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:33:12.925278 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-dd05fa30-b187-4d8d-af1b-9a6a286ee463 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] [instance: c115a692-885c-492c-a345-4bda25cab425] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:33:12.933145 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-dd05fa30-b187-4d8d-af1b-9a6a286ee463 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:12.933635 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-dd05fa30-b187-4d8d-af1b-9a6a286ee463 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:12.934461 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-dd05fa30-b187-4d8d-af1b-9a6a286ee463 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:12.934946 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-dd05fa30-b187-4d8d-af1b-9a6a286ee463 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:13.146430 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-dd05fa30-b187-4d8d-af1b-9a6a286ee463 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b4f65f82a97499dbb900d523924e946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440d4048a9ad43869a00218c7acb9614', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:33:13.156312 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-dd05fa30-b187-4d8d-af1b-9a6a286ee463 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] 10.222.0.78 "GET /compute/v2.1/servers/c115a692-885c-492c-a345-4bda25cab425" status: 200 len: 1507 microversion: 2.1 time: 0.235541 Feb 17 04:33:13.156933 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 374/730] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:33:12 2021] GET /compute/v2.1/servers/c115a692-885c-492c-a345-4bda25cab425 => generated 1507 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:33:13.175323 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-ef0b864d-b52f-417e-9749-6832bb4e074a tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "12d16ec8-050d-460a-b5d5-f49f4a2a8be8", "device": "/dev/sdb"}} {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:33:13.176655 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-ef0b864d-b52f-417e-9749-6832bb4e074a tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] [instance: c115a692-885c-492c-a345-4bda25cab425] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:33:13.186119 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-ef0b864d-b52f-417e-9749-6832bb4e074a tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:13.186633 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-ef0b864d-b52f-417e-9749-6832bb4e074a tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:13.187522 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-ef0b864d-b52f-417e-9749-6832bb4e074a tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:13.188029 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-ef0b864d-b52f-417e-9749-6832bb4e074a tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:13.283352 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-f10d75f8-a176-41a4-bae4-93c3423ac3ae tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:33:13.283693 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-f10d75f8-a176-41a4-bae4-93c3423ac3ae tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] [instance: b195626c-7ee1-4679-b956-f7ef7d6328f6] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:33:13.292805 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-f10d75f8-a176-41a4-bae4-93c3423ac3ae tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:13.293419 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-f10d75f8-a176-41a4-bae4-93c3423ac3ae tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:13.294350 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-f10d75f8-a176-41a4-bae4-93c3423ac3ae tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:13.295066 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-f10d75f8-a176-41a4-bae4-93c3423ac3ae tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:13.437604 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-f10d75f8-a176-41a4-bae4-93c3423ac3ae tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f3e4c3c174942c492405c9b112667de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5b2911946848de81be8f9741faa90f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:33:13.446661 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-f10d75f8-a176-41a4-bae4-93c3423ac3ae tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] 10.222.0.78 "GET /compute/v2.1/servers/b195626c-7ee1-4679-b956-f7ef7d6328f6" status: 200 len: 1254 microversion: 2.1 time: 0.167925 Feb 17 04:33:13.447301 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 375/731] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:33:13 2021] GET /compute/v2.1/servers/b195626c-7ee1-4679-b956-f7ef7d6328f6 => generated 1254 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:33:13.474191 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-4c6eb706-f166-48ac-a8cf-205584674d55 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:33:13.474866 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-4c6eb706-f166-48ac-a8cf-205584674d55 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] [instance: 2fe5b190-5679-4b9d-8d5f-fac1a1c407d9] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:33:13.485084 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-4c6eb706-f166-48ac-a8cf-205584674d55 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:13.485364 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-4c6eb706-f166-48ac-a8cf-205584674d55 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:13.486478 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-4c6eb706-f166-48ac-a8cf-205584674d55 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:13.487231 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-4c6eb706-f166-48ac-a8cf-205584674d55 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:13.571406 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-4c6eb706-f166-48ac-a8cf-205584674d55 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:13.571915 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-4c6eb706-f166-48ac-a8cf-205584674d55 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:13.572425 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.objects.instance [None req-4c6eb706-f166-48ac-a8cf-205584674d55 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lazy-loading 'fault' on Instance uuid 2fe5b190-5679-4b9d-8d5f-fac1a1c407d9 {{(pid=98179) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Feb 17 04:33:13.637527 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-4c6eb706-f166-48ac-a8cf-205584674d55 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1daf9a83b1d24033a3d4c0f531a4eb2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5336afdcf4aa4b46b0655432b7a1323c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:33:13.645958 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-4c6eb706-f166-48ac-a8cf-205584674d55 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] 10.222.0.78 "GET /compute/v2.1/servers/2fe5b190-5679-4b9d-8d5f-fac1a1c407d9" status: 200 len: 1311 microversion: 2.1 time: 0.175703 Feb 17 04:33:13.646701 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 376/732] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:33:13 2021] GET /compute/v2.1/servers/2fe5b190-5679-4b9d-8d5f-fac1a1c407d9 => generated 1311 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:33:13.670213 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-ef0b864d-b52f-417e-9749-6832bb4e074a tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] 10.222.0.78 "POST /compute/v2.1/servers/c115a692-885c-492c-a345-4bda25cab425/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.499328 Feb 17 04:33:13.670876 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 357/733] 10.222.0.78 () {60 vars in 1313 bytes} [Wed Feb 17 04:33:13 2021] POST /compute/v2.1/servers/c115a692-885c-492c-a345-4bda25cab425/os-volume_attachments => generated 194 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:33:13.789263 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-82092ca4-4fa0-4136-b9b0-8cc0d19bef0f tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:33:13.790671 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-82092ca4-4fa0-4136-b9b0-8cc0d19bef0f tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: 29d1ce27-f63b-4523-88be-55f65a6a2529] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:33:13.801039 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-82092ca4-4fa0-4136-b9b0-8cc0d19bef0f tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:13.801667 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-82092ca4-4fa0-4136-b9b0-8cc0d19bef0f tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:13.802636 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-82092ca4-4fa0-4136-b9b0-8cc0d19bef0f tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:13.803275 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-82092ca4-4fa0-4136-b9b0-8cc0d19bef0f tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:13.980820 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-82092ca4-4fa0-4136-b9b0-8cc0d19bef0f tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "POST /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529/action" status: 200 len: 34751 microversion: 2.1 time: 0.194779 Feb 17 04:33:13.982523 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 377/734] 10.222.0.78 () {60 vars in 1268 bytes} [Wed Feb 17 04:33:13 2021] POST /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529/action => generated 34751 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 04:33:14.466958 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-4ccca88f-79f2-4135-8f94-286acc68b93e tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:33:14.468259 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-4ccca88f-79f2-4135-8f94-286acc68b93e tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] [instance: b195626c-7ee1-4679-b956-f7ef7d6328f6] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:33:14.477792 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-4ccca88f-79f2-4135-8f94-286acc68b93e tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:14.478555 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-4ccca88f-79f2-4135-8f94-286acc68b93e tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:14.480153 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-4ccca88f-79f2-4135-8f94-286acc68b93e tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:14.480851 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-4ccca88f-79f2-4135-8f94-286acc68b93e tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:14.664959 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-50dfbfb3-d002-4f8a-a614-68edeefcbb83 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:33:14.666185 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-50dfbfb3-d002-4f8a-a614-68edeefcbb83 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] [instance: 2fe5b190-5679-4b9d-8d5f-fac1a1c407d9] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:33:14.678751 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-50dfbfb3-d002-4f8a-a614-68edeefcbb83 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:14.679695 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-50dfbfb3-d002-4f8a-a614-68edeefcbb83 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:14.680779 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-50dfbfb3-d002-4f8a-a614-68edeefcbb83 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:14.681463 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-50dfbfb3-d002-4f8a-a614-68edeefcbb83 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:14.748769 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.wsgi [None req-50dfbfb3-d002-4f8a-a614-68edeefcbb83 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] HTTP exception thrown: Instance 2fe5b190-5679-4b9d-8d5f-fac1a1c407d9 could not be found. Feb 17 04:33:14.749606 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-50dfbfb3-d002-4f8a-a614-68edeefcbb83 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Returning 404 to user: Instance 2fe5b190-5679-4b9d-8d5f-fac1a1c407d9 could not be found. {{(pid=98179) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 17 04:33:14.750702 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-50dfbfb3-d002-4f8a-a614-68edeefcbb83 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] 10.222.0.78 "GET /compute/v2.1/servers/2fe5b190-5679-4b9d-8d5f-fac1a1c407d9" status: 404 len: 111 microversion: 2.1 time: 0.090146 Feb 17 04:33:14.751439 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 378/735] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:33:14 2021] GET /compute/v2.1/servers/2fe5b190-5679-4b9d-8d5f-fac1a1c407d9 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 17 04:33:14.759627 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-3e7d9c4d-bef8-4fda-8255-59a743913074 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:33:14.760178 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-3e7d9c4d-bef8-4fda-8255-59a743913074 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] [instance: 20760e77-fe67-4ebe-87f1-34d840495341] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:33:14.768229 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-3e7d9c4d-bef8-4fda-8255-59a743913074 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:14.768736 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-3e7d9c4d-bef8-4fda-8255-59a743913074 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:14.769586 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-3e7d9c4d-bef8-4fda-8255-59a743913074 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:14.770075 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-3e7d9c4d-bef8-4fda-8255-59a743913074 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:14.846066 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-3e7d9c4d-bef8-4fda-8255-59a743913074 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] [instance: 20760e77-fe67-4ebe-87f1-34d840495341] Going to try to terminate instance {{(pid=98179) delete /opt/stack/nova/nova/compute/api.py:2540}} Feb 17 04:33:14.911021 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-4ccca88f-79f2-4135-8f94-286acc68b93e tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f3e4c3c174942c492405c9b112667de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5b2911946848de81be8f9741faa90f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:33:14.924028 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-4ccca88f-79f2-4135-8f94-286acc68b93e tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] 10.222.0.78 "GET /compute/v2.1/servers/b195626c-7ee1-4679-b956-f7ef7d6328f6" status: 200 len: 1316 microversion: 2.1 time: 0.462553 Feb 17 04:33:14.926199 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 358/736] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:33:14 2021] GET /compute/v2.1/servers/b195626c-7ee1-4679-b956-f7ef7d6328f6 => generated 1316 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:33:14.994640 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-406bd007-06b7-4df8-874f-6cb612058f3d tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:33:14.996145 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-406bd007-06b7-4df8-874f-6cb612058f3d tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: 29d1ce27-f63b-4523-88be-55f65a6a2529] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:33:15.020664 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-3e7d9c4d-bef8-4fda-8255-59a743913074 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] 10.222.0.78 "DELETE /compute/v2.1/servers/20760e77-fe67-4ebe-87f1-34d840495341" status: 204 len: 0 microversion: 2.1 time: 0.263546 Feb 17 04:33:15.023228 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 379/737] 10.222.0.78 () {58 vars in 1229 bytes} [Wed Feb 17 04:33:14 2021] DELETE /compute/v2.1/servers/20760e77-fe67-4ebe-87f1-34d840495341 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 17 04:33:15.036360 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-0632d940-76aa-4c96-b8ac-cff3c09bcc27 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:33:15.037546 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-0632d940-76aa-4c96-b8ac-cff3c09bcc27 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] [instance: 20760e77-fe67-4ebe-87f1-34d840495341] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:33:15.043841 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-406bd007-06b7-4df8-874f-6cb612058f3d tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:15.044573 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-406bd007-06b7-4df8-874f-6cb612058f3d tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:15.046186 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-406bd007-06b7-4df8-874f-6cb612058f3d tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:15.046807 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-406bd007-06b7-4df8-874f-6cb612058f3d tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:15.048713 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-0632d940-76aa-4c96-b8ac-cff3c09bcc27 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:15.049405 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-0632d940-76aa-4c96-b8ac-cff3c09bcc27 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:15.050422 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-0632d940-76aa-4c96-b8ac-cff3c09bcc27 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:15.051283 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-0632d940-76aa-4c96-b8ac-cff3c09bcc27 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:15.397430 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-0632d940-76aa-4c96-b8ac-cff3c09bcc27 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1daf9a83b1d24033a3d4c0f531a4eb2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5336afdcf4aa4b46b0655432b7a1323c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:33:15.414129 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-0632d940-76aa-4c96-b8ac-cff3c09bcc27 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] 10.222.0.78 "GET /compute/v2.1/servers/20760e77-fe67-4ebe-87f1-34d840495341" status: 200 len: 1521 microversion: 2.1 time: 0.383542 Feb 17 04:33:15.417474 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 380/738] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:33:15 2021] GET /compute/v2.1/servers/20760e77-fe67-4ebe-87f1-34d840495341 => generated 1521 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:33:15.877919 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-f467f0c9-5fd2-4bc8-8db8-c05f28633b97 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:33:15.878476 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-f467f0c9-5fd2-4bc8-8db8-c05f28633b97 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] [instance: 1ee42b60-a1c0-4b17-9aa4-01d216665df4] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:33:15.889636 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-f467f0c9-5fd2-4bc8-8db8-c05f28633b97 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:15.890429 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-f467f0c9-5fd2-4bc8-8db8-c05f28633b97 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:15.891523 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-f467f0c9-5fd2-4bc8-8db8-c05f28633b97 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:15.892031 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-f467f0c9-5fd2-4bc8-8db8-c05f28633b97 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:15.962557 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-f467f0c9-5fd2-4bc8-8db8-c05f28633b97 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] [instance: 1ee42b60-a1c0-4b17-9aa4-01d216665df4] Going to try to terminate instance {{(pid=98179) delete /opt/stack/nova/nova/compute/api.py:2540}} Feb 17 04:33:16.105477 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-f467f0c9-5fd2-4bc8-8db8-c05f28633b97 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] 10.222.0.78 "DELETE /compute/v2.1/servers/1ee42b60-a1c0-4b17-9aa4-01d216665df4" status: 204 len: 0 microversion: 2.1 time: 0.231195 Feb 17 04:33:16.106132 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 381/739] 10.222.0.78 () {58 vars in 1229 bytes} [Wed Feb 17 04:33:15 2021] DELETE /compute/v2.1/servers/1ee42b60-a1c0-4b17-9aa4-01d216665df4 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Feb 17 04:33:16.113751 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-8b1927fa-285d-4a14-85ef-bffb8fa215a0 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:33:16.114529 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-8b1927fa-285d-4a14-85ef-bffb8fa215a0 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] [instance: b195626c-7ee1-4679-b956-f7ef7d6328f6] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:33:16.123469 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-8b1927fa-285d-4a14-85ef-bffb8fa215a0 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:16.123977 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-8b1927fa-285d-4a14-85ef-bffb8fa215a0 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:16.124841 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-8b1927fa-285d-4a14-85ef-bffb8fa215a0 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:16.125337 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-8b1927fa-285d-4a14-85ef-bffb8fa215a0 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:16.362632 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-8b1927fa-285d-4a14-85ef-bffb8fa215a0 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f3e4c3c174942c492405c9b112667de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5b2911946848de81be8f9741faa90f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:33:16.372115 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-8b1927fa-285d-4a14-85ef-bffb8fa215a0 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] 10.222.0.78 "GET /compute/v2.1/servers/b195626c-7ee1-4679-b956-f7ef7d6328f6" status: 200 len: 1358 microversion: 2.1 time: 0.264759 Feb 17 04:33:16.372724 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 382/740] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:33:16 2021] GET /compute/v2.1/servers/b195626c-7ee1-4679-b956-f7ef7d6328f6 => generated 1358 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:33:16.377388 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-81dae2e2-1135-4726-8e1e-6c70678cbd07 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:33:16.378062 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-81dae2e2-1135-4726-8e1e-6c70678cbd07 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] [instance: 1ee42b60-a1c0-4b17-9aa4-01d216665df4] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:33:16.385656 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-81dae2e2-1135-4726-8e1e-6c70678cbd07 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:16.386214 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-81dae2e2-1135-4726-8e1e-6c70678cbd07 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:16.386987 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-81dae2e2-1135-4726-8e1e-6c70678cbd07 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:16.387513 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-81dae2e2-1135-4726-8e1e-6c70678cbd07 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:16.627105 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-81dae2e2-1135-4726-8e1e-6c70678cbd07 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d68d4a6c12e4331b8df8191cdd7a669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2a1ca6347d4278899a1cc009d87d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:33:16.636583 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-81dae2e2-1135-4726-8e1e-6c70678cbd07 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] 10.222.0.78 "GET /compute/v2.1/servers/1ee42b60-a1c0-4b17-9aa4-01d216665df4" status: 200 len: 1514 microversion: 2.1 time: 0.262812 Feb 17 04:33:16.637188 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 383/741] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:33:16 2021] GET /compute/v2.1/servers/1ee42b60-a1c0-4b17-9aa4-01d216665df4 => generated 1514 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:33:16.641840 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-18870679-c5f6-4112-a4d8-c39d676d366d tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:33:16.642505 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-18870679-c5f6-4112-a4d8-c39d676d366d tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] [instance: 20760e77-fe67-4ebe-87f1-34d840495341] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:33:16.649877 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-18870679-c5f6-4112-a4d8-c39d676d366d tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:16.650383 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-18870679-c5f6-4112-a4d8-c39d676d366d tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:16.651783 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-18870679-c5f6-4112-a4d8-c39d676d366d tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:16.652294 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-18870679-c5f6-4112-a4d8-c39d676d366d tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:16.875577 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-18870679-c5f6-4112-a4d8-c39d676d366d tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1daf9a83b1d24033a3d4c0f531a4eb2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5336afdcf4aa4b46b0655432b7a1323c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:33:16.884779 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-18870679-c5f6-4112-a4d8-c39d676d366d tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] 10.222.0.78 "GET /compute/v2.1/servers/20760e77-fe67-4ebe-87f1-34d840495341" status: 200 len: 1521 microversion: 2.1 time: 0.246492 Feb 17 04:33:16.886417 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 384/742] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:33:16 2021] GET /compute/v2.1/servers/20760e77-fe67-4ebe-87f1-34d840495341 => generated 1521 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:33:17.390817 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-58550fc5-ec4e-4d7a-b871-707b38939c6a tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:33:17.391640 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-58550fc5-ec4e-4d7a-b871-707b38939c6a tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] [instance: b195626c-7ee1-4679-b956-f7ef7d6328f6] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:33:17.399469 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-58550fc5-ec4e-4d7a-b871-707b38939c6a tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:17.399973 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-58550fc5-ec4e-4d7a-b871-707b38939c6a tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:17.400799 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-58550fc5-ec4e-4d7a-b871-707b38939c6a tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:17.402602 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-58550fc5-ec4e-4d7a-b871-707b38939c6a tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:17.620686 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-58550fc5-ec4e-4d7a-b871-707b38939c6a tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f3e4c3c174942c492405c9b112667de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5b2911946848de81be8f9741faa90f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:33:17.629447 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-58550fc5-ec4e-4d7a-b871-707b38939c6a tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] 10.222.0.78 "GET /compute/v2.1/servers/b195626c-7ee1-4679-b956-f7ef7d6328f6" status: 200 len: 1358 microversion: 2.1 time: 0.242684 Feb 17 04:33:17.629990 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 385/743] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:33:17 2021] GET /compute/v2.1/servers/b195626c-7ee1-4679-b956-f7ef7d6328f6 => generated 1358 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:33:17.654681 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-5ea24e8d-8126-4de6-bb9c-bbd60e776c90 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:33:17.655376 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-5ea24e8d-8126-4de6-bb9c-bbd60e776c90 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] [instance: 1ee42b60-a1c0-4b17-9aa4-01d216665df4] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:33:17.662796 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-5ea24e8d-8126-4de6-bb9c-bbd60e776c90 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:17.663352 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-5ea24e8d-8126-4de6-bb9c-bbd60e776c90 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:17.664176 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-5ea24e8d-8126-4de6-bb9c-bbd60e776c90 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:17.664661 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-5ea24e8d-8126-4de6-bb9c-bbd60e776c90 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:17.890595 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-5ea24e8d-8126-4de6-bb9c-bbd60e776c90 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d68d4a6c12e4331b8df8191cdd7a669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2a1ca6347d4278899a1cc009d87d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:33:17.899632 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-5ea24e8d-8126-4de6-bb9c-bbd60e776c90 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] 10.222.0.78 "GET /compute/v2.1/servers/1ee42b60-a1c0-4b17-9aa4-01d216665df4" status: 200 len: 1514 microversion: 2.1 time: 0.249145 Feb 17 04:33:17.900234 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 386/744] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:33:17 2021] GET /compute/v2.1/servers/1ee42b60-a1c0-4b17-9aa4-01d216665df4 => generated 1514 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:33:17.904885 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-b4352e83-995c-4679-bce1-7fce4c440b8e tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:33:17.905556 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-b4352e83-995c-4679-bce1-7fce4c440b8e tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] [instance: 20760e77-fe67-4ebe-87f1-34d840495341] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:33:17.913137 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-b4352e83-995c-4679-bce1-7fce4c440b8e tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:17.913648 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-b4352e83-995c-4679-bce1-7fce4c440b8e tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:17.914486 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-b4352e83-995c-4679-bce1-7fce4c440b8e tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:17.914989 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-b4352e83-995c-4679-bce1-7fce4c440b8e tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:18.129446 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-b4352e83-995c-4679-bce1-7fce4c440b8e tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1daf9a83b1d24033a3d4c0f531a4eb2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5336afdcf4aa4b46b0655432b7a1323c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:33:18.139140 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-b4352e83-995c-4679-bce1-7fce4c440b8e tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] 10.222.0.78 "GET /compute/v2.1/servers/20760e77-fe67-4ebe-87f1-34d840495341" status: 200 len: 1521 microversion: 2.1 time: 0.237759 Feb 17 04:33:18.139908 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 387/745] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:33:17 2021] GET /compute/v2.1/servers/20760e77-fe67-4ebe-87f1-34d840495341 => generated 1521 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:33:18.647585 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-41de59cf-bed8-494d-b265-8d11dba91f98 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:33:18.648259 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-41de59cf-bed8-494d-b265-8d11dba91f98 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] [instance: b195626c-7ee1-4679-b956-f7ef7d6328f6] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:33:18.656776 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-41de59cf-bed8-494d-b265-8d11dba91f98 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:18.657286 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-41de59cf-bed8-494d-b265-8d11dba91f98 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:18.658130 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-41de59cf-bed8-494d-b265-8d11dba91f98 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:18.658616 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-41de59cf-bed8-494d-b265-8d11dba91f98 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:18.880855 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-41de59cf-bed8-494d-b265-8d11dba91f98 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f3e4c3c174942c492405c9b112667de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5b2911946848de81be8f9741faa90f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:33:18.890720 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-41de59cf-bed8-494d-b265-8d11dba91f98 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] 10.222.0.78 "GET /compute/v2.1/servers/b195626c-7ee1-4679-b956-f7ef7d6328f6" status: 200 len: 1358 microversion: 2.1 time: 0.247012 Feb 17 04:33:18.891388 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 388/746] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:33:18 2021] GET /compute/v2.1/servers/b195626c-7ee1-4679-b956-f7ef7d6328f6 => generated 1358 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:33:18.918230 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-d93244df-24a5-45d8-8dff-d060ef186fb6 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:33:18.918897 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-d93244df-24a5-45d8-8dff-d060ef186fb6 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] [instance: 1ee42b60-a1c0-4b17-9aa4-01d216665df4] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:33:18.926815 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-d93244df-24a5-45d8-8dff-d060ef186fb6 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:18.927349 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-d93244df-24a5-45d8-8dff-d060ef186fb6 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:18.928183 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-d93244df-24a5-45d8-8dff-d060ef186fb6 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:18.928673 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-d93244df-24a5-45d8-8dff-d060ef186fb6 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:19.143392 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-d93244df-24a5-45d8-8dff-d060ef186fb6 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d68d4a6c12e4331b8df8191cdd7a669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2a1ca6347d4278899a1cc009d87d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:33:19.152642 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-d93244df-24a5-45d8-8dff-d060ef186fb6 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] 10.222.0.78 "GET /compute/v2.1/servers/1ee42b60-a1c0-4b17-9aa4-01d216665df4" status: 200 len: 1514 microversion: 2.1 time: 0.238926 Feb 17 04:33:19.153250 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 389/747] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:33:18 2021] GET /compute/v2.1/servers/1ee42b60-a1c0-4b17-9aa4-01d216665df4 => generated 1514 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:33:19.157933 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-55cb5b74-2135-480e-9ddb-a0c7c00d8c1e tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:33:19.158605 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-55cb5b74-2135-480e-9ddb-a0c7c00d8c1e tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] [instance: 20760e77-fe67-4ebe-87f1-34d840495341] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:33:19.167013 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-55cb5b74-2135-480e-9ddb-a0c7c00d8c1e tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:19.167568 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-55cb5b74-2135-480e-9ddb-a0c7c00d8c1e tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:19.168436 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-55cb5b74-2135-480e-9ddb-a0c7c00d8c1e tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:19.168941 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-55cb5b74-2135-480e-9ddb-a0c7c00d8c1e tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:19.396987 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-55cb5b74-2135-480e-9ddb-a0c7c00d8c1e tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1daf9a83b1d24033a3d4c0f531a4eb2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5336afdcf4aa4b46b0655432b7a1323c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:33:19.406355 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-55cb5b74-2135-480e-9ddb-a0c7c00d8c1e tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] 10.222.0.78 "GET /compute/v2.1/servers/20760e77-fe67-4ebe-87f1-34d840495341" status: 200 len: 1521 microversion: 2.1 time: 0.252042 Feb 17 04:33:19.407140 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 390/748] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:33:19 2021] GET /compute/v2.1/servers/20760e77-fe67-4ebe-87f1-34d840495341 => generated 1521 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:33:19.908694 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-b4a29b62-9042-4fef-ad72-648d9bf38bba tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:33:19.911249 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-b4a29b62-9042-4fef-ad72-648d9bf38bba tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] [instance: b195626c-7ee1-4679-b956-f7ef7d6328f6] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:33:19.920952 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-b4a29b62-9042-4fef-ad72-648d9bf38bba tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:19.921461 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-b4a29b62-9042-4fef-ad72-648d9bf38bba tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:19.922364 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-b4a29b62-9042-4fef-ad72-648d9bf38bba tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:19.922865 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-b4a29b62-9042-4fef-ad72-648d9bf38bba tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:20.147398 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-b4a29b62-9042-4fef-ad72-648d9bf38bba tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f3e4c3c174942c492405c9b112667de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5b2911946848de81be8f9741faa90f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:33:20.157873 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-b4a29b62-9042-4fef-ad72-648d9bf38bba tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] 10.222.0.78 "GET /compute/v2.1/servers/b195626c-7ee1-4679-b956-f7ef7d6328f6" status: 200 len: 1358 microversion: 2.1 time: 0.253256 Feb 17 04:33:20.158686 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 391/749] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:33:19 2021] GET /compute/v2.1/servers/b195626c-7ee1-4679-b956-f7ef7d6328f6 => generated 1358 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:33:20.172116 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-3b8df74f-b247-4eb9-b0e1-cba90efc37fc tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:33:20.172896 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-3b8df74f-b247-4eb9-b0e1-cba90efc37fc tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] [instance: 1ee42b60-a1c0-4b17-9aa4-01d216665df4] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:33:20.181194 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-3b8df74f-b247-4eb9-b0e1-cba90efc37fc tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:20.181842 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-3b8df74f-b247-4eb9-b0e1-cba90efc37fc tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:20.183005 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-3b8df74f-b247-4eb9-b0e1-cba90efc37fc tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:20.183723 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-3b8df74f-b247-4eb9-b0e1-cba90efc37fc tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:20.411099 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-3b8df74f-b247-4eb9-b0e1-cba90efc37fc tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d68d4a6c12e4331b8df8191cdd7a669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2a1ca6347d4278899a1cc009d87d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:33:20.420606 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-3b8df74f-b247-4eb9-b0e1-cba90efc37fc tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] 10.222.0.78 "GET /compute/v2.1/servers/1ee42b60-a1c0-4b17-9aa4-01d216665df4" status: 200 len: 1514 microversion: 2.1 time: 0.253895 Feb 17 04:33:20.421205 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 392/750] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:33:20 2021] GET /compute/v2.1/servers/1ee42b60-a1c0-4b17-9aa4-01d216665df4 => generated 1514 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:33:20.425778 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-f2256ab6-9836-48dc-9208-fb8beb6e6922 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:33:20.426390 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-f2256ab6-9836-48dc-9208-fb8beb6e6922 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] [instance: 20760e77-fe67-4ebe-87f1-34d840495341] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:33:20.434702 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-f2256ab6-9836-48dc-9208-fb8beb6e6922 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:20.435246 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-f2256ab6-9836-48dc-9208-fb8beb6e6922 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:20.436065 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-f2256ab6-9836-48dc-9208-fb8beb6e6922 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:20.436535 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-f2256ab6-9836-48dc-9208-fb8beb6e6922 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:20.665814 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-f2256ab6-9836-48dc-9208-fb8beb6e6922 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1daf9a83b1d24033a3d4c0f531a4eb2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5336afdcf4aa4b46b0655432b7a1323c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:33:20.675600 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-f2256ab6-9836-48dc-9208-fb8beb6e6922 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] 10.222.0.78 "GET /compute/v2.1/servers/20760e77-fe67-4ebe-87f1-34d840495341" status: 200 len: 1521 microversion: 2.1 time: 0.253334 Feb 17 04:33:20.676270 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 393/751] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:33:20 2021] GET /compute/v2.1/servers/20760e77-fe67-4ebe-87f1-34d840495341 => generated 1521 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:33:21.176854 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-4803c8c7-3517-402c-b029-65ff51645399 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:33:21.177530 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-4803c8c7-3517-402c-b029-65ff51645399 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] [instance: b195626c-7ee1-4679-b956-f7ef7d6328f6] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:33:21.186528 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-4803c8c7-3517-402c-b029-65ff51645399 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:21.187074 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-4803c8c7-3517-402c-b029-65ff51645399 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:21.187926 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-4803c8c7-3517-402c-b029-65ff51645399 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:21.188423 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-4803c8c7-3517-402c-b029-65ff51645399 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:21.558974 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-4803c8c7-3517-402c-b029-65ff51645399 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f3e4c3c174942c492405c9b112667de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5b2911946848de81be8f9741faa90f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:33:21.567771 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-4803c8c7-3517-402c-b029-65ff51645399 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] 10.222.0.78 "GET /compute/v2.1/servers/b195626c-7ee1-4679-b956-f7ef7d6328f6" status: 200 len: 1358 microversion: 2.1 time: 0.394883 Feb 17 04:33:21.568380 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 394/752] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:33:21 2021] GET /compute/v2.1/servers/b195626c-7ee1-4679-b956-f7ef7d6328f6 => generated 1358 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:33:21.572979 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-4b1a4970-b8e1-4c53-938f-b2888c6204bd tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:33:21.574474 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-4b1a4970-b8e1-4c53-938f-b2888c6204bd tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] [instance: 1ee42b60-a1c0-4b17-9aa4-01d216665df4] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:33:21.582080 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-4b1a4970-b8e1-4c53-938f-b2888c6204bd tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:21.582592 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-4b1a4970-b8e1-4c53-938f-b2888c6204bd tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:21.583467 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-4b1a4970-b8e1-4c53-938f-b2888c6204bd tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:21.583972 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-4b1a4970-b8e1-4c53-938f-b2888c6204bd tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:21.809560 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-4b1a4970-b8e1-4c53-938f-b2888c6204bd tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d68d4a6c12e4331b8df8191cdd7a669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2a1ca6347d4278899a1cc009d87d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:33:21.818960 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-4b1a4970-b8e1-4c53-938f-b2888c6204bd tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] 10.222.0.78 "GET /compute/v2.1/servers/1ee42b60-a1c0-4b17-9aa4-01d216665df4" status: 200 len: 1514 microversion: 2.1 time: 0.249316 Feb 17 04:33:21.819530 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 395/753] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:33:21 2021] GET /compute/v2.1/servers/1ee42b60-a1c0-4b17-9aa4-01d216665df4 => generated 1514 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:33:21.824054 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-97770212-79c3-497d-b334-a44c11893d6b tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:33:21.824778 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-97770212-79c3-497d-b334-a44c11893d6b tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] [instance: 20760e77-fe67-4ebe-87f1-34d840495341] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:33:21.833614 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-97770212-79c3-497d-b334-a44c11893d6b tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:21.834128 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-97770212-79c3-497d-b334-a44c11893d6b tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:21.834975 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-97770212-79c3-497d-b334-a44c11893d6b tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:21.835509 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-97770212-79c3-497d-b334-a44c11893d6b tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:22.050042 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-97770212-79c3-497d-b334-a44c11893d6b tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1daf9a83b1d24033a3d4c0f531a4eb2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5336afdcf4aa4b46b0655432b7a1323c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:33:22.059615 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-97770212-79c3-497d-b334-a44c11893d6b tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] 10.222.0.78 "GET /compute/v2.1/servers/20760e77-fe67-4ebe-87f1-34d840495341" status: 200 len: 1521 microversion: 2.1 time: 0.239094 Feb 17 04:33:22.060238 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 396/754] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:33:21 2021] GET /compute/v2.1/servers/20760e77-fe67-4ebe-87f1-34d840495341 => generated 1521 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:33:22.587262 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-f65c5f72-d25c-4135-a625-502fcbd7c4ca tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:33:22.587935 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-f65c5f72-d25c-4135-a625-502fcbd7c4ca tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] [instance: b195626c-7ee1-4679-b956-f7ef7d6328f6] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:33:22.596517 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-f65c5f72-d25c-4135-a625-502fcbd7c4ca tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:22.597026 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-f65c5f72-d25c-4135-a625-502fcbd7c4ca tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:22.597858 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-f65c5f72-d25c-4135-a625-502fcbd7c4ca tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:22.598346 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-f65c5f72-d25c-4135-a625-502fcbd7c4ca tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:22.818032 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-f65c5f72-d25c-4135-a625-502fcbd7c4ca tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f3e4c3c174942c492405c9b112667de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5b2911946848de81be8f9741faa90f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:33:22.827607 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-f65c5f72-d25c-4135-a625-502fcbd7c4ca tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] 10.222.0.78 "GET /compute/v2.1/servers/b195626c-7ee1-4679-b956-f7ef7d6328f6" status: 200 len: 1358 microversion: 2.1 time: 0.244371 Feb 17 04:33:22.828210 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 397/755] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:33:22 2021] GET /compute/v2.1/servers/b195626c-7ee1-4679-b956-f7ef7d6328f6 => generated 1358 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:33:22.837230 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-180e90df-c65f-4b18-937b-6329c99c6526 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:33:22.837932 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-180e90df-c65f-4b18-937b-6329c99c6526 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] [instance: 1ee42b60-a1c0-4b17-9aa4-01d216665df4] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:33:22.846469 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-180e90df-c65f-4b18-937b-6329c99c6526 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:22.846982 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-180e90df-c65f-4b18-937b-6329c99c6526 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:22.847850 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-180e90df-c65f-4b18-937b-6329c99c6526 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:22.848403 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-180e90df-c65f-4b18-937b-6329c99c6526 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:23.067072 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-180e90df-c65f-4b18-937b-6329c99c6526 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d68d4a6c12e4331b8df8191cdd7a669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2a1ca6347d4278899a1cc009d87d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:33:23.076639 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-180e90df-c65f-4b18-937b-6329c99c6526 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] 10.222.0.78 "GET /compute/v2.1/servers/1ee42b60-a1c0-4b17-9aa4-01d216665df4" status: 200 len: 1514 microversion: 2.1 time: 0.243420 Feb 17 04:33:23.077247 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 398/756] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:33:22 2021] GET /compute/v2.1/servers/1ee42b60-a1c0-4b17-9aa4-01d216665df4 => generated 1514 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:33:23.081816 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-8e4eaaed-05bf-489f-834a-0f98159733d5 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:33:23.082486 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-8e4eaaed-05bf-489f-834a-0f98159733d5 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] [instance: 20760e77-fe67-4ebe-87f1-34d840495341] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:33:23.090386 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-8e4eaaed-05bf-489f-834a-0f98159733d5 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:23.090844 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-8e4eaaed-05bf-489f-834a-0f98159733d5 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:23.091751 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-8e4eaaed-05bf-489f-834a-0f98159733d5 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:23.092251 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-8e4eaaed-05bf-489f-834a-0f98159733d5 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:23.313018 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-8e4eaaed-05bf-489f-834a-0f98159733d5 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1daf9a83b1d24033a3d4c0f531a4eb2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5336afdcf4aa4b46b0655432b7a1323c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:33:23.321770 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-8e4eaaed-05bf-489f-834a-0f98159733d5 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] 10.222.0.78 "GET /compute/v2.1/servers/20760e77-fe67-4ebe-87f1-34d840495341" status: 200 len: 1521 microversion: 2.1 time: 0.243513 Feb 17 04:33:23.322366 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 399/757] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:33:23 2021] GET /compute/v2.1/servers/20760e77-fe67-4ebe-87f1-34d840495341 => generated 1521 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:33:23.846298 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-1b4053d0-3259-49b5-938e-73155907bd39 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:33:23.846978 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-1b4053d0-3259-49b5-938e-73155907bd39 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] [instance: b195626c-7ee1-4679-b956-f7ef7d6328f6] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:33:23.855564 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-1b4053d0-3259-49b5-938e-73155907bd39 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:23.856082 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-1b4053d0-3259-49b5-938e-73155907bd39 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:23.856925 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-1b4053d0-3259-49b5-938e-73155907bd39 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:23.857422 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-1b4053d0-3259-49b5-938e-73155907bd39 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:24.084620 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-1b4053d0-3259-49b5-938e-73155907bd39 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f3e4c3c174942c492405c9b112667de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5b2911946848de81be8f9741faa90f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:33:24.094417 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-1b4053d0-3259-49b5-938e-73155907bd39 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] 10.222.0.78 "GET /compute/v2.1/servers/b195626c-7ee1-4679-b956-f7ef7d6328f6" status: 200 len: 1358 microversion: 2.1 time: 0.252055 Feb 17 04:33:24.095027 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 400/758] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:33:23 2021] GET /compute/v2.1/servers/b195626c-7ee1-4679-b956-f7ef7d6328f6 => generated 1358 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:33:24.099837 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-6a1a1882-a1b9-4eb0-ae4c-7e2f0dadd925 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:33:24.100506 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-6a1a1882-a1b9-4eb0-ae4c-7e2f0dadd925 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] [instance: 1ee42b60-a1c0-4b17-9aa4-01d216665df4] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:33:24.110408 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-6a1a1882-a1b9-4eb0-ae4c-7e2f0dadd925 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:24.111227 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-6a1a1882-a1b9-4eb0-ae4c-7e2f0dadd925 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:24.112085 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-6a1a1882-a1b9-4eb0-ae4c-7e2f0dadd925 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:24.112575 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-6a1a1882-a1b9-4eb0-ae4c-7e2f0dadd925 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:24.363534 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-6a1a1882-a1b9-4eb0-ae4c-7e2f0dadd925 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d68d4a6c12e4331b8df8191cdd7a669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2a1ca6347d4278899a1cc009d87d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:33:24.373910 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-6a1a1882-a1b9-4eb0-ae4c-7e2f0dadd925 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] 10.222.0.78 "GET /compute/v2.1/servers/1ee42b60-a1c0-4b17-9aa4-01d216665df4" status: 200 len: 1514 microversion: 2.1 time: 0.277729 Feb 17 04:33:24.374633 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 401/759] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:33:24 2021] GET /compute/v2.1/servers/1ee42b60-a1c0-4b17-9aa4-01d216665df4 => generated 1514 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:33:24.379687 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-eeee83d9-168b-4014-8dbe-511c0e18dc8b tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:33:24.380410 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-eeee83d9-168b-4014-8dbe-511c0e18dc8b tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] [instance: 20760e77-fe67-4ebe-87f1-34d840495341] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:33:24.390833 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-eeee83d9-168b-4014-8dbe-511c0e18dc8b tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:24.391504 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-eeee83d9-168b-4014-8dbe-511c0e18dc8b tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:24.392449 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-eeee83d9-168b-4014-8dbe-511c0e18dc8b tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:24.393020 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-eeee83d9-168b-4014-8dbe-511c0e18dc8b tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:24.626119 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-eeee83d9-168b-4014-8dbe-511c0e18dc8b tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1daf9a83b1d24033a3d4c0f531a4eb2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5336afdcf4aa4b46b0655432b7a1323c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:33:24.637348 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-eeee83d9-168b-4014-8dbe-511c0e18dc8b tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] 10.222.0.78 "GET /compute/v2.1/servers/20760e77-fe67-4ebe-87f1-34d840495341" status: 200 len: 1521 microversion: 2.1 time: 0.260009 Feb 17 04:33:24.639068 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 402/760] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:33:24 2021] GET /compute/v2.1/servers/20760e77-fe67-4ebe-87f1-34d840495341 => generated 1521 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:33:25.113679 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-11822988-71d1-4b35-8fc3-9a772d3420a4 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:33:25.114396 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-11822988-71d1-4b35-8fc3-9a772d3420a4 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] [instance: b195626c-7ee1-4679-b956-f7ef7d6328f6] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:33:25.122746 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-11822988-71d1-4b35-8fc3-9a772d3420a4 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:25.123066 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-11822988-71d1-4b35-8fc3-9a772d3420a4 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:25.123928 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-11822988-71d1-4b35-8fc3-9a772d3420a4 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:25.125000 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-11822988-71d1-4b35-8fc3-9a772d3420a4 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:25.345899 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-11822988-71d1-4b35-8fc3-9a772d3420a4 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f3e4c3c174942c492405c9b112667de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5b2911946848de81be8f9741faa90f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:33:25.354914 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-11822988-71d1-4b35-8fc3-9a772d3420a4 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] 10.222.0.78 "GET /compute/v2.1/servers/b195626c-7ee1-4679-b956-f7ef7d6328f6" status: 200 len: 1358 microversion: 2.1 time: 0.245758 Feb 17 04:33:25.355676 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 403/761] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:33:25 2021] GET /compute/v2.1/servers/b195626c-7ee1-4679-b956-f7ef7d6328f6 => generated 1358 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:33:25.392902 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-434ddbbf-2431-4cce-90d4-0f173016aeb1 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:33:25.393498 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-434ddbbf-2431-4cce-90d4-0f173016aeb1 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] [instance: 1ee42b60-a1c0-4b17-9aa4-01d216665df4] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:33:25.401488 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-434ddbbf-2431-4cce-90d4-0f173016aeb1 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:25.402001 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-434ddbbf-2431-4cce-90d4-0f173016aeb1 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:25.403609 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-434ddbbf-2431-4cce-90d4-0f173016aeb1 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:25.404112 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-434ddbbf-2431-4cce-90d4-0f173016aeb1 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:25.626989 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-434ddbbf-2431-4cce-90d4-0f173016aeb1 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d68d4a6c12e4331b8df8191cdd7a669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2a1ca6347d4278899a1cc009d87d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:33:25.636138 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-434ddbbf-2431-4cce-90d4-0f173016aeb1 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] 10.222.0.78 "GET /compute/v2.1/servers/1ee42b60-a1c0-4b17-9aa4-01d216665df4" status: 200 len: 1514 microversion: 2.1 time: 0.247267 Feb 17 04:33:25.636837 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 404/762] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:33:25 2021] GET /compute/v2.1/servers/1ee42b60-a1c0-4b17-9aa4-01d216665df4 => generated 1514 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:33:25.655874 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-7b893ca8-dbcf-46f6-a753-4dfa7c5cbc69 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:33:25.656470 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-7b893ca8-dbcf-46f6-a753-4dfa7c5cbc69 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] [instance: 20760e77-fe67-4ebe-87f1-34d840495341] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:33:25.664473 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-7b893ca8-dbcf-46f6-a753-4dfa7c5cbc69 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:25.664982 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-7b893ca8-dbcf-46f6-a753-4dfa7c5cbc69 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:25.665822 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-7b893ca8-dbcf-46f6-a753-4dfa7c5cbc69 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:25.666319 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-7b893ca8-dbcf-46f6-a753-4dfa7c5cbc69 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:25.883972 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-7b893ca8-dbcf-46f6-a753-4dfa7c5cbc69 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1daf9a83b1d24033a3d4c0f531a4eb2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5336afdcf4aa4b46b0655432b7a1323c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:33:25.893968 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-7b893ca8-dbcf-46f6-a753-4dfa7c5cbc69 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] 10.222.0.78 "GET /compute/v2.1/servers/20760e77-fe67-4ebe-87f1-34d840495341" status: 200 len: 1521 microversion: 2.1 time: 0.242432 Feb 17 04:33:25.894795 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 405/763] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:33:25 2021] GET /compute/v2.1/servers/20760e77-fe67-4ebe-87f1-34d840495341 => generated 1521 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:33:26.374164 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-c7fbdb2b-64a0-446b-b392-4b83a875d174 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:33:26.374847 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-c7fbdb2b-64a0-446b-b392-4b83a875d174 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] [instance: b195626c-7ee1-4679-b956-f7ef7d6328f6] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:33:26.382875 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-c7fbdb2b-64a0-446b-b392-4b83a875d174 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:26.383434 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-c7fbdb2b-64a0-446b-b392-4b83a875d174 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:26.384282 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-c7fbdb2b-64a0-446b-b392-4b83a875d174 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:26.384865 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-c7fbdb2b-64a0-446b-b392-4b83a875d174 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:26.612580 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-c7fbdb2b-64a0-446b-b392-4b83a875d174 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f3e4c3c174942c492405c9b112667de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5b2911946848de81be8f9741faa90f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:33:26.621375 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-c7fbdb2b-64a0-446b-b392-4b83a875d174 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] 10.222.0.78 "GET /compute/v2.1/servers/b195626c-7ee1-4679-b956-f7ef7d6328f6" status: 200 len: 1358 microversion: 2.1 time: 0.251750 Feb 17 04:33:26.621982 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 406/764] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:33:26 2021] GET /compute/v2.1/servers/b195626c-7ee1-4679-b956-f7ef7d6328f6 => generated 1358 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:33:26.933402 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-111b215f-d2ec-4a30-b9ea-db186520f0f2 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:33:26.934168 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-111b215f-d2ec-4a30-b9ea-db186520f0f2 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] [instance: 1ee42b60-a1c0-4b17-9aa4-01d216665df4] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:33:26.942205 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-111b215f-d2ec-4a30-b9ea-db186520f0f2 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:26.942725 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-111b215f-d2ec-4a30-b9ea-db186520f0f2 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:26.943600 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-111b215f-d2ec-4a30-b9ea-db186520f0f2 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:26.944101 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-111b215f-d2ec-4a30-b9ea-db186520f0f2 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:27.161757 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-111b215f-d2ec-4a30-b9ea-db186520f0f2 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d68d4a6c12e4331b8df8191cdd7a669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2a1ca6347d4278899a1cc009d87d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:33:27.179625 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-111b215f-d2ec-4a30-b9ea-db186520f0f2 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] 10.222.0.78 "GET /compute/v2.1/servers/1ee42b60-a1c0-4b17-9aa4-01d216665df4" status: 200 len: 1514 microversion: 2.1 time: 0.520875 Feb 17 04:33:27.179625 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 407/765] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:33:26 2021] GET /compute/v2.1/servers/1ee42b60-a1c0-4b17-9aa4-01d216665df4 => generated 1514 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:33:27.184335 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-059fdca1-7e7f-4af4-8edb-9f2169ce1b03 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:33:27.184998 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-059fdca1-7e7f-4af4-8edb-9f2169ce1b03 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] [instance: 20760e77-fe67-4ebe-87f1-34d840495341] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:33:27.193232 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-059fdca1-7e7f-4af4-8edb-9f2169ce1b03 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:27.193738 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-059fdca1-7e7f-4af4-8edb-9f2169ce1b03 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:27.194591 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-059fdca1-7e7f-4af4-8edb-9f2169ce1b03 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:27.195188 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-059fdca1-7e7f-4af4-8edb-9f2169ce1b03 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:27.417503 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-059fdca1-7e7f-4af4-8edb-9f2169ce1b03 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1daf9a83b1d24033a3d4c0f531a4eb2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5336afdcf4aa4b46b0655432b7a1323c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:33:27.427203 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-059fdca1-7e7f-4af4-8edb-9f2169ce1b03 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] 10.222.0.78 "GET /compute/v2.1/servers/20760e77-fe67-4ebe-87f1-34d840495341" status: 200 len: 1521 microversion: 2.1 time: 0.246856 Feb 17 04:33:27.427799 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 408/766] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:33:27 2021] GET /compute/v2.1/servers/20760e77-fe67-4ebe-87f1-34d840495341 => generated 1521 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:33:27.639420 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-0f2f3ea3-0833-4823-9974-c24aaf77ae0b tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:33:27.640032 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-0f2f3ea3-0833-4823-9974-c24aaf77ae0b tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] [instance: b195626c-7ee1-4679-b956-f7ef7d6328f6] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:33:27.647967 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-0f2f3ea3-0833-4823-9974-c24aaf77ae0b tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:27.648479 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-0f2f3ea3-0833-4823-9974-c24aaf77ae0b tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:27.649318 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-0f2f3ea3-0833-4823-9974-c24aaf77ae0b tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:27.649824 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-0f2f3ea3-0833-4823-9974-c24aaf77ae0b tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:27.872521 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-0f2f3ea3-0833-4823-9974-c24aaf77ae0b tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f3e4c3c174942c492405c9b112667de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5b2911946848de81be8f9741faa90f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:33:27.881208 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-0f2f3ea3-0833-4823-9974-c24aaf77ae0b tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] 10.222.0.78 "GET /compute/v2.1/servers/b195626c-7ee1-4679-b956-f7ef7d6328f6" status: 200 len: 1358 microversion: 2.1 time: 0.245995 Feb 17 04:33:27.881808 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 409/767] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:33:27 2021] GET /compute/v2.1/servers/b195626c-7ee1-4679-b956-f7ef7d6328f6 => generated 1358 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:33:28.189453 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-0fffab78-9db4-4b7d-aaca-53b28e193cc9 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:33:28.190218 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-0fffab78-9db4-4b7d-aaca-53b28e193cc9 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] [instance: 1ee42b60-a1c0-4b17-9aa4-01d216665df4] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:33:28.198847 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-0fffab78-9db4-4b7d-aaca-53b28e193cc9 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:28.200340 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-0fffab78-9db4-4b7d-aaca-53b28e193cc9 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:28.201016 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-0fffab78-9db4-4b7d-aaca-53b28e193cc9 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:28.201520 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-0fffab78-9db4-4b7d-aaca-53b28e193cc9 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:28.423418 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-0fffab78-9db4-4b7d-aaca-53b28e193cc9 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d68d4a6c12e4331b8df8191cdd7a669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2a1ca6347d4278899a1cc009d87d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:33:28.432300 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-0fffab78-9db4-4b7d-aaca-53b28e193cc9 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] 10.222.0.78 "GET /compute/v2.1/servers/1ee42b60-a1c0-4b17-9aa4-01d216665df4" status: 200 len: 1514 microversion: 2.1 time: 0.246881 Feb 17 04:33:28.432908 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 410/768] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:33:28 2021] GET /compute/v2.1/servers/1ee42b60-a1c0-4b17-9aa4-01d216665df4 => generated 1514 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:33:28.447281 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-2bdff043-04ec-482c-8f02-94d3cf485425 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:33:28.447897 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-2bdff043-04ec-482c-8f02-94d3cf485425 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] [instance: 20760e77-fe67-4ebe-87f1-34d840495341] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:33:28.456609 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-2bdff043-04ec-482c-8f02-94d3cf485425 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:28.457207 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-2bdff043-04ec-482c-8f02-94d3cf485425 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:28.458066 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-2bdff043-04ec-482c-8f02-94d3cf485425 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:28.458565 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-2bdff043-04ec-482c-8f02-94d3cf485425 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:28.679551 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-2bdff043-04ec-482c-8f02-94d3cf485425 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1daf9a83b1d24033a3d4c0f531a4eb2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5336afdcf4aa4b46b0655432b7a1323c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:33:28.689165 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-2bdff043-04ec-482c-8f02-94d3cf485425 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] 10.222.0.78 "GET /compute/v2.1/servers/20760e77-fe67-4ebe-87f1-34d840495341" status: 200 len: 1521 microversion: 2.1 time: 0.245840 Feb 17 04:33:28.689759 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 411/769] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:33:28 2021] GET /compute/v2.1/servers/20760e77-fe67-4ebe-87f1-34d840495341 => generated 1521 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:33:28.899675 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-0892d0ba-41b6-4a16-971d-9d466f6e95d9 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:33:28.900335 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-0892d0ba-41b6-4a16-971d-9d466f6e95d9 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] [instance: b195626c-7ee1-4679-b956-f7ef7d6328f6] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:33:28.908975 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-0892d0ba-41b6-4a16-971d-9d466f6e95d9 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:28.909475 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-0892d0ba-41b6-4a16-971d-9d466f6e95d9 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:28.910297 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-0892d0ba-41b6-4a16-971d-9d466f6e95d9 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:28.910783 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-0892d0ba-41b6-4a16-971d-9d466f6e95d9 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:29.148587 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-0892d0ba-41b6-4a16-971d-9d466f6e95d9 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f3e4c3c174942c492405c9b112667de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5b2911946848de81be8f9741faa90f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:33:29.159418 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-0892d0ba-41b6-4a16-971d-9d466f6e95d9 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] 10.222.0.78 "GET /compute/v2.1/servers/b195626c-7ee1-4679-b956-f7ef7d6328f6" status: 200 len: 1358 microversion: 2.1 time: 0.263475 Feb 17 04:33:29.163997 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 412/770] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:33:28 2021] GET /compute/v2.1/servers/b195626c-7ee1-4679-b956-f7ef7d6328f6 => generated 1358 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:33:29.450464 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-e3d59ddb-a7e8-4166-982d-6a4ac54aaa79 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:33:29.451216 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-e3d59ddb-a7e8-4166-982d-6a4ac54aaa79 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] [instance: 1ee42b60-a1c0-4b17-9aa4-01d216665df4] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:33:29.459164 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-e3d59ddb-a7e8-4166-982d-6a4ac54aaa79 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:29.459671 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-e3d59ddb-a7e8-4166-982d-6a4ac54aaa79 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:29.460558 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-e3d59ddb-a7e8-4166-982d-6a4ac54aaa79 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:29.461050 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-e3d59ddb-a7e8-4166-982d-6a4ac54aaa79 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:29.674530 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-e3d59ddb-a7e8-4166-982d-6a4ac54aaa79 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d68d4a6c12e4331b8df8191cdd7a669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2a1ca6347d4278899a1cc009d87d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:33:29.684176 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-e3d59ddb-a7e8-4166-982d-6a4ac54aaa79 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] 10.222.0.78 "GET /compute/v2.1/servers/1ee42b60-a1c0-4b17-9aa4-01d216665df4" status: 200 len: 1514 microversion: 2.1 time: 0.237641 Feb 17 04:33:29.684475 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 413/771] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:33:29 2021] GET /compute/v2.1/servers/1ee42b60-a1c0-4b17-9aa4-01d216665df4 => generated 1514 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:33:29.707318 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-b2ab2b3b-510a-43c3-83d3-3ccff71eda9f tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:33:29.707911 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-b2ab2b3b-510a-43c3-83d3-3ccff71eda9f tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] [instance: 20760e77-fe67-4ebe-87f1-34d840495341] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:33:29.716656 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-b2ab2b3b-510a-43c3-83d3-3ccff71eda9f tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:29.717164 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-b2ab2b3b-510a-43c3-83d3-3ccff71eda9f tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:29.718013 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-b2ab2b3b-510a-43c3-83d3-3ccff71eda9f tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:29.718505 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-b2ab2b3b-510a-43c3-83d3-3ccff71eda9f tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:29.932281 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-b2ab2b3b-510a-43c3-83d3-3ccff71eda9f tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1daf9a83b1d24033a3d4c0f531a4eb2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5336afdcf4aa4b46b0655432b7a1323c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:33:29.942365 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-b2ab2b3b-510a-43c3-83d3-3ccff71eda9f tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] 10.222.0.78 "GET /compute/v2.1/servers/20760e77-fe67-4ebe-87f1-34d840495341" status: 200 len: 1521 microversion: 2.1 time: 0.239274 Feb 17 04:33:29.943105 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 414/772] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:33:29 2021] GET /compute/v2.1/servers/20760e77-fe67-4ebe-87f1-34d840495341 => generated 1521 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:33:30.178131 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-deec6105-a8d5-444f-9ae2-49d168ab84ba tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:33:30.178813 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-deec6105-a8d5-444f-9ae2-49d168ab84ba tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] [instance: b195626c-7ee1-4679-b956-f7ef7d6328f6] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:33:30.187337 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-deec6105-a8d5-444f-9ae2-49d168ab84ba tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:30.187852 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-deec6105-a8d5-444f-9ae2-49d168ab84ba tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:30.188692 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-deec6105-a8d5-444f-9ae2-49d168ab84ba tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:30.189190 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-deec6105-a8d5-444f-9ae2-49d168ab84ba tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:30.408710 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-deec6105-a8d5-444f-9ae2-49d168ab84ba tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f3e4c3c174942c492405c9b112667de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5b2911946848de81be8f9741faa90f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:33:30.417482 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-deec6105-a8d5-444f-9ae2-49d168ab84ba tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] 10.222.0.78 "GET /compute/v2.1/servers/b195626c-7ee1-4679-b956-f7ef7d6328f6" status: 200 len: 1358 microversion: 2.1 time: 0.243402 Feb 17 04:33:30.418790 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 415/773] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:33:30 2021] GET /compute/v2.1/servers/b195626c-7ee1-4679-b956-f7ef7d6328f6 => generated 1358 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:33:30.702510 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-5f740dbc-c13d-4ef5-9247-f6ca68cbd939 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:33:30.703212 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-5f740dbc-c13d-4ef5-9247-f6ca68cbd939 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] [instance: 1ee42b60-a1c0-4b17-9aa4-01d216665df4] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:33:30.712006 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-5f740dbc-c13d-4ef5-9247-f6ca68cbd939 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:30.712461 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-5f740dbc-c13d-4ef5-9247-f6ca68cbd939 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:30.713311 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-5f740dbc-c13d-4ef5-9247-f6ca68cbd939 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:30.713811 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-5f740dbc-c13d-4ef5-9247-f6ca68cbd939 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:31.128617 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-5f740dbc-c13d-4ef5-9247-f6ca68cbd939 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d68d4a6c12e4331b8df8191cdd7a669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2a1ca6347d4278899a1cc009d87d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:33:31.138648 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-5f740dbc-c13d-4ef5-9247-f6ca68cbd939 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] 10.222.0.78 "GET /compute/v2.1/servers/1ee42b60-a1c0-4b17-9aa4-01d216665df4" status: 200 len: 1514 microversion: 2.1 time: 0.440623 Feb 17 04:33:31.149251 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 416/774] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:33:30 2021] GET /compute/v2.1/servers/1ee42b60-a1c0-4b17-9aa4-01d216665df4 => generated 1514 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:33:31.149251 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-d38a6aa2-a638-4145-96c9-1b8378d289e6 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:33:31.149251 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-d38a6aa2-a638-4145-96c9-1b8378d289e6 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] [instance: 20760e77-fe67-4ebe-87f1-34d840495341] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:33:31.153954 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-d38a6aa2-a638-4145-96c9-1b8378d289e6 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:31.154463 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-d38a6aa2-a638-4145-96c9-1b8378d289e6 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:31.155333 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-d38a6aa2-a638-4145-96c9-1b8378d289e6 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:31.155824 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-d38a6aa2-a638-4145-96c9-1b8378d289e6 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:31.377207 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-d38a6aa2-a638-4145-96c9-1b8378d289e6 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1daf9a83b1d24033a3d4c0f531a4eb2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5336afdcf4aa4b46b0655432b7a1323c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:33:31.386040 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-d38a6aa2-a638-4145-96c9-1b8378d289e6 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] 10.222.0.78 "GET /compute/v2.1/servers/20760e77-fe67-4ebe-87f1-34d840495341" status: 200 len: 1521 microversion: 2.1 time: 0.245741 Feb 17 04:33:31.387220 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 417/775] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:33:31 2021] GET /compute/v2.1/servers/20760e77-fe67-4ebe-87f1-34d840495341 => generated 1521 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:33:31.436569 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-cc1a3116-fcc8-43f3-8ffe-0d406fe889ab tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:33:31.437305 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-cc1a3116-fcc8-43f3-8ffe-0d406fe889ab tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] [instance: b195626c-7ee1-4679-b956-f7ef7d6328f6] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:33:31.444840 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-cc1a3116-fcc8-43f3-8ffe-0d406fe889ab tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:31.445343 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-cc1a3116-fcc8-43f3-8ffe-0d406fe889ab tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:31.446172 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-cc1a3116-fcc8-43f3-8ffe-0d406fe889ab tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:31.446662 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-cc1a3116-fcc8-43f3-8ffe-0d406fe889ab tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:31.815769 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-cc1a3116-fcc8-43f3-8ffe-0d406fe889ab tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f3e4c3c174942c492405c9b112667de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5b2911946848de81be8f9741faa90f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:33:31.826152 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-cc1a3116-fcc8-43f3-8ffe-0d406fe889ab tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] 10.222.0.78 "GET /compute/v2.1/servers/b195626c-7ee1-4679-b956-f7ef7d6328f6" status: 200 len: 1358 microversion: 2.1 time: 0.393715 Feb 17 04:33:31.826959 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 418/776] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:33:31 2021] GET /compute/v2.1/servers/b195626c-7ee1-4679-b956-f7ef7d6328f6 => generated 1358 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:33:32.158589 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-a5bbd99d-7f64-426c-b5e9-a2024024a038 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:33:32.159920 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-a5bbd99d-7f64-426c-b5e9-a2024024a038 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] [instance: 1ee42b60-a1c0-4b17-9aa4-01d216665df4] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:33:32.178655 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-a5bbd99d-7f64-426c-b5e9-a2024024a038 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:32.179212 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-a5bbd99d-7f64-426c-b5e9-a2024024a038 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:32.180312 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-a5bbd99d-7f64-426c-b5e9-a2024024a038 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:32.180961 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-a5bbd99d-7f64-426c-b5e9-a2024024a038 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:32.396292 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-a5bbd99d-7f64-426c-b5e9-a2024024a038 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d68d4a6c12e4331b8df8191cdd7a669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2a1ca6347d4278899a1cc009d87d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:33:32.405526 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-a5bbd99d-7f64-426c-b5e9-a2024024a038 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] 10.222.0.78 "GET /compute/v2.1/servers/1ee42b60-a1c0-4b17-9aa4-01d216665df4" status: 200 len: 1514 microversion: 2.1 time: 0.251945 Feb 17 04:33:32.406111 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 419/777] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:33:32 2021] GET /compute/v2.1/servers/1ee42b60-a1c0-4b17-9aa4-01d216665df4 => generated 1514 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:33:32.410924 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-1ef97e54-973e-4286-a166-4b67cb720785 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:33:32.411590 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-1ef97e54-973e-4286-a166-4b67cb720785 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] [instance: 20760e77-fe67-4ebe-87f1-34d840495341] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:33:32.420054 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-1ef97e54-973e-4286-a166-4b67cb720785 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:32.420571 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-1ef97e54-973e-4286-a166-4b67cb720785 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:32.421411 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-1ef97e54-973e-4286-a166-4b67cb720785 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:32.421905 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-1ef97e54-973e-4286-a166-4b67cb720785 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:32.650758 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-1ef97e54-973e-4286-a166-4b67cb720785 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1daf9a83b1d24033a3d4c0f531a4eb2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5336afdcf4aa4b46b0655432b7a1323c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:33:32.661444 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-1ef97e54-973e-4286-a166-4b67cb720785 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] 10.222.0.78 "GET /compute/v2.1/servers/20760e77-fe67-4ebe-87f1-34d840495341" status: 200 len: 1521 microversion: 2.1 time: 0.254161 Feb 17 04:33:32.662182 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 420/778] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:33:32 2021] GET /compute/v2.1/servers/20760e77-fe67-4ebe-87f1-34d840495341 => generated 1521 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:33:32.844806 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-9db8b808-b84d-468c-9476-f1712ef19900 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:33:32.845470 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-9db8b808-b84d-468c-9476-f1712ef19900 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] [instance: b195626c-7ee1-4679-b956-f7ef7d6328f6] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:33:32.854619 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-9db8b808-b84d-468c-9476-f1712ef19900 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:32.855905 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-9db8b808-b84d-468c-9476-f1712ef19900 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:32.856971 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-9db8b808-b84d-468c-9476-f1712ef19900 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:32.857464 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-9db8b808-b84d-468c-9476-f1712ef19900 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:33.085655 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-9db8b808-b84d-468c-9476-f1712ef19900 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f3e4c3c174942c492405c9b112667de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5b2911946848de81be8f9741faa90f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:33:33.095014 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-9db8b808-b84d-468c-9476-f1712ef19900 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] 10.222.0.78 "GET /compute/v2.1/servers/b195626c-7ee1-4679-b956-f7ef7d6328f6" status: 200 len: 1358 microversion: 2.1 time: 0.254343 Feb 17 04:33:33.095636 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 421/779] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:33:32 2021] GET /compute/v2.1/servers/b195626c-7ee1-4679-b956-f7ef7d6328f6 => generated 1358 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:33:33.424939 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-b2e636e0-56ba-4b2b-baee-2b202972d36a tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:33:33.425535 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-b2e636e0-56ba-4b2b-baee-2b202972d36a tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] [instance: 1ee42b60-a1c0-4b17-9aa4-01d216665df4] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:33:33.433402 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-b2e636e0-56ba-4b2b-baee-2b202972d36a tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:33.433922 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-b2e636e0-56ba-4b2b-baee-2b202972d36a tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:33.434744 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-b2e636e0-56ba-4b2b-baee-2b202972d36a tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:33.435292 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-b2e636e0-56ba-4b2b-baee-2b202972d36a tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:33.652040 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-b2e636e0-56ba-4b2b-baee-2b202972d36a tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d68d4a6c12e4331b8df8191cdd7a669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2a1ca6347d4278899a1cc009d87d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:33:33.661118 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-b2e636e0-56ba-4b2b-baee-2b202972d36a tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] 10.222.0.78 "GET /compute/v2.1/servers/1ee42b60-a1c0-4b17-9aa4-01d216665df4" status: 200 len: 1514 microversion: 2.1 time: 0.240210 Feb 17 04:33:33.661729 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 422/780] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:33:33 2021] GET /compute/v2.1/servers/1ee42b60-a1c0-4b17-9aa4-01d216665df4 => generated 1514 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:33:33.680170 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-398acfc0-3fb9-4063-a0f0-010a96f055a4 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:33:33.680780 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-398acfc0-3fb9-4063-a0f0-010a96f055a4 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] [instance: 20760e77-fe67-4ebe-87f1-34d840495341] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:33:33.689159 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-398acfc0-3fb9-4063-a0f0-010a96f055a4 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:33.689667 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-398acfc0-3fb9-4063-a0f0-010a96f055a4 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:33.690505 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-398acfc0-3fb9-4063-a0f0-010a96f055a4 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:33.690997 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-398acfc0-3fb9-4063-a0f0-010a96f055a4 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:33.905311 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-398acfc0-3fb9-4063-a0f0-010a96f055a4 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1daf9a83b1d24033a3d4c0f531a4eb2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5336afdcf4aa4b46b0655432b7a1323c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:33:33.914837 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-398acfc0-3fb9-4063-a0f0-010a96f055a4 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] 10.222.0.78 "GET /compute/v2.1/servers/20760e77-fe67-4ebe-87f1-34d840495341" status: 200 len: 1521 microversion: 2.1 time: 0.238421 Feb 17 04:33:33.915474 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 423/781] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:33:33 2021] GET /compute/v2.1/servers/20760e77-fe67-4ebe-87f1-34d840495341 => generated 1521 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:33:34.113543 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-ad0a82a4-b08b-44dd-b0f6-0e8eca71e8af tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:33:34.114220 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-ad0a82a4-b08b-44dd-b0f6-0e8eca71e8af tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] [instance: b195626c-7ee1-4679-b956-f7ef7d6328f6] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:33:34.123686 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-ad0a82a4-b08b-44dd-b0f6-0e8eca71e8af tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:34.124208 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-ad0a82a4-b08b-44dd-b0f6-0e8eca71e8af tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:34.125077 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-ad0a82a4-b08b-44dd-b0f6-0e8eca71e8af tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:34.125580 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-ad0a82a4-b08b-44dd-b0f6-0e8eca71e8af tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:34.350570 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-ad0a82a4-b08b-44dd-b0f6-0e8eca71e8af tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f3e4c3c174942c492405c9b112667de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5b2911946848de81be8f9741faa90f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:33:34.359973 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-ad0a82a4-b08b-44dd-b0f6-0e8eca71e8af tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] 10.222.0.78 "GET /compute/v2.1/servers/b195626c-7ee1-4679-b956-f7ef7d6328f6" status: 200 len: 1358 microversion: 2.1 time: 0.251032 Feb 17 04:33:34.360829 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 424/782] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:33:34 2021] GET /compute/v2.1/servers/b195626c-7ee1-4679-b956-f7ef7d6328f6 => generated 1358 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:33:34.680901 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-57accaaf-1ff8-4087-a8c8-4dbbe6bdb698 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:33:34.681570 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-57accaaf-1ff8-4087-a8c8-4dbbe6bdb698 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] [instance: 1ee42b60-a1c0-4b17-9aa4-01d216665df4] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:33:34.689404 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-57accaaf-1ff8-4087-a8c8-4dbbe6bdb698 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:34.689907 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-57accaaf-1ff8-4087-a8c8-4dbbe6bdb698 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:34.690733 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-57accaaf-1ff8-4087-a8c8-4dbbe6bdb698 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:34.691256 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-57accaaf-1ff8-4087-a8c8-4dbbe6bdb698 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:34.918713 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-57accaaf-1ff8-4087-a8c8-4dbbe6bdb698 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d68d4a6c12e4331b8df8191cdd7a669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2a1ca6347d4278899a1cc009d87d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:33:34.928823 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-57accaaf-1ff8-4087-a8c8-4dbbe6bdb698 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] 10.222.0.78 "GET /compute/v2.1/servers/1ee42b60-a1c0-4b17-9aa4-01d216665df4" status: 200 len: 1514 microversion: 2.1 time: 0.251697 Feb 17 04:33:34.928823 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 425/783] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:33:34 2021] GET /compute/v2.1/servers/1ee42b60-a1c0-4b17-9aa4-01d216665df4 => generated 1514 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:33:34.935227 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-97d4ab83-d7e0-4c7c-9410-4ec1223bf497 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:33:34.935227 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-97d4ab83-d7e0-4c7c-9410-4ec1223bf497 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] [instance: 20760e77-fe67-4ebe-87f1-34d840495341] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:33:34.942523 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-97d4ab83-d7e0-4c7c-9410-4ec1223bf497 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:34.943059 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-97d4ab83-d7e0-4c7c-9410-4ec1223bf497 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:34.943912 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-97d4ab83-d7e0-4c7c-9410-4ec1223bf497 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:34.944401 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-97d4ab83-d7e0-4c7c-9410-4ec1223bf497 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:35.169147 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-97d4ab83-d7e0-4c7c-9410-4ec1223bf497 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1daf9a83b1d24033a3d4c0f531a4eb2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5336afdcf4aa4b46b0655432b7a1323c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:33:35.178300 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-97d4ab83-d7e0-4c7c-9410-4ec1223bf497 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] 10.222.0.78 "GET /compute/v2.1/servers/20760e77-fe67-4ebe-87f1-34d840495341" status: 200 len: 1521 microversion: 2.1 time: 0.248183 Feb 17 04:33:35.178907 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 426/784] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:33:34 2021] GET /compute/v2.1/servers/20760e77-fe67-4ebe-87f1-34d840495341 => generated 1521 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:33:35.378536 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-216f114c-36bb-4424-b03a-fb934f5f5a0c tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:33:35.379278 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-216f114c-36bb-4424-b03a-fb934f5f5a0c tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] [instance: b195626c-7ee1-4679-b956-f7ef7d6328f6] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:33:35.387103 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-216f114c-36bb-4424-b03a-fb934f5f5a0c tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:35.387614 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-216f114c-36bb-4424-b03a-fb934f5f5a0c tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:35.388457 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-216f114c-36bb-4424-b03a-fb934f5f5a0c tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:35.388954 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-216f114c-36bb-4424-b03a-fb934f5f5a0c tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:35.606753 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-216f114c-36bb-4424-b03a-fb934f5f5a0c tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f3e4c3c174942c492405c9b112667de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5b2911946848de81be8f9741faa90f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:33:35.616253 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-216f114c-36bb-4424-b03a-fb934f5f5a0c tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] 10.222.0.78 "GET /compute/v2.1/servers/b195626c-7ee1-4679-b956-f7ef7d6328f6" status: 200 len: 1358 microversion: 2.1 time: 0.241616 Feb 17 04:33:35.616882 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 427/785] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:33:35 2021] GET /compute/v2.1/servers/b195626c-7ee1-4679-b956-f7ef7d6328f6 => generated 1358 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:33:35.946324 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-9c97559f-366d-4281-9231-5bd1109f0353 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:33:35.947057 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-9c97559f-366d-4281-9231-5bd1109f0353 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] [instance: 1ee42b60-a1c0-4b17-9aa4-01d216665df4] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:33:35.954922 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-9c97559f-366d-4281-9231-5bd1109f0353 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:35.955465 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-9c97559f-366d-4281-9231-5bd1109f0353 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:35.956309 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-9c97559f-366d-4281-9231-5bd1109f0353 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:35.956823 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-9c97559f-366d-4281-9231-5bd1109f0353 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:36.173705 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-9c97559f-366d-4281-9231-5bd1109f0353 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d68d4a6c12e4331b8df8191cdd7a669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2a1ca6347d4278899a1cc009d87d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:33:36.182850 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-9c97559f-366d-4281-9231-5bd1109f0353 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] 10.222.0.78 "GET /compute/v2.1/servers/1ee42b60-a1c0-4b17-9aa4-01d216665df4" status: 200 len: 1514 microversion: 2.1 time: 0.240571 Feb 17 04:33:36.189052 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 428/786] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:33:35 2021] GET /compute/v2.1/servers/1ee42b60-a1c0-4b17-9aa4-01d216665df4 => generated 1514 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:33:36.197150 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-2e485e92-46ba-435a-b231-0661d8133a67 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:33:36.197693 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-2e485e92-46ba-435a-b231-0661d8133a67 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] [instance: 20760e77-fe67-4ebe-87f1-34d840495341] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:33:36.205948 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-2e485e92-46ba-435a-b231-0661d8133a67 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:36.206445 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-2e485e92-46ba-435a-b231-0661d8133a67 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:36.207360 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-2e485e92-46ba-435a-b231-0661d8133a67 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:36.207846 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-2e485e92-46ba-435a-b231-0661d8133a67 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:36.430613 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-2e485e92-46ba-435a-b231-0661d8133a67 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1daf9a83b1d24033a3d4c0f531a4eb2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5336afdcf4aa4b46b0655432b7a1323c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:33:36.439893 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-2e485e92-46ba-435a-b231-0661d8133a67 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] 10.222.0.78 "GET /compute/v2.1/servers/20760e77-fe67-4ebe-87f1-34d840495341" status: 200 len: 1521 microversion: 2.1 time: 0.246970 Feb 17 04:33:36.440687 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 429/787] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:33:36 2021] GET /compute/v2.1/servers/20760e77-fe67-4ebe-87f1-34d840495341 => generated 1521 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:33:36.634378 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-f8ac8903-398a-416b-aaeb-da97e90a2484 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:33:36.635071 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-f8ac8903-398a-416b-aaeb-da97e90a2484 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] [instance: b195626c-7ee1-4679-b956-f7ef7d6328f6] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:33:36.646190 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-f8ac8903-398a-416b-aaeb-da97e90a2484 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:36.647194 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-f8ac8903-398a-416b-aaeb-da97e90a2484 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:36.648819 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-f8ac8903-398a-416b-aaeb-da97e90a2484 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:36.649971 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-f8ac8903-398a-416b-aaeb-da97e90a2484 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:36.873837 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-f8ac8903-398a-416b-aaeb-da97e90a2484 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f3e4c3c174942c492405c9b112667de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5b2911946848de81be8f9741faa90f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:33:36.883105 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-f8ac8903-398a-416b-aaeb-da97e90a2484 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] 10.222.0.78 "GET /compute/v2.1/servers/b195626c-7ee1-4679-b956-f7ef7d6328f6" status: 200 len: 1358 microversion: 2.1 time: 0.252708 Feb 17 04:33:36.883959 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 430/788] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:33:36 2021] GET /compute/v2.1/servers/b195626c-7ee1-4679-b956-f7ef7d6328f6 => generated 1358 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:33:37.202587 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-f93886e6-bdd9-40af-9f5d-95faca0d194f tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:33:37.203309 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-f93886e6-bdd9-40af-9f5d-95faca0d194f tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] [instance: 1ee42b60-a1c0-4b17-9aa4-01d216665df4] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:33:37.211303 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-f93886e6-bdd9-40af-9f5d-95faca0d194f tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:37.211822 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-f93886e6-bdd9-40af-9f5d-95faca0d194f tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:37.212661 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-f93886e6-bdd9-40af-9f5d-95faca0d194f tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:37.213157 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-f93886e6-bdd9-40af-9f5d-95faca0d194f tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:37.427383 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-f93886e6-bdd9-40af-9f5d-95faca0d194f tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d68d4a6c12e4331b8df8191cdd7a669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2a1ca6347d4278899a1cc009d87d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:33:37.437347 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-f93886e6-bdd9-40af-9f5d-95faca0d194f tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] 10.222.0.78 "GET /compute/v2.1/servers/1ee42b60-a1c0-4b17-9aa4-01d216665df4" status: 200 len: 1514 microversion: 2.1 time: 0.239402 Feb 17 04:33:37.437944 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 431/789] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:33:37 2021] GET /compute/v2.1/servers/1ee42b60-a1c0-4b17-9aa4-01d216665df4 => generated 1514 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:33:37.457817 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-ca772030-00ff-440c-9f82-fd40013cb746 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:33:37.458490 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-ca772030-00ff-440c-9f82-fd40013cb746 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] [instance: 20760e77-fe67-4ebe-87f1-34d840495341] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:33:37.466690 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-ca772030-00ff-440c-9f82-fd40013cb746 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:37.467231 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-ca772030-00ff-440c-9f82-fd40013cb746 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:37.468064 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-ca772030-00ff-440c-9f82-fd40013cb746 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:37.468556 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-ca772030-00ff-440c-9f82-fd40013cb746 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:37.692431 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-ca772030-00ff-440c-9f82-fd40013cb746 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1daf9a83b1d24033a3d4c0f531a4eb2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5336afdcf4aa4b46b0655432b7a1323c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:33:37.702151 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-ca772030-00ff-440c-9f82-fd40013cb746 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] 10.222.0.78 "GET /compute/v2.1/servers/20760e77-fe67-4ebe-87f1-34d840495341" status: 200 len: 1521 microversion: 2.1 time: 0.248337 Feb 17 04:33:37.702762 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 432/790] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:33:37 2021] GET /compute/v2.1/servers/20760e77-fe67-4ebe-87f1-34d840495341 => generated 1521 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:33:37.901536 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-6f21487d-801c-4d7b-9e58-11f8d57f7ef1 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:33:37.902397 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-6f21487d-801c-4d7b-9e58-11f8d57f7ef1 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] [instance: b195626c-7ee1-4679-b956-f7ef7d6328f6] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:33:37.910811 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-6f21487d-801c-4d7b-9e58-11f8d57f7ef1 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:37.911327 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-6f21487d-801c-4d7b-9e58-11f8d57f7ef1 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:37.912166 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-6f21487d-801c-4d7b-9e58-11f8d57f7ef1 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:37.912651 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-6f21487d-801c-4d7b-9e58-11f8d57f7ef1 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:38.125561 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-6f21487d-801c-4d7b-9e58-11f8d57f7ef1 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f3e4c3c174942c492405c9b112667de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5b2911946848de81be8f9741faa90f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:33:38.134298 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-6f21487d-801c-4d7b-9e58-11f8d57f7ef1 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] 10.222.0.78 "GET /compute/v2.1/servers/b195626c-7ee1-4679-b956-f7ef7d6328f6" status: 200 len: 1358 microversion: 2.1 time: 0.236809 Feb 17 04:33:38.135117 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 433/791] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:33:37 2021] GET /compute/v2.1/servers/b195626c-7ee1-4679-b956-f7ef7d6328f6 => generated 1358 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:33:38.455924 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-02af4a15-d158-40da-90bb-b05f97ecf563 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:33:38.456597 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-02af4a15-d158-40da-90bb-b05f97ecf563 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] [instance: 1ee42b60-a1c0-4b17-9aa4-01d216665df4] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:33:38.464504 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-02af4a15-d158-40da-90bb-b05f97ecf563 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:38.465142 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-02af4a15-d158-40da-90bb-b05f97ecf563 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:38.465986 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-02af4a15-d158-40da-90bb-b05f97ecf563 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:38.466477 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-02af4a15-d158-40da-90bb-b05f97ecf563 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:38.688026 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-02af4a15-d158-40da-90bb-b05f97ecf563 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d68d4a6c12e4331b8df8191cdd7a669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2a1ca6347d4278899a1cc009d87d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:33:38.696996 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-02af4a15-d158-40da-90bb-b05f97ecf563 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] 10.222.0.78 "GET /compute/v2.1/servers/1ee42b60-a1c0-4b17-9aa4-01d216665df4" status: 200 len: 1514 microversion: 2.1 time: 0.245121 Feb 17 04:33:38.697599 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 434/792] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:33:38 2021] GET /compute/v2.1/servers/1ee42b60-a1c0-4b17-9aa4-01d216665df4 => generated 1514 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:33:38.720178 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-f9665e4c-976b-40bc-9685-9ecc6fa6d3e2 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:33:38.720840 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-f9665e4c-976b-40bc-9685-9ecc6fa6d3e2 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] [instance: 20760e77-fe67-4ebe-87f1-34d840495341] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:33:38.728621 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-f9665e4c-976b-40bc-9685-9ecc6fa6d3e2 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:38.729143 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-f9665e4c-976b-40bc-9685-9ecc6fa6d3e2 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:38.730389 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-f9665e4c-976b-40bc-9685-9ecc6fa6d3e2 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:38.732027 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-f9665e4c-976b-40bc-9685-9ecc6fa6d3e2 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:38.947938 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-f9665e4c-976b-40bc-9685-9ecc6fa6d3e2 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1daf9a83b1d24033a3d4c0f531a4eb2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5336afdcf4aa4b46b0655432b7a1323c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:33:38.957076 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-f9665e4c-976b-40bc-9685-9ecc6fa6d3e2 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] 10.222.0.78 "GET /compute/v2.1/servers/20760e77-fe67-4ebe-87f1-34d840495341" status: 200 len: 1521 microversion: 2.1 time: 0.240694 Feb 17 04:33:38.957685 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 435/793] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:33:38 2021] GET /compute/v2.1/servers/20760e77-fe67-4ebe-87f1-34d840495341 => generated 1521 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:33:39.153264 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-d1d59baa-2654-4b54-940a-c1515dd6e8cb tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:33:39.153872 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-d1d59baa-2654-4b54-940a-c1515dd6e8cb tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] [instance: b195626c-7ee1-4679-b956-f7ef7d6328f6] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:33:39.161893 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-d1d59baa-2654-4b54-940a-c1515dd6e8cb tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:39.162406 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-d1d59baa-2654-4b54-940a-c1515dd6e8cb tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:39.163282 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-d1d59baa-2654-4b54-940a-c1515dd6e8cb tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:39.163779 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-d1d59baa-2654-4b54-940a-c1515dd6e8cb tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:39.376903 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-d1d59baa-2654-4b54-940a-c1515dd6e8cb tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f3e4c3c174942c492405c9b112667de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5b2911946848de81be8f9741faa90f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:33:39.385746 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-d1d59baa-2654-4b54-940a-c1515dd6e8cb tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] 10.222.0.78 "GET /compute/v2.1/servers/b195626c-7ee1-4679-b956-f7ef7d6328f6" status: 200 len: 1358 microversion: 2.1 time: 0.236570 Feb 17 04:33:39.386346 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 436/794] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:33:39 2021] GET /compute/v2.1/servers/b195626c-7ee1-4679-b956-f7ef7d6328f6 => generated 1358 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:33:39.716158 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-35f06811-9c09-4fdc-8565-363191e3db3a tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:33:39.716834 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-35f06811-9c09-4fdc-8565-363191e3db3a tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] [instance: 1ee42b60-a1c0-4b17-9aa4-01d216665df4] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:33:39.725097 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-35f06811-9c09-4fdc-8565-363191e3db3a tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:39.725583 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-35f06811-9c09-4fdc-8565-363191e3db3a tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:39.726418 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-35f06811-9c09-4fdc-8565-363191e3db3a tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:39.726913 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-35f06811-9c09-4fdc-8565-363191e3db3a tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:39.942227 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-35f06811-9c09-4fdc-8565-363191e3db3a tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d68d4a6c12e4331b8df8191cdd7a669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2a1ca6347d4278899a1cc009d87d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:33:39.951983 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-35f06811-9c09-4fdc-8565-363191e3db3a tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] 10.222.0.78 "GET /compute/v2.1/servers/1ee42b60-a1c0-4b17-9aa4-01d216665df4" status: 200 len: 1514 microversion: 2.1 time: 0.240355 Feb 17 04:33:39.952578 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 437/795] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:33:39 2021] GET /compute/v2.1/servers/1ee42b60-a1c0-4b17-9aa4-01d216665df4 => generated 1514 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:33:39.974746 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-b0c2aeb9-185c-49d0-b838-26989a4fb5db tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:33:39.975427 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-b0c2aeb9-185c-49d0-b838-26989a4fb5db tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] [instance: 20760e77-fe67-4ebe-87f1-34d840495341] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:33:39.983090 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-b0c2aeb9-185c-49d0-b838-26989a4fb5db tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:39.983603 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-b0c2aeb9-185c-49d0-b838-26989a4fb5db tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:39.984429 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-b0c2aeb9-185c-49d0-b838-26989a4fb5db tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:39.984914 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-b0c2aeb9-185c-49d0-b838-26989a4fb5db tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:40.201489 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-b0c2aeb9-185c-49d0-b838-26989a4fb5db tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1daf9a83b1d24033a3d4c0f531a4eb2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5336afdcf4aa4b46b0655432b7a1323c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:33:40.210482 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-b0c2aeb9-185c-49d0-b838-26989a4fb5db tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] 10.222.0.78 "GET /compute/v2.1/servers/20760e77-fe67-4ebe-87f1-34d840495341" status: 200 len: 1521 microversion: 2.1 time: 0.239404 Feb 17 04:33:40.211104 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 438/796] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:33:39 2021] GET /compute/v2.1/servers/20760e77-fe67-4ebe-87f1-34d840495341 => generated 1521 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:33:40.403377 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-2629c9fa-4b2d-4496-b0ae-f2deb3a48fe1 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:33:40.404060 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-2629c9fa-4b2d-4496-b0ae-f2deb3a48fe1 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] [instance: b195626c-7ee1-4679-b956-f7ef7d6328f6] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:33:40.412083 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-2629c9fa-4b2d-4496-b0ae-f2deb3a48fe1 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:40.412597 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-2629c9fa-4b2d-4496-b0ae-f2deb3a48fe1 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:40.413441 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-2629c9fa-4b2d-4496-b0ae-f2deb3a48fe1 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:40.413941 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-2629c9fa-4b2d-4496-b0ae-f2deb3a48fe1 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:40.630709 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-2629c9fa-4b2d-4496-b0ae-f2deb3a48fe1 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f3e4c3c174942c492405c9b112667de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5b2911946848de81be8f9741faa90f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:33:40.640258 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-2629c9fa-4b2d-4496-b0ae-f2deb3a48fe1 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] 10.222.0.78 "GET /compute/v2.1/servers/b195626c-7ee1-4679-b956-f7ef7d6328f6" status: 200 len: 1358 microversion: 2.1 time: 0.240913 Feb 17 04:33:40.640803 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 439/797] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:33:40 2021] GET /compute/v2.1/servers/b195626c-7ee1-4679-b956-f7ef7d6328f6 => generated 1358 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:33:40.970753 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-5d698aa0-5d84-45ac-b057-04987c4d30cb tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:33:40.971456 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-5d698aa0-5d84-45ac-b057-04987c4d30cb tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] [instance: 1ee42b60-a1c0-4b17-9aa4-01d216665df4] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:33:40.979430 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-5d698aa0-5d84-45ac-b057-04987c4d30cb tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:40.979945 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-5d698aa0-5d84-45ac-b057-04987c4d30cb tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:40.981421 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-5d698aa0-5d84-45ac-b057-04987c4d30cb tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:40.981923 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-5d698aa0-5d84-45ac-b057-04987c4d30cb tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:41.104525 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-406bd007-06b7-4df8-874f-6cb612058f3d tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "POST /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529/action" status: 200 len: 38283 microversion: 2.1 time: 26.114656 Feb 17 04:33:41.106166 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 359/798] 10.222.0.78 () {60 vars in 1268 bytes} [Wed Feb 17 04:33:14 2021] POST /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529/action => generated 38283 bytes in 26116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 04:33:41.239868 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-5d698aa0-5d84-45ac-b057-04987c4d30cb tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d68d4a6c12e4331b8df8191cdd7a669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2a1ca6347d4278899a1cc009d87d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:33:41.250604 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-5d698aa0-5d84-45ac-b057-04987c4d30cb tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] 10.222.0.78 "GET /compute/v2.1/servers/1ee42b60-a1c0-4b17-9aa4-01d216665df4" status: 200 len: 1514 microversion: 2.1 time: 0.283521 Feb 17 04:33:41.251461 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 440/799] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:33:40 2021] GET /compute/v2.1/servers/1ee42b60-a1c0-4b17-9aa4-01d216665df4 => generated 1514 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:33:41.256391 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-ed324b3c-194c-4b1b-ab51-051dd6ec1b65 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:33:41.257069 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-ed324b3c-194c-4b1b-ab51-051dd6ec1b65 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] [instance: 20760e77-fe67-4ebe-87f1-34d840495341] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:33:41.265522 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-ed324b3c-194c-4b1b-ab51-051dd6ec1b65 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:41.266171 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-ed324b3c-194c-4b1b-ab51-051dd6ec1b65 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:41.267028 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-ed324b3c-194c-4b1b-ab51-051dd6ec1b65 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:41.267327 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-4b093f7c-3815-429c-bafb-93827e93de79 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:33:41.267621 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-ed324b3c-194c-4b1b-ab51-051dd6ec1b65 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:41.267993 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-4b093f7c-3815-429c-bafb-93827e93de79 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: 29d1ce27-f63b-4523-88be-55f65a6a2529] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:33:41.276949 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-4b093f7c-3815-429c-bafb-93827e93de79 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:41.277662 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-4b093f7c-3815-429c-bafb-93827e93de79 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:41.278585 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-4b093f7c-3815-429c-bafb-93827e93de79 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:41.279138 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-4b093f7c-3815-429c-bafb-93827e93de79 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:41.345404 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-4b093f7c-3815-429c-bafb-93827e93de79 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "GET /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529/ips" status: 200 len: 144 microversion: 2.1 time: 0.232573 Feb 17 04:33:41.346012 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 360/800] 10.222.0.78 () {58 vars in 1238 bytes} [Wed Feb 17 04:33:41 2021] GET /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529/ips => generated 144 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 17 04:33:41.488611 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-ed324b3c-194c-4b1b-ab51-051dd6ec1b65 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1daf9a83b1d24033a3d4c0f531a4eb2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5336afdcf4aa4b46b0655432b7a1323c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:33:41.499836 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-ed324b3c-194c-4b1b-ab51-051dd6ec1b65 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] 10.222.0.78 "GET /compute/v2.1/servers/20760e77-fe67-4ebe-87f1-34d840495341" status: 200 len: 1521 microversion: 2.1 time: 0.247515 Feb 17 04:33:41.500601 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 441/801] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:33:41 2021] GET /compute/v2.1/servers/20760e77-fe67-4ebe-87f1-34d840495341 => generated 1521 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:33:41.659276 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-184dd0a5-88a3-41db-8bce-f5a4a3be5184 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:33:41.659963 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-184dd0a5-88a3-41db-8bce-f5a4a3be5184 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] [instance: b195626c-7ee1-4679-b956-f7ef7d6328f6] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:33:41.668678 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-184dd0a5-88a3-41db-8bce-f5a4a3be5184 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:41.669202 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-184dd0a5-88a3-41db-8bce-f5a4a3be5184 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:41.670056 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-184dd0a5-88a3-41db-8bce-f5a4a3be5184 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:41.670558 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-184dd0a5-88a3-41db-8bce-f5a4a3be5184 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:42.268773 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-a84652f3-0274-41b8-80d8-c032623c60c2 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:33:42.269543 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-a84652f3-0274-41b8-80d8-c032623c60c2 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] [instance: 1ee42b60-a1c0-4b17-9aa4-01d216665df4] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:33:42.278287 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-a84652f3-0274-41b8-80d8-c032623c60c2 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:42.278873 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-a84652f3-0274-41b8-80d8-c032623c60c2 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:42.279763 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-a84652f3-0274-41b8-80d8-c032623c60c2 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:42.280256 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-a84652f3-0274-41b8-80d8-c032623c60c2 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:42.505411 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-a84652f3-0274-41b8-80d8-c032623c60c2 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d68d4a6c12e4331b8df8191cdd7a669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2a1ca6347d4278899a1cc009d87d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:33:42.515903 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-a84652f3-0274-41b8-80d8-c032623c60c2 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] 10.222.0.78 "GET /compute/v2.1/servers/1ee42b60-a1c0-4b17-9aa4-01d216665df4" status: 200 len: 1514 microversion: 2.1 time: 0.250977 Feb 17 04:33:42.516538 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 442/802] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:33:42 2021] GET /compute/v2.1/servers/1ee42b60-a1c0-4b17-9aa4-01d216665df4 => generated 1514 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:33:42.521805 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-1b1b1110-a1bd-4daa-9f80-ae1288c462a9 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:33:42.522484 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-1b1b1110-a1bd-4daa-9f80-ae1288c462a9 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] [instance: 20760e77-fe67-4ebe-87f1-34d840495341] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:33:42.531419 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-1b1b1110-a1bd-4daa-9f80-ae1288c462a9 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:42.531928 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-1b1b1110-a1bd-4daa-9f80-ae1288c462a9 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:42.532787 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-1b1b1110-a1bd-4daa-9f80-ae1288c462a9 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:42.533275 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-1b1b1110-a1bd-4daa-9f80-ae1288c462a9 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:42.760262 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-1b1b1110-a1bd-4daa-9f80-ae1288c462a9 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1daf9a83b1d24033a3d4c0f531a4eb2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5336afdcf4aa4b46b0655432b7a1323c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:33:42.771207 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-1b1b1110-a1bd-4daa-9f80-ae1288c462a9 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] 10.222.0.78 "GET /compute/v2.1/servers/20760e77-fe67-4ebe-87f1-34d840495341" status: 200 len: 1521 microversion: 2.1 time: 0.253491 Feb 17 04:33:42.771821 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 443/803] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:33:42 2021] GET /compute/v2.1/servers/20760e77-fe67-4ebe-87f1-34d840495341 => generated 1521 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:33:42.785018 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-184dd0a5-88a3-41db-8bce-f5a4a3be5184 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f3e4c3c174942c492405c9b112667de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5b2911946848de81be8f9741faa90f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:33:42.795087 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-184dd0a5-88a3-41db-8bce-f5a4a3be5184 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] 10.222.0.78 "GET /compute/v2.1/servers/b195626c-7ee1-4679-b956-f7ef7d6328f6" status: 200 len: 1358 microversion: 2.1 time: 1.139372 Feb 17 04:33:42.796049 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 361/804] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:33:41 2021] GET /compute/v2.1/servers/b195626c-7ee1-4679-b956-f7ef7d6328f6 => generated 1358 bytes in 1141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:33:43.534731 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-2c80b55e-e984-4876-8f44-cc5962576861 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:33:43.535458 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-2c80b55e-e984-4876-8f44-cc5962576861 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] [instance: 1ee42b60-a1c0-4b17-9aa4-01d216665df4] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:33:43.543707 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-2c80b55e-e984-4876-8f44-cc5962576861 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:43.544223 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-2c80b55e-e984-4876-8f44-cc5962576861 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:43.545062 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-2c80b55e-e984-4876-8f44-cc5962576861 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:43.545552 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-2c80b55e-e984-4876-8f44-cc5962576861 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:43.566864 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [req-95e97f19-1f6c-40d6-89e8-572bf1737cee req-884802e4-e5a2-4bc5-88b6-5198495e3c02 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b195626c-7ee1-4679-b956-f7ef7d6328f6", "tag": "b60a0e42-338e-46c0-ba43-9b2027219e08"}]} {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:33:43.568636 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:33:43.568636 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: warnings.warn(msg) Feb 17 04:33:43.579540 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [req-95e97f19-1f6c-40d6-89e8-572bf1737cee req-884802e4-e5a2-4bc5-88b6-5198495e3c02 service nova] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:43.580055 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [req-95e97f19-1f6c-40d6-89e8-572bf1737cee req-884802e4-e5a2-4bc5-88b6-5198495e3c02 service nova] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:43.599069 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.compute.server_external_events [req-95e97f19-1f6c-40d6-89e8-572bf1737cee req-884802e4-e5a2-4bc5-88b6-5198495e3c02 service nova] Creating event network-changed:b60a0e42-338e-46c0-ba43-9b2027219e08 for instance b195626c-7ee1-4679-b956-f7ef7d6328f6 on hv-cinder-75998 Feb 17 04:33:43.604164 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [req-95e97f19-1f6c-40d6-89e8-572bf1737cee req-884802e4-e5a2-4bc5-88b6-5198495e3c02 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041736 Feb 17 04:33:43.604804 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 362/805] 10.222.0.78 () {64 vars in 1308 bytes} [Wed Feb 17 04:33:43 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:33:43.773803 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-2c80b55e-e984-4876-8f44-cc5962576861 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d68d4a6c12e4331b8df8191cdd7a669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2a1ca6347d4278899a1cc009d87d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:33:43.784093 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-2c80b55e-e984-4876-8f44-cc5962576861 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] 10.222.0.78 "GET /compute/v2.1/servers/1ee42b60-a1c0-4b17-9aa4-01d216665df4" status: 200 len: 1514 microversion: 2.1 time: 0.252681 Feb 17 04:33:43.784093 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 444/806] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:33:43 2021] GET /compute/v2.1/servers/1ee42b60-a1c0-4b17-9aa4-01d216665df4 => generated 1514 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:33:43.801277 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-45e2a1c6-a489-44c7-a7ab-403e52ef7df1 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:33:43.802318 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-45e2a1c6-a489-44c7-a7ab-403e52ef7df1 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] [instance: 20760e77-fe67-4ebe-87f1-34d840495341] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:33:43.819105 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-9072f1eb-dc8f-4b19-b90d-78a0bf4b18a4 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:33:43.819105 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-9072f1eb-dc8f-4b19-b90d-78a0bf4b18a4 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] [instance: b195626c-7ee1-4679-b956-f7ef7d6328f6] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:33:43.819271 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-45e2a1c6-a489-44c7-a7ab-403e52ef7df1 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:43.819271 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-45e2a1c6-a489-44c7-a7ab-403e52ef7df1 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:43.819271 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-45e2a1c6-a489-44c7-a7ab-403e52ef7df1 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:43.819271 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-45e2a1c6-a489-44c7-a7ab-403e52ef7df1 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:43.824996 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-9072f1eb-dc8f-4b19-b90d-78a0bf4b18a4 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:43.825276 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-9072f1eb-dc8f-4b19-b90d-78a0bf4b18a4 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:43.826321 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-9072f1eb-dc8f-4b19-b90d-78a0bf4b18a4 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:43.826823 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-9072f1eb-dc8f-4b19-b90d-78a0bf4b18a4 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:44.047499 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-9072f1eb-dc8f-4b19-b90d-78a0bf4b18a4 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f3e4c3c174942c492405c9b112667de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5b2911946848de81be8f9741faa90f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:33:44.056380 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-9072f1eb-dc8f-4b19-b90d-78a0bf4b18a4 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] 10.222.0.78 "GET /compute/v2.1/servers/b195626c-7ee1-4679-b956-f7ef7d6328f6" status: 200 len: 1358 microversion: 2.1 time: 0.246537 Feb 17 04:33:44.056981 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 445/807] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:33:43 2021] GET /compute/v2.1/servers/b195626c-7ee1-4679-b956-f7ef7d6328f6 => generated 1358 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:33:44.320695 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-45e2a1c6-a489-44c7-a7ab-403e52ef7df1 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1daf9a83b1d24033a3d4c0f531a4eb2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5336afdcf4aa4b46b0655432b7a1323c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:33:44.331925 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-45e2a1c6-a489-44c7-a7ab-403e52ef7df1 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] 10.222.0.78 "GET /compute/v2.1/servers/20760e77-fe67-4ebe-87f1-34d840495341" status: 200 len: 1521 microversion: 2.1 time: 0.535431 Feb 17 04:33:44.332853 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 363/808] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:33:43 2021] GET /compute/v2.1/servers/20760e77-fe67-4ebe-87f1-34d840495341 => generated 1521 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:33:44.802804 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-1240a30c-e6e5-42bc-a12e-ee605e64439d tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:33:44.803514 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-1240a30c-e6e5-42bc-a12e-ee605e64439d tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] [instance: 1ee42b60-a1c0-4b17-9aa4-01d216665df4] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:33:44.814159 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-1240a30c-e6e5-42bc-a12e-ee605e64439d tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:44.815100 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-1240a30c-e6e5-42bc-a12e-ee605e64439d tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:44.816273 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-1240a30c-e6e5-42bc-a12e-ee605e64439d tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:44.817142 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-1240a30c-e6e5-42bc-a12e-ee605e64439d tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:45.075421 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-bbe4caa6-af07-4f6d-a48e-e26164243475 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:33:45.076480 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-bbe4caa6-af07-4f6d-a48e-e26164243475 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] [instance: b195626c-7ee1-4679-b956-f7ef7d6328f6] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:33:45.085940 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-bbe4caa6-af07-4f6d-a48e-e26164243475 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:45.086800 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-bbe4caa6-af07-4f6d-a48e-e26164243475 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:45.087013 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-1240a30c-e6e5-42bc-a12e-ee605e64439d tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d68d4a6c12e4331b8df8191cdd7a669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2a1ca6347d4278899a1cc009d87d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:33:45.088044 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-bbe4caa6-af07-4f6d-a48e-e26164243475 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:45.088695 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-bbe4caa6-af07-4f6d-a48e-e26164243475 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:45.097818 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-1240a30c-e6e5-42bc-a12e-ee605e64439d tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] 10.222.0.78 "GET /compute/v2.1/servers/1ee42b60-a1c0-4b17-9aa4-01d216665df4" status: 200 len: 1514 microversion: 2.1 time: 0.299017 Feb 17 04:33:45.098420 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 446/809] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:33:44 2021] GET /compute/v2.1/servers/1ee42b60-a1c0-4b17-9aa4-01d216665df4 => generated 1514 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:33:45.489197 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-f87658e6-df9e-4dff-a09f-7d9af33895d3 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:33:45.490364 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-f87658e6-df9e-4dff-a09f-7d9af33895d3 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] [instance: 20760e77-fe67-4ebe-87f1-34d840495341] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:33:45.499069 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-f87658e6-df9e-4dff-a09f-7d9af33895d3 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:45.499630 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-f87658e6-df9e-4dff-a09f-7d9af33895d3 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:45.500480 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-f87658e6-df9e-4dff-a09f-7d9af33895d3 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:45.500979 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-f87658e6-df9e-4dff-a09f-7d9af33895d3 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:45.536411 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-bbe4caa6-af07-4f6d-a48e-e26164243475 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f3e4c3c174942c492405c9b112667de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5b2911946848de81be8f9741faa90f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:33:45.546138 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-bbe4caa6-af07-4f6d-a48e-e26164243475 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] 10.222.0.78 "GET /compute/v2.1/servers/b195626c-7ee1-4679-b956-f7ef7d6328f6" status: 200 len: 1358 microversion: 2.1 time: 0.475889 Feb 17 04:33:45.546831 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 364/810] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:33:45 2021] GET /compute/v2.1/servers/b195626c-7ee1-4679-b956-f7ef7d6328f6 => generated 1358 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:33:45.715184 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-0d705b7d-1950-4e57-a3b1-8a3bdabf117f tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c774c2e2-d944-4d2e-8cc9-09f5d7ac1bf8"}} {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:33:45.716552 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-0d705b7d-1950-4e57-a3b1-8a3bdabf117f tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: 29d1ce27-f63b-4523-88be-55f65a6a2529] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:33:45.718976 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-f87658e6-df9e-4dff-a09f-7d9af33895d3 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1daf9a83b1d24033a3d4c0f531a4eb2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5336afdcf4aa4b46b0655432b7a1323c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:33:45.724506 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-0d705b7d-1950-4e57-a3b1-8a3bdabf117f tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:45.725023 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-0d705b7d-1950-4e57-a3b1-8a3bdabf117f tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:45.725878 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-0d705b7d-1950-4e57-a3b1-8a3bdabf117f tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:45.726381 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-0d705b7d-1950-4e57-a3b1-8a3bdabf117f tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:45.727909 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-f87658e6-df9e-4dff-a09f-7d9af33895d3 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] 10.222.0.78 "GET /compute/v2.1/servers/20760e77-fe67-4ebe-87f1-34d840495341" status: 200 len: 1521 microversion: 2.1 time: 0.378529 Feb 17 04:33:45.728549 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 447/811] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:33:45 2021] GET /compute/v2.1/servers/20760e77-fe67-4ebe-87f1-34d840495341 => generated 1521 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:33:46.116954 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-fdd6420f-1b3f-426f-9798-a1930ddc8f89 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:33:46.117934 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-fdd6420f-1b3f-426f-9798-a1930ddc8f89 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] [instance: 1ee42b60-a1c0-4b17-9aa4-01d216665df4] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:33:46.138532 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-fdd6420f-1b3f-426f-9798-a1930ddc8f89 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:46.141215 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-fdd6420f-1b3f-426f-9798-a1930ddc8f89 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:46.142210 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-fdd6420f-1b3f-426f-9798-a1930ddc8f89 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:46.143933 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-fdd6420f-1b3f-426f-9798-a1930ddc8f89 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:46.160574 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-0d705b7d-1950-4e57-a3b1-8a3bdabf117f tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "POST /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.449956 Feb 17 04:33:46.166555 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 365/812] 10.222.0.78 () {60 vars in 1313 bytes} [Wed Feb 17 04:33:45 2021] POST /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529/os-volume_attachments => generated 194 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 17 04:33:46.392223 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-fdd6420f-1b3f-426f-9798-a1930ddc8f89 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d68d4a6c12e4331b8df8191cdd7a669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2a1ca6347d4278899a1cc009d87d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:33:46.403697 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-fdd6420f-1b3f-426f-9798-a1930ddc8f89 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] 10.222.0.78 "GET /compute/v2.1/servers/1ee42b60-a1c0-4b17-9aa4-01d216665df4" status: 200 len: 1514 microversion: 2.1 time: 0.289618 Feb 17 04:33:46.404539 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 448/813] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:33:46 2021] GET /compute/v2.1/servers/1ee42b60-a1c0-4b17-9aa4-01d216665df4 => generated 1514 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:33:46.565918 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-b98b806b-ac60-484c-89da-691c7d22630f tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:33:46.566684 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-b98b806b-ac60-484c-89da-691c7d22630f tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] [instance: b195626c-7ee1-4679-b956-f7ef7d6328f6] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:33:46.575597 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-b98b806b-ac60-484c-89da-691c7d22630f tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:46.576113 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-b98b806b-ac60-484c-89da-691c7d22630f tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:46.576966 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-b98b806b-ac60-484c-89da-691c7d22630f tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:46.577472 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-b98b806b-ac60-484c-89da-691c7d22630f tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:46.746804 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-ba7c014b-26a2-449a-a0dc-5664d8ddc40b tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:33:46.747739 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-ba7c014b-26a2-449a-a0dc-5664d8ddc40b tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] [instance: 20760e77-fe67-4ebe-87f1-34d840495341] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:33:46.755665 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-ba7c014b-26a2-449a-a0dc-5664d8ddc40b tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:46.756180 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-ba7c014b-26a2-449a-a0dc-5664d8ddc40b tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:46.757033 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-ba7c014b-26a2-449a-a0dc-5664d8ddc40b tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:46.757532 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-ba7c014b-26a2-449a-a0dc-5664d8ddc40b tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:46.974922 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-ba7c014b-26a2-449a-a0dc-5664d8ddc40b tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1daf9a83b1d24033a3d4c0f531a4eb2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5336afdcf4aa4b46b0655432b7a1323c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:33:46.984832 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-ba7c014b-26a2-449a-a0dc-5664d8ddc40b tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] 10.222.0.78 "GET /compute/v2.1/servers/20760e77-fe67-4ebe-87f1-34d840495341" status: 200 len: 1521 microversion: 2.1 time: 0.242682 Feb 17 04:33:46.985720 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 449/814] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:33:46 2021] GET /compute/v2.1/servers/20760e77-fe67-4ebe-87f1-34d840495341 => generated 1521 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:33:47.029109 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-b98b806b-ac60-484c-89da-691c7d22630f tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f3e4c3c174942c492405c9b112667de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5b2911946848de81be8f9741faa90f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:33:47.038975 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-b98b806b-ac60-484c-89da-691c7d22630f tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] 10.222.0.78 "GET /compute/v2.1/servers/b195626c-7ee1-4679-b956-f7ef7d6328f6" status: 200 len: 1358 microversion: 2.1 time: 0.477517 Feb 17 04:33:47.039645 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 366/815] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:33:46 2021] GET /compute/v2.1/servers/b195626c-7ee1-4679-b956-f7ef7d6328f6 => generated 1358 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:33:47.118105 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [req-34b440a6-2540-49ea-bece-1465a66dcf5c req-6372a66b-bd55-4eef-b697-2a2c97e1c3d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ee42b60-a1c0-4b17-9aa4-01d216665df4", "name": "network-vif-deleted", "tag": "f38915de-2eaf-408a-aefc-2ed6e07dc1dd"}]} {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:33:47.120041 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:33:47.120041 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: warnings.warn(msg) Feb 17 04:33:47.154123 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [req-34b440a6-2540-49ea-bece-1465a66dcf5c req-6372a66b-bd55-4eef-b697-2a2c97e1c3d9 service nova] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:47.154650 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [req-34b440a6-2540-49ea-bece-1465a66dcf5c req-6372a66b-bd55-4eef-b697-2a2c97e1c3d9 service nova] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:47.173780 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.compute.server_external_events [req-34b440a6-2540-49ea-bece-1465a66dcf5c req-6372a66b-bd55-4eef-b697-2a2c97e1c3d9 service nova] Creating event network-vif-deleted:f38915de-2eaf-408a-aefc-2ed6e07dc1dd for instance 1ee42b60-a1c0-4b17-9aa4-01d216665df4 on hv-cinder-75998 Feb 17 04:33:47.178998 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [req-34b440a6-2540-49ea-bece-1465a66dcf5c req-6372a66b-bd55-4eef-b697-2a2c97e1c3d9 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065184 Feb 17 04:33:47.179658 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 450/816] 10.222.0.78 () {64 vars in 1308 bytes} [Wed Feb 17 04:33:47 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:33:47.423529 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-94f9783a-6f88-45a5-b6cd-78970a4d93c3 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:33:47.424232 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-94f9783a-6f88-45a5-b6cd-78970a4d93c3 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] [instance: 1ee42b60-a1c0-4b17-9aa4-01d216665df4] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:33:47.432322 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-94f9783a-6f88-45a5-b6cd-78970a4d93c3 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:47.432829 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-94f9783a-6f88-45a5-b6cd-78970a4d93c3 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:47.433925 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-94f9783a-6f88-45a5-b6cd-78970a4d93c3 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:47.434546 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-94f9783a-6f88-45a5-b6cd-78970a4d93c3 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:47.511268 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-94f9783a-6f88-45a5-b6cd-78970a4d93c3 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:47.512371 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-94f9783a-6f88-45a5-b6cd-78970a4d93c3 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:47.512930 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.objects.instance [None req-94f9783a-6f88-45a5-b6cd-78970a4d93c3 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lazy-loading 'fault' on Instance uuid 1ee42b60-a1c0-4b17-9aa4-01d216665df4 {{(pid=98178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Feb 17 04:33:47.590792 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-94f9783a-6f88-45a5-b6cd-78970a4d93c3 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d68d4a6c12e4331b8df8191cdd7a669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2a1ca6347d4278899a1cc009d87d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:33:47.599587 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-94f9783a-6f88-45a5-b6cd-78970a4d93c3 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] 10.222.0.78 "GET /compute/v2.1/servers/1ee42b60-a1c0-4b17-9aa4-01d216665df4" status: 200 len: 1307 microversion: 2.1 time: 0.181202 Feb 17 04:33:47.600198 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 367/817] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:33:47 2021] GET /compute/v2.1/servers/1ee42b60-a1c0-4b17-9aa4-01d216665df4 => generated 1307 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:33:48.004333 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-5096c9c7-0a54-43f1-beaf-fbedab67d116 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:33:48.005117 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-5096c9c7-0a54-43f1-beaf-fbedab67d116 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] [instance: 20760e77-fe67-4ebe-87f1-34d840495341] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:33:48.013510 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-5096c9c7-0a54-43f1-beaf-fbedab67d116 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:48.014062 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-5096c9c7-0a54-43f1-beaf-fbedab67d116 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:48.014910 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-5096c9c7-0a54-43f1-beaf-fbedab67d116 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:48.015437 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-5096c9c7-0a54-43f1-beaf-fbedab67d116 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:48.056910 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-9c6285d0-e957-4e29-88ce-dbae12168fa4 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:33:48.057584 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-9c6285d0-e957-4e29-88ce-dbae12168fa4 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] [instance: b195626c-7ee1-4679-b956-f7ef7d6328f6] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:33:48.066215 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-9c6285d0-e957-4e29-88ce-dbae12168fa4 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:48.066727 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-9c6285d0-e957-4e29-88ce-dbae12168fa4 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:48.067604 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-9c6285d0-e957-4e29-88ce-dbae12168fa4 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:48.068106 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-9c6285d0-e957-4e29-88ce-dbae12168fa4 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:48.268324 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-5096c9c7-0a54-43f1-beaf-fbedab67d116 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1daf9a83b1d24033a3d4c0f531a4eb2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5336afdcf4aa4b46b0655432b7a1323c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:33:48.278531 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-5096c9c7-0a54-43f1-beaf-fbedab67d116 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] 10.222.0.78 "GET /compute/v2.1/servers/20760e77-fe67-4ebe-87f1-34d840495341" status: 200 len: 1521 microversion: 2.1 time: 0.279108 Feb 17 04:33:48.279422 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 451/818] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:33:47 2021] GET /compute/v2.1/servers/20760e77-fe67-4ebe-87f1-34d840495341 => generated 1521 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:33:48.310926 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-9c6285d0-e957-4e29-88ce-dbae12168fa4 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f3e4c3c174942c492405c9b112667de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5b2911946848de81be8f9741faa90f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:33:48.320396 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-9c6285d0-e957-4e29-88ce-dbae12168fa4 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] 10.222.0.78 "GET /compute/v2.1/servers/b195626c-7ee1-4679-b956-f7ef7d6328f6" status: 200 len: 1358 microversion: 2.1 time: 0.267531 Feb 17 04:33:48.321114 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 368/819] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:33:48 2021] GET /compute/v2.1/servers/b195626c-7ee1-4679-b956-f7ef7d6328f6 => generated 1358 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:33:48.619078 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-2f146a04-9859-463a-811c-5a8998ea9a7e tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:33:48.619662 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-2f146a04-9859-463a-811c-5a8998ea9a7e tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] [instance: 1ee42b60-a1c0-4b17-9aa4-01d216665df4] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:33:48.627431 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-2f146a04-9859-463a-811c-5a8998ea9a7e tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:48.627934 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-2f146a04-9859-463a-811c-5a8998ea9a7e tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:48.628757 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-2f146a04-9859-463a-811c-5a8998ea9a7e tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:48.629241 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-2f146a04-9859-463a-811c-5a8998ea9a7e tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:48.684684 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.wsgi [None req-2f146a04-9859-463a-811c-5a8998ea9a7e tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] HTTP exception thrown: Instance 1ee42b60-a1c0-4b17-9aa4-01d216665df4 could not be found. Feb 17 04:33:48.685338 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-2f146a04-9859-463a-811c-5a8998ea9a7e tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Returning 404 to user: Instance 1ee42b60-a1c0-4b17-9aa4-01d216665df4 could not be found. {{(pid=98179) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 17 04:33:48.686220 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-2f146a04-9859-463a-811c-5a8998ea9a7e tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] 10.222.0.78 "GET /compute/v2.1/servers/1ee42b60-a1c0-4b17-9aa4-01d216665df4" status: 404 len: 111 microversion: 2.1 time: 0.071226 Feb 17 04:33:48.686813 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 452/820] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:33:48 2021] GET /compute/v2.1/servers/1ee42b60-a1c0-4b17-9aa4-01d216665df4 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 17 04:33:49.297857 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-b01eea74-69b4-4819-8c53-f5d4bf622707 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:33:49.298579 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-b01eea74-69b4-4819-8c53-f5d4bf622707 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] [instance: 20760e77-fe67-4ebe-87f1-34d840495341] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:33:49.306985 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-b01eea74-69b4-4819-8c53-f5d4bf622707 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:49.307559 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-b01eea74-69b4-4819-8c53-f5d4bf622707 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:49.308922 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-b01eea74-69b4-4819-8c53-f5d4bf622707 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:49.309422 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-b01eea74-69b4-4819-8c53-f5d4bf622707 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:49.338016 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-1ad90926-f23e-4af6-8547-4bc1bc2c4ff1 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:33:49.338926 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-1ad90926-f23e-4af6-8547-4bc1bc2c4ff1 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] [instance: b195626c-7ee1-4679-b956-f7ef7d6328f6] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:33:49.347200 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-1ad90926-f23e-4af6-8547-4bc1bc2c4ff1 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:49.348406 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-1ad90926-f23e-4af6-8547-4bc1bc2c4ff1 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:49.349384 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-1ad90926-f23e-4af6-8547-4bc1bc2c4ff1 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:49.350013 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-1ad90926-f23e-4af6-8547-4bc1bc2c4ff1 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:49.538324 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-b01eea74-69b4-4819-8c53-f5d4bf622707 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1daf9a83b1d24033a3d4c0f531a4eb2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5336afdcf4aa4b46b0655432b7a1323c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:33:49.548128 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-b01eea74-69b4-4819-8c53-f5d4bf622707 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] 10.222.0.78 "GET /compute/v2.1/servers/20760e77-fe67-4ebe-87f1-34d840495341" status: 200 len: 1521 microversion: 2.1 time: 0.254351 Feb 17 04:33:49.549048 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 369/821] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:33:49 2021] GET /compute/v2.1/servers/20760e77-fe67-4ebe-87f1-34d840495341 => generated 1521 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:33:49.580417 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-1ad90926-f23e-4af6-8547-4bc1bc2c4ff1 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f3e4c3c174942c492405c9b112667de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5b2911946848de81be8f9741faa90f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:33:49.591425 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-1ad90926-f23e-4af6-8547-4bc1bc2c4ff1 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] 10.222.0.78 "GET /compute/v2.1/servers/b195626c-7ee1-4679-b956-f7ef7d6328f6" status: 200 len: 1358 microversion: 2.1 time: 0.257326 Feb 17 04:33:49.592044 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 453/822] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:33:49 2021] GET /compute/v2.1/servers/b195626c-7ee1-4679-b956-f7ef7d6328f6 => generated 1358 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:33:50.566581 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-7ecf716e-8ff8-4504-94cd-d5df3896f4ca tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:33:50.567278 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-7ecf716e-8ff8-4504-94cd-d5df3896f4ca tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] [instance: 20760e77-fe67-4ebe-87f1-34d840495341] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:33:50.575196 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-7ecf716e-8ff8-4504-94cd-d5df3896f4ca tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:50.575704 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-7ecf716e-8ff8-4504-94cd-d5df3896f4ca tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:50.576535 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-7ecf716e-8ff8-4504-94cd-d5df3896f4ca tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:50.577027 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-7ecf716e-8ff8-4504-94cd-d5df3896f4ca tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:50.610937 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-c4f8b775-9159-41d2-8809-86c6098b8f3b tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:33:50.611710 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-c4f8b775-9159-41d2-8809-86c6098b8f3b tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] [instance: b195626c-7ee1-4679-b956-f7ef7d6328f6] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:33:50.620247 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-c4f8b775-9159-41d2-8809-86c6098b8f3b tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:50.620897 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-c4f8b775-9159-41d2-8809-86c6098b8f3b tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:50.621762 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-c4f8b775-9159-41d2-8809-86c6098b8f3b tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:50.622263 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-c4f8b775-9159-41d2-8809-86c6098b8f3b tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:50.806459 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-7ecf716e-8ff8-4504-94cd-d5df3896f4ca tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1daf9a83b1d24033a3d4c0f531a4eb2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5336afdcf4aa4b46b0655432b7a1323c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:33:50.823766 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-7ecf716e-8ff8-4504-94cd-d5df3896f4ca tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] 10.222.0.78 "GET /compute/v2.1/servers/20760e77-fe67-4ebe-87f1-34d840495341" status: 200 len: 1521 microversion: 2.1 time: 0.261076 Feb 17 04:33:50.827551 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 370/823] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:33:50 2021] GET /compute/v2.1/servers/20760e77-fe67-4ebe-87f1-34d840495341 => generated 1521 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:33:50.838665 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-c4f8b775-9159-41d2-8809-86c6098b8f3b tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f3e4c3c174942c492405c9b112667de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5b2911946848de81be8f9741faa90f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:33:50.848426 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-c4f8b775-9159-41d2-8809-86c6098b8f3b tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] 10.222.0.78 "GET /compute/v2.1/servers/b195626c-7ee1-4679-b956-f7ef7d6328f6" status: 200 len: 1358 microversion: 2.1 time: 0.242094 Feb 17 04:33:50.849044 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 454/824] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:33:50 2021] GET /compute/v2.1/servers/b195626c-7ee1-4679-b956-f7ef7d6328f6 => generated 1358 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:33:51.035769 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-ccb3fd78-29e0-4424-8802-d1a73032be38 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:33:51.036327 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-ccb3fd78-29e0-4424-8802-d1a73032be38 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] [instance: ad42ab86-4168-46d3-9394-9fb44fc79d18] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:33:51.044259 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-ccb3fd78-29e0-4424-8802-d1a73032be38 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:51.044771 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-ccb3fd78-29e0-4424-8802-d1a73032be38 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:51.045614 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-ccb3fd78-29e0-4424-8802-d1a73032be38 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:51.046111 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-ccb3fd78-29e0-4424-8802-d1a73032be38 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:51.111484 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-ccb3fd78-29e0-4424-8802-d1a73032be38 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] [instance: ad42ab86-4168-46d3-9394-9fb44fc79d18] Going to try to terminate instance {{(pid=98178) delete /opt/stack/nova/nova/compute/api.py:2540}} Feb 17 04:33:51.223987 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-ccb3fd78-29e0-4424-8802-d1a73032be38 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] 10.222.0.78 "DELETE /compute/v2.1/servers/ad42ab86-4168-46d3-9394-9fb44fc79d18" status: 204 len: 0 microversion: 2.1 time: 0.191912 Feb 17 04:33:51.224620 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 371/825] 10.222.0.78 () {58 vars in 1229 bytes} [Wed Feb 17 04:33:51 2021] DELETE /compute/v2.1/servers/ad42ab86-4168-46d3-9394-9fb44fc79d18 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 17 04:33:51.233834 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-c40e9c22-1d36-4b89-b431-2046037e4c2c tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:33:51.234505 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-c40e9c22-1d36-4b89-b431-2046037e4c2c tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] [instance: ad42ab86-4168-46d3-9394-9fb44fc79d18] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:33:51.242648 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-c40e9c22-1d36-4b89-b431-2046037e4c2c tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:51.243187 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-c40e9c22-1d36-4b89-b431-2046037e4c2c tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:51.244024 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-c40e9c22-1d36-4b89-b431-2046037e4c2c tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:51.244513 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-c40e9c22-1d36-4b89-b431-2046037e4c2c tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:51.457322 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-c40e9c22-1d36-4b89-b431-2046037e4c2c tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d68d4a6c12e4331b8df8191cdd7a669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2a1ca6347d4278899a1cc009d87d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:33:51.466653 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-c40e9c22-1d36-4b89-b431-2046037e4c2c tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] 10.222.0.78 "GET /compute/v2.1/servers/ad42ab86-4168-46d3-9394-9fb44fc79d18" status: 200 len: 1513 microversion: 2.1 time: 0.237448 Feb 17 04:33:51.467295 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 455/826] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:33:51 2021] GET /compute/v2.1/servers/ad42ab86-4168-46d3-9394-9fb44fc79d18 => generated 1513 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:33:51.843476 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-82defe3d-4686-4690-8b86-d5cb887aa9cf tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:33:51.844260 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-82defe3d-4686-4690-8b86-d5cb887aa9cf tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] [instance: 20760e77-fe67-4ebe-87f1-34d840495341] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:33:51.852091 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-82defe3d-4686-4690-8b86-d5cb887aa9cf tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:51.852610 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-82defe3d-4686-4690-8b86-d5cb887aa9cf tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:51.853455 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-82defe3d-4686-4690-8b86-d5cb887aa9cf tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:51.853963 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-82defe3d-4686-4690-8b86-d5cb887aa9cf tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:51.866086 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-ac2986bb-337b-4615-aafe-f8b828448002 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:33:51.866760 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-ac2986bb-337b-4615-aafe-f8b828448002 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] [instance: b195626c-7ee1-4679-b956-f7ef7d6328f6] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:33:51.874808 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-ac2986bb-337b-4615-aafe-f8b828448002 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:51.875352 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-ac2986bb-337b-4615-aafe-f8b828448002 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:51.876192 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-ac2986bb-337b-4615-aafe-f8b828448002 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:51.876690 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-ac2986bb-337b-4615-aafe-f8b828448002 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:52.082309 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-82defe3d-4686-4690-8b86-d5cb887aa9cf tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1daf9a83b1d24033a3d4c0f531a4eb2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5336afdcf4aa4b46b0655432b7a1323c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:33:52.091605 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-ac2986bb-337b-4615-aafe-f8b828448002 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f3e4c3c174942c492405c9b112667de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5b2911946848de81be8f9741faa90f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:33:52.091772 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-82defe3d-4686-4690-8b86-d5cb887aa9cf tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] 10.222.0.78 "GET /compute/v2.1/servers/20760e77-fe67-4ebe-87f1-34d840495341" status: 200 len: 1521 microversion: 2.1 time: 0.253374 Feb 17 04:33:52.092970 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 372/827] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:33:51 2021] GET /compute/v2.1/servers/20760e77-fe67-4ebe-87f1-34d840495341 => generated 1521 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:33:52.100729 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-ac2986bb-337b-4615-aafe-f8b828448002 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] 10.222.0.78 "GET /compute/v2.1/servers/b195626c-7ee1-4679-b956-f7ef7d6328f6" status: 200 len: 1358 microversion: 2.1 time: 0.238521 Feb 17 04:33:52.101328 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 456/828] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:33:51 2021] GET /compute/v2.1/servers/b195626c-7ee1-4679-b956-f7ef7d6328f6 => generated 1358 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:33:52.485554 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-d3d9254d-71f4-4ada-a44b-8dd40b9cbeca tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:33:52.486229 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-d3d9254d-71f4-4ada-a44b-8dd40b9cbeca tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] [instance: ad42ab86-4168-46d3-9394-9fb44fc79d18] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:33:52.494104 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-d3d9254d-71f4-4ada-a44b-8dd40b9cbeca tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:52.494599 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-d3d9254d-71f4-4ada-a44b-8dd40b9cbeca tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:52.495464 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-d3d9254d-71f4-4ada-a44b-8dd40b9cbeca tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:52.496531 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-d3d9254d-71f4-4ada-a44b-8dd40b9cbeca tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:52.706821 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-d3d9254d-71f4-4ada-a44b-8dd40b9cbeca tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d68d4a6c12e4331b8df8191cdd7a669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2a1ca6347d4278899a1cc009d87d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:33:52.715778 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-d3d9254d-71f4-4ada-a44b-8dd40b9cbeca tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] 10.222.0.78 "GET /compute/v2.1/servers/ad42ab86-4168-46d3-9394-9fb44fc79d18" status: 200 len: 1513 microversion: 2.1 time: 0.234519 Feb 17 04:33:52.716385 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 373/829] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:33:52 2021] GET /compute/v2.1/servers/ad42ab86-4168-46d3-9394-9fb44fc79d18 => generated 1513 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:33:53.110863 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-55e7fcb7-9c20-4d31-87e4-75a05814aa9f tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:33:53.111541 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-55e7fcb7-9c20-4d31-87e4-75a05814aa9f tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] [instance: 20760e77-fe67-4ebe-87f1-34d840495341] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:33:53.117914 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-692c8e74-b3d1-4dc2-bd81-74ea097fceac tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:33:53.118725 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-692c8e74-b3d1-4dc2-bd81-74ea097fceac tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] [instance: b195626c-7ee1-4679-b956-f7ef7d6328f6] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:33:53.119505 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-55e7fcb7-9c20-4d31-87e4-75a05814aa9f tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:53.120035 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-55e7fcb7-9c20-4d31-87e4-75a05814aa9f tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:53.120886 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-55e7fcb7-9c20-4d31-87e4-75a05814aa9f tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:53.121389 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-55e7fcb7-9c20-4d31-87e4-75a05814aa9f tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:53.127054 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-692c8e74-b3d1-4dc2-bd81-74ea097fceac tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:53.127569 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-692c8e74-b3d1-4dc2-bd81-74ea097fceac tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:53.128415 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-692c8e74-b3d1-4dc2-bd81-74ea097fceac tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:53.128906 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-692c8e74-b3d1-4dc2-bd81-74ea097fceac tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:53.338118 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-55e7fcb7-9c20-4d31-87e4-75a05814aa9f tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1daf9a83b1d24033a3d4c0f531a4eb2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5336afdcf4aa4b46b0655432b7a1323c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:33:53.346099 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-692c8e74-b3d1-4dc2-bd81-74ea097fceac tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f3e4c3c174942c492405c9b112667de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5b2911946848de81be8f9741faa90f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:33:53.347925 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-55e7fcb7-9c20-4d31-87e4-75a05814aa9f tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] 10.222.0.78 "GET /compute/v2.1/servers/20760e77-fe67-4ebe-87f1-34d840495341" status: 200 len: 1521 microversion: 2.1 time: 0.241372 Feb 17 04:33:53.348580 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 457/830] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:33:53 2021] GET /compute/v2.1/servers/20760e77-fe67-4ebe-87f1-34d840495341 => generated 1521 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:33:53.355971 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-692c8e74-b3d1-4dc2-bd81-74ea097fceac tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] 10.222.0.78 "GET /compute/v2.1/servers/b195626c-7ee1-4679-b956-f7ef7d6328f6" status: 200 len: 1358 microversion: 2.1 time: 0.241364 Feb 17 04:33:53.356570 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 374/831] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:33:53 2021] GET /compute/v2.1/servers/b195626c-7ee1-4679-b956-f7ef7d6328f6 => generated 1358 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:33:53.734621 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-8fe57975-2bf1-4db2-ad80-8b8f79e9e0ac tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:33:53.735555 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-8fe57975-2bf1-4db2-ad80-8b8f79e9e0ac tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] [instance: ad42ab86-4168-46d3-9394-9fb44fc79d18] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:33:53.743387 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-8fe57975-2bf1-4db2-ad80-8b8f79e9e0ac tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:53.743893 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-8fe57975-2bf1-4db2-ad80-8b8f79e9e0ac tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:53.744723 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-8fe57975-2bf1-4db2-ad80-8b8f79e9e0ac tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:53.745213 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-8fe57975-2bf1-4db2-ad80-8b8f79e9e0ac tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:53.958001 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-8fe57975-2bf1-4db2-ad80-8b8f79e9e0ac tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d68d4a6c12e4331b8df8191cdd7a669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2a1ca6347d4278899a1cc009d87d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:33:53.967427 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-8fe57975-2bf1-4db2-ad80-8b8f79e9e0ac tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] 10.222.0.78 "GET /compute/v2.1/servers/ad42ab86-4168-46d3-9394-9fb44fc79d18" status: 200 len: 1513 microversion: 2.1 time: 0.237437 Feb 17 04:33:53.968026 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 458/832] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:33:53 2021] GET /compute/v2.1/servers/ad42ab86-4168-46d3-9394-9fb44fc79d18 => generated 1513 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:33:54.367248 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-a8ffe4a1-7f7e-43d2-8789-aa623e6e1f96 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:33:54.367859 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-a8ffe4a1-7f7e-43d2-8789-aa623e6e1f96 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] [instance: 20760e77-fe67-4ebe-87f1-34d840495341] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:33:54.374326 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-8bb10ee4-6537-4987-a1df-0f5de180b811 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:33:54.374989 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-8bb10ee4-6537-4987-a1df-0f5de180b811 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] [instance: b195626c-7ee1-4679-b956-f7ef7d6328f6] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:33:54.376307 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-a8ffe4a1-7f7e-43d2-8789-aa623e6e1f96 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:54.376826 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-a8ffe4a1-7f7e-43d2-8789-aa623e6e1f96 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:54.377681 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-a8ffe4a1-7f7e-43d2-8789-aa623e6e1f96 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:54.378185 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-a8ffe4a1-7f7e-43d2-8789-aa623e6e1f96 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:54.382814 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-8bb10ee4-6537-4987-a1df-0f5de180b811 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:54.383357 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-8bb10ee4-6537-4987-a1df-0f5de180b811 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:54.384181 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-8bb10ee4-6537-4987-a1df-0f5de180b811 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:54.384664 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-8bb10ee4-6537-4987-a1df-0f5de180b811 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:54.593136 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-a8ffe4a1-7f7e-43d2-8789-aa623e6e1f96 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1daf9a83b1d24033a3d4c0f531a4eb2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5336afdcf4aa4b46b0655432b7a1323c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:33:54.596789 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-8bb10ee4-6537-4987-a1df-0f5de180b811 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f3e4c3c174942c492405c9b112667de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5b2911946848de81be8f9741faa90f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:33:54.602195 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-a8ffe4a1-7f7e-43d2-8789-aa623e6e1f96 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] 10.222.0.78 "GET /compute/v2.1/servers/20760e77-fe67-4ebe-87f1-34d840495341" status: 200 len: 1521 microversion: 2.1 time: 0.239026 Feb 17 04:33:54.602808 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 375/833] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:33:54 2021] GET /compute/v2.1/servers/20760e77-fe67-4ebe-87f1-34d840495341 => generated 1521 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:33:54.605847 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-8bb10ee4-6537-4987-a1df-0f5de180b811 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] 10.222.0.78 "GET /compute/v2.1/servers/b195626c-7ee1-4679-b956-f7ef7d6328f6" status: 200 len: 1358 microversion: 2.1 time: 0.235875 Feb 17 04:33:54.606449 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 459/834] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:33:54 2021] GET /compute/v2.1/servers/b195626c-7ee1-4679-b956-f7ef7d6328f6 => generated 1358 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:33:54.985076 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-e8daf91e-5ee3-447c-9cf9-6171ad69bf09 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:33:54.986011 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-e8daf91e-5ee3-447c-9cf9-6171ad69bf09 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] [instance: ad42ab86-4168-46d3-9394-9fb44fc79d18] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:33:54.993929 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-e8daf91e-5ee3-447c-9cf9-6171ad69bf09 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:54.994442 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-e8daf91e-5ee3-447c-9cf9-6171ad69bf09 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:54.995321 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-e8daf91e-5ee3-447c-9cf9-6171ad69bf09 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:54.995820 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-e8daf91e-5ee3-447c-9cf9-6171ad69bf09 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:55.208734 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-e8daf91e-5ee3-447c-9cf9-6171ad69bf09 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d68d4a6c12e4331b8df8191cdd7a669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2a1ca6347d4278899a1cc009d87d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:33:55.218406 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-e8daf91e-5ee3-447c-9cf9-6171ad69bf09 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] 10.222.0.78 "GET /compute/v2.1/servers/ad42ab86-4168-46d3-9394-9fb44fc79d18" status: 200 len: 1513 microversion: 2.1 time: 0.237465 Feb 17 04:33:55.219005 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 376/835] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:33:54 2021] GET /compute/v2.1/servers/ad42ab86-4168-46d3-9394-9fb44fc79d18 => generated 1513 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:33:55.621313 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-7398d217-17fb-4418-b0ac-2c2445ddbc75 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:33:55.621983 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-7398d217-17fb-4418-b0ac-2c2445ddbc75 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] [instance: 20760e77-fe67-4ebe-87f1-34d840495341] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:33:55.624998 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-0e48427c-0ab5-4c06-963c-7cf0a24d4de7 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:33:55.625673 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-0e48427c-0ab5-4c06-963c-7cf0a24d4de7 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] [instance: b195626c-7ee1-4679-b956-f7ef7d6328f6] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:33:55.630033 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-7398d217-17fb-4418-b0ac-2c2445ddbc75 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:55.630535 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-7398d217-17fb-4418-b0ac-2c2445ddbc75 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:55.631395 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-7398d217-17fb-4418-b0ac-2c2445ddbc75 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:55.631884 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-7398d217-17fb-4418-b0ac-2c2445ddbc75 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:55.633618 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-0e48427c-0ab5-4c06-963c-7cf0a24d4de7 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:55.634125 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-0e48427c-0ab5-4c06-963c-7cf0a24d4de7 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:55.634966 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-0e48427c-0ab5-4c06-963c-7cf0a24d4de7 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:55.635485 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-0e48427c-0ab5-4c06-963c-7cf0a24d4de7 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:55.844853 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-7398d217-17fb-4418-b0ac-2c2445ddbc75 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1daf9a83b1d24033a3d4c0f531a4eb2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5336afdcf4aa4b46b0655432b7a1323c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:33:55.845587 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-0e48427c-0ab5-4c06-963c-7cf0a24d4de7 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f3e4c3c174942c492405c9b112667de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5b2911946848de81be8f9741faa90f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:33:55.854089 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-7398d217-17fb-4418-b0ac-2c2445ddbc75 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] 10.222.0.78 "GET /compute/v2.1/servers/20760e77-fe67-4ebe-87f1-34d840495341" status: 200 len: 1521 microversion: 2.1 time: 0.237499 Feb 17 04:33:55.854536 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-0e48427c-0ab5-4c06-963c-7cf0a24d4de7 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] 10.222.0.78 "GET /compute/v2.1/servers/b195626c-7ee1-4679-b956-f7ef7d6328f6" status: 200 len: 1358 microversion: 2.1 time: 0.234344 Feb 17 04:33:55.854662 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 460/836] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:33:55 2021] GET /compute/v2.1/servers/20760e77-fe67-4ebe-87f1-34d840495341 => generated 1521 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:33:55.855759 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 377/837] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:33:55 2021] GET /compute/v2.1/servers/b195626c-7ee1-4679-b956-f7ef7d6328f6 => generated 1358 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:33:56.238096 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-27cdce04-1d1d-4ed6-bf51-e17a1c96ecdc tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:33:56.238802 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-27cdce04-1d1d-4ed6-bf51-e17a1c96ecdc tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] [instance: ad42ab86-4168-46d3-9394-9fb44fc79d18] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:33:56.247393 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-27cdce04-1d1d-4ed6-bf51-e17a1c96ecdc tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:56.247900 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-27cdce04-1d1d-4ed6-bf51-e17a1c96ecdc tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:56.248722 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-27cdce04-1d1d-4ed6-bf51-e17a1c96ecdc tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:56.249210 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-27cdce04-1d1d-4ed6-bf51-e17a1c96ecdc tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:56.656970 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-27cdce04-1d1d-4ed6-bf51-e17a1c96ecdc tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d68d4a6c12e4331b8df8191cdd7a669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2a1ca6347d4278899a1cc009d87d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:33:56.665745 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-27cdce04-1d1d-4ed6-bf51-e17a1c96ecdc tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] 10.222.0.78 "GET /compute/v2.1/servers/ad42ab86-4168-46d3-9394-9fb44fc79d18" status: 200 len: 1513 microversion: 2.1 time: 0.432073 Feb 17 04:33:56.666349 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 461/838] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:33:56 2021] GET /compute/v2.1/servers/ad42ab86-4168-46d3-9394-9fb44fc79d18 => generated 1513 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:33:56.873289 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-acf21830-f947-4a16-affd-fbaf9a6afab8 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:33:56.873509 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-dfea7051-f359-4c80-9923-493624e58526 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:33:56.873883 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-acf21830-f947-4a16-affd-fbaf9a6afab8 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] [instance: 20760e77-fe67-4ebe-87f1-34d840495341] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:33:56.874008 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-dfea7051-f359-4c80-9923-493624e58526 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] [instance: b195626c-7ee1-4679-b956-f7ef7d6328f6] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:33:56.882030 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-dfea7051-f359-4c80-9923-493624e58526 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:56.882172 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-acf21830-f947-4a16-affd-fbaf9a6afab8 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:56.882583 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-acf21830-f947-4a16-affd-fbaf9a6afab8 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:56.882718 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-dfea7051-f359-4c80-9923-493624e58526 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:56.883463 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-acf21830-f947-4a16-affd-fbaf9a6afab8 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:56.883585 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-dfea7051-f359-4c80-9923-493624e58526 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:56.883966 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-dfea7051-f359-4c80-9923-493624e58526 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:56.884144 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-acf21830-f947-4a16-affd-fbaf9a6afab8 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:57.097754 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-dfea7051-f359-4c80-9923-493624e58526 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f3e4c3c174942c492405c9b112667de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5b2911946848de81be8f9741faa90f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:33:57.103516 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-acf21830-f947-4a16-affd-fbaf9a6afab8 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1daf9a83b1d24033a3d4c0f531a4eb2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5336afdcf4aa4b46b0655432b7a1323c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:33:57.107432 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-dfea7051-f359-4c80-9923-493624e58526 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] 10.222.0.78 "GET /compute/v2.1/servers/b195626c-7ee1-4679-b956-f7ef7d6328f6" status: 200 len: 1358 microversion: 2.1 time: 0.238169 Feb 17 04:33:57.108053 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 462/839] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:33:56 2021] GET /compute/v2.1/servers/b195626c-7ee1-4679-b956-f7ef7d6328f6 => generated 1358 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:33:57.114278 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-acf21830-f947-4a16-affd-fbaf9a6afab8 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] 10.222.0.78 "GET /compute/v2.1/servers/20760e77-fe67-4ebe-87f1-34d840495341" status: 200 len: 1521 microversion: 2.1 time: 0.245075 Feb 17 04:33:57.114882 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 378/840] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:33:56 2021] GET /compute/v2.1/servers/20760e77-fe67-4ebe-87f1-34d840495341 => generated 1521 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:33:57.684737 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-89232e00-10da-4d27-af13-1817fd0aba9a tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:33:57.685410 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-89232e00-10da-4d27-af13-1817fd0aba9a tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] [instance: ad42ab86-4168-46d3-9394-9fb44fc79d18] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:33:57.693441 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-89232e00-10da-4d27-af13-1817fd0aba9a tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:57.693954 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-89232e00-10da-4d27-af13-1817fd0aba9a tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:57.694786 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-89232e00-10da-4d27-af13-1817fd0aba9a tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:57.695303 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-89232e00-10da-4d27-af13-1817fd0aba9a tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:57.907199 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-89232e00-10da-4d27-af13-1817fd0aba9a tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d68d4a6c12e4331b8df8191cdd7a669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2a1ca6347d4278899a1cc009d87d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:33:57.916199 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-89232e00-10da-4d27-af13-1817fd0aba9a tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] 10.222.0.78 "GET /compute/v2.1/servers/ad42ab86-4168-46d3-9394-9fb44fc79d18" status: 200 len: 1513 microversion: 2.1 time: 0.235673 Feb 17 04:33:57.916805 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 463/841] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:33:57 2021] GET /compute/v2.1/servers/ad42ab86-4168-46d3-9394-9fb44fc79d18 => generated 1513 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:33:58.127927 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-f965e3cd-ef93-4641-bec0-31bb25491110 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:33:58.128959 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-f965e3cd-ef93-4641-bec0-31bb25491110 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] [instance: b195626c-7ee1-4679-b956-f7ef7d6328f6] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:33:58.139935 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-8ebaf602-93ac-4409-807f-b1078e3341cc tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:33:58.140605 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-8ebaf602-93ac-4409-807f-b1078e3341cc tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] [instance: 20760e77-fe67-4ebe-87f1-34d840495341] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:33:58.153817 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-f965e3cd-ef93-4641-bec0-31bb25491110 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:58.158243 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-f965e3cd-ef93-4641-bec0-31bb25491110 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:58.159214 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-f965e3cd-ef93-4641-bec0-31bb25491110 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:58.159710 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-f965e3cd-ef93-4641-bec0-31bb25491110 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:58.172737 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-8ebaf602-93ac-4409-807f-b1078e3341cc tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:58.173238 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-8ebaf602-93ac-4409-807f-b1078e3341cc tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:58.174088 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-8ebaf602-93ac-4409-807f-b1078e3341cc tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:58.174575 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-8ebaf602-93ac-4409-807f-b1078e3341cc tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:58.411798 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-8ebaf602-93ac-4409-807f-b1078e3341cc tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1daf9a83b1d24033a3d4c0f531a4eb2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5336afdcf4aa4b46b0655432b7a1323c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:33:58.421278 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-8ebaf602-93ac-4409-807f-b1078e3341cc tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] 10.222.0.78 "GET /compute/v2.1/servers/20760e77-fe67-4ebe-87f1-34d840495341" status: 200 len: 1521 microversion: 2.1 time: 0.287969 Feb 17 04:33:58.421893 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 464/842] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:33:58 2021] GET /compute/v2.1/servers/20760e77-fe67-4ebe-87f1-34d840495341 => generated 1521 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:33:58.449982 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-f965e3cd-ef93-4641-bec0-31bb25491110 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f3e4c3c174942c492405c9b112667de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5b2911946848de81be8f9741faa90f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:33:58.459062 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-f965e3cd-ef93-4641-bec0-31bb25491110 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] 10.222.0.78 "GET /compute/v2.1/servers/b195626c-7ee1-4679-b956-f7ef7d6328f6" status: 200 len: 1358 microversion: 2.1 time: 0.336623 Feb 17 04:33:58.459683 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 379/843] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:33:58 2021] GET /compute/v2.1/servers/b195626c-7ee1-4679-b956-f7ef7d6328f6 => generated 1358 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:33:58.649137 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [req-6492c72f-7961-4b72-97ef-f148c44f2813 req-78f7b370-874b-42f0-b539-bb09e5608309 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20760e77-fe67-4ebe-87f1-34d840495341", "name": "network-vif-unplugged", "status": "completed", "tag": "8f824d75-b2bf-47d0-90e8-3ba823dae40e"}]} {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:33:58.651298 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:33:58.651298 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: warnings.warn(msg) Feb 17 04:33:58.661453 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [req-6492c72f-7961-4b72-97ef-f148c44f2813 req-78f7b370-874b-42f0-b539-bb09e5608309 service nova] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:58.661899 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [req-6492c72f-7961-4b72-97ef-f148c44f2813 req-78f7b370-874b-42f0-b539-bb09e5608309 service nova] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:58.680440 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.compute.server_external_events [req-6492c72f-7961-4b72-97ef-f148c44f2813 req-78f7b370-874b-42f0-b539-bb09e5608309 service nova] Creating event network-vif-unplugged:8f824d75-b2bf-47d0-90e8-3ba823dae40e for instance 20760e77-fe67-4ebe-87f1-34d840495341 on hv-cinder-75998 Feb 17 04:33:58.686273 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [req-6492c72f-7961-4b72-97ef-f148c44f2813 req-78f7b370-874b-42f0-b539-bb09e5608309 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.041016 Feb 17 04:33:58.687116 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 465/844] 10.222.0.78 () {64 vars in 1308 bytes} [Wed Feb 17 04:33:58 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:33:58.934113 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-a5f637ed-41b6-4dca-99ce-d8c366a7665b tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:33:58.934796 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-a5f637ed-41b6-4dca-99ce-d8c366a7665b tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] [instance: ad42ab86-4168-46d3-9394-9fb44fc79d18] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:33:58.943073 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-a5f637ed-41b6-4dca-99ce-d8c366a7665b tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:58.943737 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-a5f637ed-41b6-4dca-99ce-d8c366a7665b tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:58.944707 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-a5f637ed-41b6-4dca-99ce-d8c366a7665b tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:58.945329 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-a5f637ed-41b6-4dca-99ce-d8c366a7665b tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:59.375775 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-a5f637ed-41b6-4dca-99ce-d8c366a7665b tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d68d4a6c12e4331b8df8191cdd7a669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2a1ca6347d4278899a1cc009d87d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:33:59.385119 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-a5f637ed-41b6-4dca-99ce-d8c366a7665b tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] 10.222.0.78 "GET /compute/v2.1/servers/ad42ab86-4168-46d3-9394-9fb44fc79d18" status: 200 len: 1513 microversion: 2.1 time: 0.455105 Feb 17 04:33:59.385855 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 380/845] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:33:58 2021] GET /compute/v2.1/servers/ad42ab86-4168-46d3-9394-9fb44fc79d18 => generated 1513 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:33:59.441245 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-f4e7ae61-98f7-43a5-bfb5-c98d669a55da tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:33:59.442177 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-f4e7ae61-98f7-43a5-bfb5-c98d669a55da tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] [instance: 20760e77-fe67-4ebe-87f1-34d840495341] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:33:59.450904 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-f4e7ae61-98f7-43a5-bfb5-c98d669a55da tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:59.451829 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-f4e7ae61-98f7-43a5-bfb5-c98d669a55da tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:59.452527 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-f4e7ae61-98f7-43a5-bfb5-c98d669a55da tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:59.453089 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-f4e7ae61-98f7-43a5-bfb5-c98d669a55da tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:59.477415 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-34704165-1e53-419f-bf7a-8c9d42459aa3 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:33:59.478064 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-34704165-1e53-419f-bf7a-8c9d42459aa3 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] [instance: b195626c-7ee1-4679-b956-f7ef7d6328f6] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:33:59.487167 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-34704165-1e53-419f-bf7a-8c9d42459aa3 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:59.487689 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-34704165-1e53-419f-bf7a-8c9d42459aa3 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:59.488546 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-34704165-1e53-419f-bf7a-8c9d42459aa3 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:59.489043 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-34704165-1e53-419f-bf7a-8c9d42459aa3 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:59.579973 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-f4e7ae61-98f7-43a5-bfb5-c98d669a55da tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1daf9a83b1d24033a3d4c0f531a4eb2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5336afdcf4aa4b46b0655432b7a1323c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:33:59.589668 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-f4e7ae61-98f7-43a5-bfb5-c98d669a55da tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] 10.222.0.78 "GET /compute/v2.1/servers/20760e77-fe67-4ebe-87f1-34d840495341" status: 200 len: 1479 microversion: 2.1 time: 0.152805 Feb 17 04:33:59.590503 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 466/846] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:33:59 2021] GET /compute/v2.1/servers/20760e77-fe67-4ebe-87f1-34d840495341 => generated 1479 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:33:59.652731 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [req-741479d8-6f7c-46b7-9256-a7637864289f req-b7f369d2-a648-44b8-b13f-4a9c97d5804b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20760e77-fe67-4ebe-87f1-34d840495341", "name": "network-vif-deleted", "tag": "8f824d75-b2bf-47d0-90e8-3ba823dae40e"}]} {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:33:59.654579 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:33:59.654579 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: warnings.warn(msg) Feb 17 04:33:59.663555 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [req-741479d8-6f7c-46b7-9256-a7637864289f req-b7f369d2-a648-44b8-b13f-4a9c97d5804b service nova] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:59.664063 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [req-741479d8-6f7c-46b7-9256-a7637864289f req-b7f369d2-a648-44b8-b13f-4a9c97d5804b service nova] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:59.682065 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.compute.server_external_events [req-741479d8-6f7c-46b7-9256-a7637864289f req-b7f369d2-a648-44b8-b13f-4a9c97d5804b service nova] Creating event network-vif-deleted:8f824d75-b2bf-47d0-90e8-3ba823dae40e for instance 20760e77-fe67-4ebe-87f1-34d840495341 on hv-cinder-75998 Feb 17 04:33:59.687278 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [req-741479d8-6f7c-46b7-9256-a7637864289f req-b7f369d2-a648-44b8-b13f-4a9c97d5804b service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095593 Feb 17 04:33:59.688195 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 467/847] 10.222.0.78 () {64 vars in 1308 bytes} [Wed Feb 17 04:33:59 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:33:59.710885 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-34704165-1e53-419f-bf7a-8c9d42459aa3 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f3e4c3c174942c492405c9b112667de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5b2911946848de81be8f9741faa90f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:33:59.720684 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-34704165-1e53-419f-bf7a-8c9d42459aa3 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] 10.222.0.78 "GET /compute/v2.1/servers/b195626c-7ee1-4679-b956-f7ef7d6328f6" status: 200 len: 1358 microversion: 2.1 time: 0.247192 Feb 17 04:33:59.722172 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 381/848] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:33:59 2021] GET /compute/v2.1/servers/b195626c-7ee1-4679-b956-f7ef7d6328f6 => generated 1358 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:33:59.727279 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-a045d9b6-3888-48f4-ad9f-fa0d6d4cb477 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:33:59.735832 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-a045d9b6-3888-48f4-ad9f-fa0d6d4cb477 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:59.736341 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-a045d9b6-3888-48f4-ad9f-fa0d6d4cb477 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:59.796368 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-a045d9b6-3888-48f4-ad9f-fa0d6d4cb477 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: 29d1ce27-f63b-4523-88be-55f65a6a2529] Going to try to stop instance {{(pid=98179) force_stop /opt/stack/nova/nova/compute/api.py:2580}} Feb 17 04:33:59.875376 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-a045d9b6-3888-48f4-ad9f-fa0d6d4cb477 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "POST /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529/action" status: 202 len: 0 microversion: 2.1 time: 0.152238 Feb 17 04:33:59.876044 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 468/849] 10.222.0.78 () {60 vars in 1268 bytes} [Wed Feb 17 04:33:59 2021] POST /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529/action => generated 0 bytes in 154 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Feb 17 04:33:59.884739 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-756a5414-6a5c-46bd-8a68-74279010d9d3 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:33:59.885517 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-756a5414-6a5c-46bd-8a68-74279010d9d3 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: 29d1ce27-f63b-4523-88be-55f65a6a2529] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:33:59.894592 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-756a5414-6a5c-46bd-8a68-74279010d9d3 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:59.895128 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-756a5414-6a5c-46bd-8a68-74279010d9d3 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:33:59.895974 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-756a5414-6a5c-46bd-8a68-74279010d9d3 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:33:59.896473 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-756a5414-6a5c-46bd-8a68-74279010d9d3 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:00.115184 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-756a5414-6a5c-46bd-8a68-74279010d9d3 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2deb449189ba427a9b8fcb0e21f22566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2c8716a46f54187902492f8ce162f58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:34:00.125482 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-756a5414-6a5c-46bd-8a68-74279010d9d3 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "GET /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529" status: 200 len: 1722 microversion: 2.1 time: 0.244765 Feb 17 04:34:00.126077 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 382/850] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:33:59 2021] GET /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529 => generated 1722 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:34:00.404611 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-f5192370-b449-4692-b754-d1a1c6587d5a tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:34:00.405305 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-f5192370-b449-4692-b754-d1a1c6587d5a tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] [instance: ad42ab86-4168-46d3-9394-9fb44fc79d18] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:34:00.413396 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-f5192370-b449-4692-b754-d1a1c6587d5a tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:00.413906 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-f5192370-b449-4692-b754-d1a1c6587d5a tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:00.414739 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-f5192370-b449-4692-b754-d1a1c6587d5a tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:00.415267 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-f5192370-b449-4692-b754-d1a1c6587d5a tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:00.608309 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-8dd81ea0-56dc-48e1-896b-2543bb9856eb tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:34:00.608986 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-8dd81ea0-56dc-48e1-896b-2543bb9856eb tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] [instance: 20760e77-fe67-4ebe-87f1-34d840495341] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:34:00.617448 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-8dd81ea0-56dc-48e1-896b-2543bb9856eb tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:00.617960 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-8dd81ea0-56dc-48e1-896b-2543bb9856eb tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:00.618810 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-8dd81ea0-56dc-48e1-896b-2543bb9856eb tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:00.619338 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-8dd81ea0-56dc-48e1-896b-2543bb9856eb tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:00.633216 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-f5192370-b449-4692-b754-d1a1c6587d5a tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d68d4a6c12e4331b8df8191cdd7a669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2a1ca6347d4278899a1cc009d87d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:34:00.642236 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-f5192370-b449-4692-b754-d1a1c6587d5a tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] 10.222.0.78 "GET /compute/v2.1/servers/ad42ab86-4168-46d3-9394-9fb44fc79d18" status: 200 len: 1513 microversion: 2.1 time: 0.242774 Feb 17 04:34:00.642846 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 469/851] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:34:00 2021] GET /compute/v2.1/servers/ad42ab86-4168-46d3-9394-9fb44fc79d18 => generated 1513 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:34:00.738888 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-3ecbd93d-d280-4ab4-9e18-919b1530d106 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:34:00.739640 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-3ecbd93d-d280-4ab4-9e18-919b1530d106 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] [instance: b195626c-7ee1-4679-b956-f7ef7d6328f6] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:34:00.748531 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-3ecbd93d-d280-4ab4-9e18-919b1530d106 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:00.749038 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-3ecbd93d-d280-4ab4-9e18-919b1530d106 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:00.749886 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-3ecbd93d-d280-4ab4-9e18-919b1530d106 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:00.750379 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-3ecbd93d-d280-4ab4-9e18-919b1530d106 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:00.759289 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-8dd81ea0-56dc-48e1-896b-2543bb9856eb tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1daf9a83b1d24033a3d4c0f531a4eb2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5336afdcf4aa4b46b0655432b7a1323c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:34:00.768288 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-8dd81ea0-56dc-48e1-896b-2543bb9856eb tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] 10.222.0.78 "GET /compute/v2.1/servers/20760e77-fe67-4ebe-87f1-34d840495341" status: 200 len: 1479 microversion: 2.1 time: 0.164596 Feb 17 04:34:00.768894 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 383/852] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:34:00 2021] GET /compute/v2.1/servers/20760e77-fe67-4ebe-87f1-34d840495341 => generated 1479 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:34:00.963161 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-3ecbd93d-d280-4ab4-9e18-919b1530d106 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f3e4c3c174942c492405c9b112667de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5b2911946848de81be8f9741faa90f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:34:00.972566 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-3ecbd93d-d280-4ab4-9e18-919b1530d106 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] 10.222.0.78 "GET /compute/v2.1/servers/b195626c-7ee1-4679-b956-f7ef7d6328f6" status: 200 len: 1358 microversion: 2.1 time: 0.237967 Feb 17 04:34:00.973167 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 470/853] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:34:00 2021] GET /compute/v2.1/servers/b195626c-7ee1-4679-b956-f7ef7d6328f6 => generated 1358 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:34:01.145745 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-6d827d76-6b72-42cd-9632-8bd6c4ede73e tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:34:01.146470 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-6d827d76-6b72-42cd-9632-8bd6c4ede73e tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: 29d1ce27-f63b-4523-88be-55f65a6a2529] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:34:01.155053 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-6d827d76-6b72-42cd-9632-8bd6c4ede73e tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:01.155564 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-6d827d76-6b72-42cd-9632-8bd6c4ede73e tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:01.156416 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-6d827d76-6b72-42cd-9632-8bd6c4ede73e tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:01.156914 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-6d827d76-6b72-42cd-9632-8bd6c4ede73e tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:01.371539 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-6d827d76-6b72-42cd-9632-8bd6c4ede73e tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2deb449189ba427a9b8fcb0e21f22566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2c8716a46f54187902492f8ce162f58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:34:01.380803 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-6d827d76-6b72-42cd-9632-8bd6c4ede73e tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "GET /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529" status: 200 len: 1722 microversion: 2.1 time: 0.239273 Feb 17 04:34:01.381406 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 384/854] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:34:01 2021] GET /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529 => generated 1722 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:34:01.660784 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-1238f98e-4d7a-4c44-9ff8-194b7ddda5ad tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:34:01.661435 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-1238f98e-4d7a-4c44-9ff8-194b7ddda5ad tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] [instance: ad42ab86-4168-46d3-9394-9fb44fc79d18] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:34:01.670177 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-1238f98e-4d7a-4c44-9ff8-194b7ddda5ad tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:01.670687 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-1238f98e-4d7a-4c44-9ff8-194b7ddda5ad tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:01.671558 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-1238f98e-4d7a-4c44-9ff8-194b7ddda5ad tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:01.672052 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-1238f98e-4d7a-4c44-9ff8-194b7ddda5ad tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:01.788903 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-df1ab3b1-21aa-418b-af4e-a568a9be2372 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:34:01.789492 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-df1ab3b1-21aa-418b-af4e-a568a9be2372 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] [instance: 20760e77-fe67-4ebe-87f1-34d840495341] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:34:01.798845 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-df1ab3b1-21aa-418b-af4e-a568a9be2372 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:01.799381 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-df1ab3b1-21aa-418b-af4e-a568a9be2372 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:01.800237 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-df1ab3b1-21aa-418b-af4e-a568a9be2372 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:01.800732 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-df1ab3b1-21aa-418b-af4e-a568a9be2372 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:01.891068 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-1238f98e-4d7a-4c44-9ff8-194b7ddda5ad tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d68d4a6c12e4331b8df8191cdd7a669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2a1ca6347d4278899a1cc009d87d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:34:01.899862 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-1238f98e-4d7a-4c44-9ff8-194b7ddda5ad tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] 10.222.0.78 "GET /compute/v2.1/servers/ad42ab86-4168-46d3-9394-9fb44fc79d18" status: 200 len: 1513 microversion: 2.1 time: 0.243258 Feb 17 04:34:01.900469 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 471/855] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:34:01 2021] GET /compute/v2.1/servers/ad42ab86-4168-46d3-9394-9fb44fc79d18 => generated 1513 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:34:01.927294 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-df1ab3b1-21aa-418b-af4e-a568a9be2372 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1daf9a83b1d24033a3d4c0f531a4eb2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5336afdcf4aa4b46b0655432b7a1323c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:34:01.936316 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-df1ab3b1-21aa-418b-af4e-a568a9be2372 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] 10.222.0.78 "GET /compute/v2.1/servers/20760e77-fe67-4ebe-87f1-34d840495341" status: 200 len: 1479 microversion: 2.1 time: 0.151520 Feb 17 04:34:01.936919 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 385/856] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:34:01 2021] GET /compute/v2.1/servers/20760e77-fe67-4ebe-87f1-34d840495341 => generated 1479 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:34:01.991779 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-b361b3b9-5d8f-47d4-bce1-9157af8e8a56 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:34:01.992458 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-b361b3b9-5d8f-47d4-bce1-9157af8e8a56 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] [instance: b195626c-7ee1-4679-b956-f7ef7d6328f6] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:34:02.000270 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-b361b3b9-5d8f-47d4-bce1-9157af8e8a56 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:02.000782 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-b361b3b9-5d8f-47d4-bce1-9157af8e8a56 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:02.001617 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-b361b3b9-5d8f-47d4-bce1-9157af8e8a56 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:02.002108 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-b361b3b9-5d8f-47d4-bce1-9157af8e8a56 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:02.218134 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-b361b3b9-5d8f-47d4-bce1-9157af8e8a56 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f3e4c3c174942c492405c9b112667de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5b2911946848de81be8f9741faa90f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:34:02.226890 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-b361b3b9-5d8f-47d4-bce1-9157af8e8a56 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] 10.222.0.78 "GET /compute/v2.1/servers/b195626c-7ee1-4679-b956-f7ef7d6328f6" status: 200 len: 1358 microversion: 2.1 time: 0.239038 Feb 17 04:34:02.227545 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 472/857] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:34:01 2021] GET /compute/v2.1/servers/b195626c-7ee1-4679-b956-f7ef7d6328f6 => generated 1358 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:34:02.399689 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-18c88e9c-2de2-4a2c-b459-cb5dc817ba3f tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:34:02.400396 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-18c88e9c-2de2-4a2c-b459-cb5dc817ba3f tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: 29d1ce27-f63b-4523-88be-55f65a6a2529] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:34:02.408293 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-18c88e9c-2de2-4a2c-b459-cb5dc817ba3f tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:02.408808 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-18c88e9c-2de2-4a2c-b459-cb5dc817ba3f tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:02.409645 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-18c88e9c-2de2-4a2c-b459-cb5dc817ba3f tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:02.410151 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-18c88e9c-2de2-4a2c-b459-cb5dc817ba3f tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:02.624541 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-18c88e9c-2de2-4a2c-b459-cb5dc817ba3f tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2deb449189ba427a9b8fcb0e21f22566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2c8716a46f54187902492f8ce162f58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:34:02.633864 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-18c88e9c-2de2-4a2c-b459-cb5dc817ba3f tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "GET /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529" status: 200 len: 1722 microversion: 2.1 time: 0.238212 Feb 17 04:34:02.634464 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 386/858] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:34:02 2021] GET /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529 => generated 1722 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:34:02.918624 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-6a2562ec-f755-4ae4-a8bf-188fe77c5949 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:34:02.919376 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-6a2562ec-f755-4ae4-a8bf-188fe77c5949 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] [instance: ad42ab86-4168-46d3-9394-9fb44fc79d18] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:34:02.927272 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-6a2562ec-f755-4ae4-a8bf-188fe77c5949 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:02.927789 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-6a2562ec-f755-4ae4-a8bf-188fe77c5949 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:02.928631 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-6a2562ec-f755-4ae4-a8bf-188fe77c5949 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:02.929175 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-6a2562ec-f755-4ae4-a8bf-188fe77c5949 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:02.953979 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-bef4945d-c2df-4038-8abb-977698529665 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:34:02.954648 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-bef4945d-c2df-4038-8abb-977698529665 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] [instance: 20760e77-fe67-4ebe-87f1-34d840495341] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:34:02.969645 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-bef4945d-c2df-4038-8abb-977698529665 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:02.970168 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-bef4945d-c2df-4038-8abb-977698529665 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:02.971023 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-bef4945d-c2df-4038-8abb-977698529665 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:02.971551 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-bef4945d-c2df-4038-8abb-977698529665 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:03.110564 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-bef4945d-c2df-4038-8abb-977698529665 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1daf9a83b1d24033a3d4c0f531a4eb2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5336afdcf4aa4b46b0655432b7a1323c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:34:03.120855 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-bef4945d-c2df-4038-8abb-977698529665 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] 10.222.0.78 "GET /compute/v2.1/servers/20760e77-fe67-4ebe-87f1-34d840495341" status: 200 len: 1479 microversion: 2.1 time: 0.170243 Feb 17 04:34:03.121446 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 387/859] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:34:02 2021] GET /compute/v2.1/servers/20760e77-fe67-4ebe-87f1-34d840495341 => generated 1479 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:34:03.157837 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-6a2562ec-f755-4ae4-a8bf-188fe77c5949 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d68d4a6c12e4331b8df8191cdd7a669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2a1ca6347d4278899a1cc009d87d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:34:03.170100 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-6a2562ec-f755-4ae4-a8bf-188fe77c5949 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] 10.222.0.78 "GET /compute/v2.1/servers/ad42ab86-4168-46d3-9394-9fb44fc79d18" status: 200 len: 1513 microversion: 2.1 time: 0.255787 Feb 17 04:34:03.170848 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 473/860] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:34:02 2021] GET /compute/v2.1/servers/ad42ab86-4168-46d3-9394-9fb44fc79d18 => generated 1513 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:34:03.245279 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-90fa1607-4e8d-4f16-b96f-7df1014ae5c5 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:34:03.246236 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-90fa1607-4e8d-4f16-b96f-7df1014ae5c5 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] [instance: b195626c-7ee1-4679-b956-f7ef7d6328f6] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:34:03.254175 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-90fa1607-4e8d-4f16-b96f-7df1014ae5c5 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:03.254692 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-90fa1607-4e8d-4f16-b96f-7df1014ae5c5 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:03.255568 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-90fa1607-4e8d-4f16-b96f-7df1014ae5c5 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:03.256071 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-90fa1607-4e8d-4f16-b96f-7df1014ae5c5 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:03.476244 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-90fa1607-4e8d-4f16-b96f-7df1014ae5c5 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f3e4c3c174942c492405c9b112667de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5b2911946848de81be8f9741faa90f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:34:03.485527 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-90fa1607-4e8d-4f16-b96f-7df1014ae5c5 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] 10.222.0.78 "GET /compute/v2.1/servers/b195626c-7ee1-4679-b956-f7ef7d6328f6" status: 200 len: 1358 microversion: 2.1 time: 0.244026 Feb 17 04:34:03.486131 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 388/861] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:34:03 2021] GET /compute/v2.1/servers/b195626c-7ee1-4679-b956-f7ef7d6328f6 => generated 1358 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:34:03.652881 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-6d173e7d-20fd-4867-be9e-7e25dc94f4c7 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:34:03.653668 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-6d173e7d-20fd-4867-be9e-7e25dc94f4c7 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: 29d1ce27-f63b-4523-88be-55f65a6a2529] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:34:03.661527 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-6d173e7d-20fd-4867-be9e-7e25dc94f4c7 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:03.662036 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-6d173e7d-20fd-4867-be9e-7e25dc94f4c7 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:03.662869 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-6d173e7d-20fd-4867-be9e-7e25dc94f4c7 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:03.663436 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-6d173e7d-20fd-4867-be9e-7e25dc94f4c7 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:03.882429 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-6d173e7d-20fd-4867-be9e-7e25dc94f4c7 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2deb449189ba427a9b8fcb0e21f22566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2c8716a46f54187902492f8ce162f58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:34:03.892376 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-6d173e7d-20fd-4867-be9e-7e25dc94f4c7 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "GET /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529" status: 200 len: 1722 microversion: 2.1 time: 0.244109 Feb 17 04:34:03.892961 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 474/862] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:34:03 2021] GET /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529 => generated 1722 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:34:04.138659 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-cafbc428-04d0-411b-a6a4-463443fc2c24 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:34:04.139368 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-cafbc428-04d0-411b-a6a4-463443fc2c24 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] [instance: 20760e77-fe67-4ebe-87f1-34d840495341] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:34:04.147455 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-cafbc428-04d0-411b-a6a4-463443fc2c24 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:04.148197 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-cafbc428-04d0-411b-a6a4-463443fc2c24 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:04.149061 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-cafbc428-04d0-411b-a6a4-463443fc2c24 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:04.149566 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-cafbc428-04d0-411b-a6a4-463443fc2c24 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:04.189197 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-1fcefab7-bbaf-47e4-bffb-a51ee9713d9d tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:34:04.189884 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-1fcefab7-bbaf-47e4-bffb-a51ee9713d9d tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] [instance: ad42ab86-4168-46d3-9394-9fb44fc79d18] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:34:04.197654 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-1fcefab7-bbaf-47e4-bffb-a51ee9713d9d tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:04.198207 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-1fcefab7-bbaf-47e4-bffb-a51ee9713d9d tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:04.199161 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-1fcefab7-bbaf-47e4-bffb-a51ee9713d9d tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:04.199659 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-1fcefab7-bbaf-47e4-bffb-a51ee9713d9d tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:04.227898 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-cafbc428-04d0-411b-a6a4-463443fc2c24 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:04.228421 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-cafbc428-04d0-411b-a6a4-463443fc2c24 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:04.228950 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.objects.instance [None req-cafbc428-04d0-411b-a6a4-463443fc2c24 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lazy-loading 'fault' on Instance uuid 20760e77-fe67-4ebe-87f1-34d840495341 {{(pid=98178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Feb 17 04:34:04.300849 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-cafbc428-04d0-411b-a6a4-463443fc2c24 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1daf9a83b1d24033a3d4c0f531a4eb2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5336afdcf4aa4b46b0655432b7a1323c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:34:04.311596 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-cafbc428-04d0-411b-a6a4-463443fc2c24 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] 10.222.0.78 "GET /compute/v2.1/servers/20760e77-fe67-4ebe-87f1-34d840495341" status: 200 len: 1312 microversion: 2.1 time: 0.177037 Feb 17 04:34:04.312598 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 389/863] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:34:04 2021] GET /compute/v2.1/servers/20760e77-fe67-4ebe-87f1-34d840495341 => generated 1312 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:34:04.502797 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-72ed6044-2550-4a38-bb6d-f73fb69156da tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:34:04.503578 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-72ed6044-2550-4a38-bb6d-f73fb69156da tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] [instance: b195626c-7ee1-4679-b956-f7ef7d6328f6] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:34:04.512337 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-72ed6044-2550-4a38-bb6d-f73fb69156da tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:04.512964 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-72ed6044-2550-4a38-bb6d-f73fb69156da tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:04.513885 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-72ed6044-2550-4a38-bb6d-f73fb69156da tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:04.514369 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-72ed6044-2550-4a38-bb6d-f73fb69156da tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:04.545509 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-1fcefab7-bbaf-47e4-bffb-a51ee9713d9d tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d68d4a6c12e4331b8df8191cdd7a669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2a1ca6347d4278899a1cc009d87d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:34:04.554512 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-1fcefab7-bbaf-47e4-bffb-a51ee9713d9d tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] 10.222.0.78 "GET /compute/v2.1/servers/ad42ab86-4168-46d3-9394-9fb44fc79d18" status: 200 len: 1513 microversion: 2.1 time: 0.369492 Feb 17 04:34:04.555153 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 475/864] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:34:04 2021] GET /compute/v2.1/servers/ad42ab86-4168-46d3-9394-9fb44fc79d18 => generated 1513 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:34:04.731938 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-72ed6044-2550-4a38-bb6d-f73fb69156da tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f3e4c3c174942c492405c9b112667de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5b2911946848de81be8f9741faa90f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:34:04.741679 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-72ed6044-2550-4a38-bb6d-f73fb69156da tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] 10.222.0.78 "GET /compute/v2.1/servers/b195626c-7ee1-4679-b956-f7ef7d6328f6" status: 200 len: 1358 microversion: 2.1 time: 0.242760 Feb 17 04:34:04.742326 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 390/865] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:34:04 2021] GET /compute/v2.1/servers/b195626c-7ee1-4679-b956-f7ef7d6328f6 => generated 1358 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:34:04.910057 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-96f0cf2a-633c-4237-b383-4216f5872098 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:34:04.910729 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-96f0cf2a-633c-4237-b383-4216f5872098 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: 29d1ce27-f63b-4523-88be-55f65a6a2529] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:34:04.919015 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-96f0cf2a-633c-4237-b383-4216f5872098 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:04.919564 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-96f0cf2a-633c-4237-b383-4216f5872098 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:04.920403 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-96f0cf2a-633c-4237-b383-4216f5872098 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:04.920897 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-96f0cf2a-633c-4237-b383-4216f5872098 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:05.131204 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-96f0cf2a-633c-4237-b383-4216f5872098 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2deb449189ba427a9b8fcb0e21f22566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2c8716a46f54187902492f8ce162f58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:34:05.142238 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-96f0cf2a-633c-4237-b383-4216f5872098 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "GET /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529" status: 200 len: 1722 microversion: 2.1 time: 0.236143 Feb 17 04:34:05.142863 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 476/866] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:34:04 2021] GET /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529 => generated 1722 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:34:05.330603 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-c0e23875-d215-4824-92f2-494ec7a36954 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:34:05.331250 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-c0e23875-d215-4824-92f2-494ec7a36954 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] [instance: 20760e77-fe67-4ebe-87f1-34d840495341] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:34:05.339695 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-c0e23875-d215-4824-92f2-494ec7a36954 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:05.340271 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-c0e23875-d215-4824-92f2-494ec7a36954 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:05.341138 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-c0e23875-d215-4824-92f2-494ec7a36954 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:05.341643 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-c0e23875-d215-4824-92f2-494ec7a36954 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:05.395509 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.wsgi [None req-c0e23875-d215-4824-92f2-494ec7a36954 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] HTTP exception thrown: Instance 20760e77-fe67-4ebe-87f1-34d840495341 could not be found. Feb 17 04:34:05.396165 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-c0e23875-d215-4824-92f2-494ec7a36954 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] Returning 404 to user: Instance 20760e77-fe67-4ebe-87f1-34d840495341 could not be found. {{(pid=98178) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 17 04:34:05.397070 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-c0e23875-d215-4824-92f2-494ec7a36954 tempest-ServerRescueNegativeTestJSON-721894797 tempest-ServerRescueNegativeTestJSON-721894797-project] 10.222.0.78 "GET /compute/v2.1/servers/20760e77-fe67-4ebe-87f1-34d840495341" status: 404 len: 111 microversion: 2.1 time: 0.070626 Feb 17 04:34:05.397683 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 391/867] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:34:05 2021] GET /compute/v2.1/servers/20760e77-fe67-4ebe-87f1-34d840495341 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 17 04:34:05.574538 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-178b2f23-bcf6-45fb-94ac-1986c67e29f2 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:34:05.575252 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-178b2f23-bcf6-45fb-94ac-1986c67e29f2 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] [instance: ad42ab86-4168-46d3-9394-9fb44fc79d18] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:34:05.583865 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-178b2f23-bcf6-45fb-94ac-1986c67e29f2 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:05.584287 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-178b2f23-bcf6-45fb-94ac-1986c67e29f2 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:05.585149 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-178b2f23-bcf6-45fb-94ac-1986c67e29f2 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:05.585644 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-178b2f23-bcf6-45fb-94ac-1986c67e29f2 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:05.760799 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-b851fc74-9ee3-4a42-b336-fe2c8a22b187 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:34:05.761795 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-b851fc74-9ee3-4a42-b336-fe2c8a22b187 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] [instance: b195626c-7ee1-4679-b956-f7ef7d6328f6] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:34:05.770017 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-b851fc74-9ee3-4a42-b336-fe2c8a22b187 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:05.770613 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-b851fc74-9ee3-4a42-b336-fe2c8a22b187 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:05.771614 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-b851fc74-9ee3-4a42-b336-fe2c8a22b187 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:05.772246 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-b851fc74-9ee3-4a42-b336-fe2c8a22b187 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:05.824473 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-178b2f23-bcf6-45fb-94ac-1986c67e29f2 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d68d4a6c12e4331b8df8191cdd7a669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2a1ca6347d4278899a1cc009d87d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:34:05.846137 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-178b2f23-bcf6-45fb-94ac-1986c67e29f2 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] 10.222.0.78 "GET /compute/v2.1/servers/ad42ab86-4168-46d3-9394-9fb44fc79d18" status: 200 len: 1513 microversion: 2.1 time: 0.276168 Feb 17 04:34:05.851557 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 477/868] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:34:05 2021] GET /compute/v2.1/servers/ad42ab86-4168-46d3-9394-9fb44fc79d18 => generated 1513 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:34:06.068050 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [req-eef43891-251c-4340-acc0-069704eeb7a7 req-45be7b03-cb28-4369-bdb5-b5168a160ae6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b195626c-7ee1-4679-b956-f7ef7d6328f6", "name": "network-vif-plugged", "status": "completed", "tag": "b60a0e42-338e-46c0-ba43-9b2027219e08"}]} {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:34:06.069903 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:34:06.069903 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: warnings.warn(msg) Feb 17 04:34:06.079234 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [req-eef43891-251c-4340-acc0-069704eeb7a7 req-45be7b03-cb28-4369-bdb5-b5168a160ae6 service nova] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:06.079745 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [req-eef43891-251c-4340-acc0-069704eeb7a7 req-45be7b03-cb28-4369-bdb5-b5168a160ae6 service nova] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:06.097834 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.compute.server_external_events [req-eef43891-251c-4340-acc0-069704eeb7a7 req-45be7b03-cb28-4369-bdb5-b5168a160ae6 service nova] Creating event network-vif-plugged:b60a0e42-338e-46c0-ba43-9b2027219e08 for instance b195626c-7ee1-4679-b956-f7ef7d6328f6 on hv-cinder-75998 Feb 17 04:34:06.103166 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [req-eef43891-251c-4340-acc0-069704eeb7a7 req-45be7b03-cb28-4369-bdb5-b5168a160ae6 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039196 Feb 17 04:34:06.103972 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 478/869] 10.222.0.78 () {64 vars in 1308 bytes} [Wed Feb 17 04:34:06 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 17 04:34:06.163849 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-a80ee3d4-6c7e-4d2a-9802-8e06121cfef3 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:34:06.165088 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-a80ee3d4-6c7e-4d2a-9802-8e06121cfef3 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: 29d1ce27-f63b-4523-88be-55f65a6a2529] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:34:06.184220 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-a80ee3d4-6c7e-4d2a-9802-8e06121cfef3 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:06.184910 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-a80ee3d4-6c7e-4d2a-9802-8e06121cfef3 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:06.186148 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-a80ee3d4-6c7e-4d2a-9802-8e06121cfef3 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:06.186896 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-a80ee3d4-6c7e-4d2a-9802-8e06121cfef3 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:06.419620 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-a80ee3d4-6c7e-4d2a-9802-8e06121cfef3 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2deb449189ba427a9b8fcb0e21f22566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2c8716a46f54187902492f8ce162f58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:34:06.429428 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-a80ee3d4-6c7e-4d2a-9802-8e06121cfef3 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "GET /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529" status: 200 len: 1722 microversion: 2.1 time: 0.271317 Feb 17 04:34:06.430148 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 479/870] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:34:06 2021] GET /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529 => generated 1722 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:34:06.539618 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-b851fc74-9ee3-4a42-b336-fe2c8a22b187 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f3e4c3c174942c492405c9b112667de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5b2911946848de81be8f9741faa90f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:34:06.548797 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-b851fc74-9ee3-4a42-b336-fe2c8a22b187 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] 10.222.0.78 "GET /compute/v2.1/servers/b195626c-7ee1-4679-b956-f7ef7d6328f6" status: 200 len: 1358 microversion: 2.1 time: 0.792218 Feb 17 04:34:06.549494 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 392/871] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:34:05 2021] GET /compute/v2.1/servers/b195626c-7ee1-4679-b956-f7ef7d6328f6 => generated 1358 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:34:06.869493 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-a0291045-e443-4f8a-a802-aa8d655b8e1d tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:34:06.871436 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-a0291045-e443-4f8a-a802-aa8d655b8e1d tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] [instance: ad42ab86-4168-46d3-9394-9fb44fc79d18] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:34:06.879357 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-a0291045-e443-4f8a-a802-aa8d655b8e1d tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:06.879867 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-a0291045-e443-4f8a-a802-aa8d655b8e1d tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:06.880855 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-a0291045-e443-4f8a-a802-aa8d655b8e1d tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:06.881349 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-a0291045-e443-4f8a-a802-aa8d655b8e1d tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:07.119511 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-a0291045-e443-4f8a-a802-aa8d655b8e1d tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d68d4a6c12e4331b8df8191cdd7a669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2a1ca6347d4278899a1cc009d87d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:34:07.130166 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-a0291045-e443-4f8a-a802-aa8d655b8e1d tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] 10.222.0.78 "GET /compute/v2.1/servers/ad42ab86-4168-46d3-9394-9fb44fc79d18" status: 200 len: 1513 microversion: 2.1 time: 0.264846 Feb 17 04:34:07.130866 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 480/872] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:34:06 2021] GET /compute/v2.1/servers/ad42ab86-4168-46d3-9394-9fb44fc79d18 => generated 1513 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:34:07.449174 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-84f6f36b-403c-46c1-a010-9271286cc70b tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:34:07.449860 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-84f6f36b-403c-46c1-a010-9271286cc70b tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: 29d1ce27-f63b-4523-88be-55f65a6a2529] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:34:07.458196 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-84f6f36b-403c-46c1-a010-9271286cc70b tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:07.458713 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-84f6f36b-403c-46c1-a010-9271286cc70b tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:07.459606 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-84f6f36b-403c-46c1-a010-9271286cc70b tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:07.460110 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-84f6f36b-403c-46c1-a010-9271286cc70b tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:07.566599 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-d45e3096-0930-47de-a824-252baa847512 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:34:07.567244 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-d45e3096-0930-47de-a824-252baa847512 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] [instance: b195626c-7ee1-4679-b956-f7ef7d6328f6] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:34:07.575885 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-d45e3096-0930-47de-a824-252baa847512 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:07.576395 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-d45e3096-0930-47de-a824-252baa847512 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:07.577227 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-d45e3096-0930-47de-a824-252baa847512 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:07.577716 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-d45e3096-0930-47de-a824-252baa847512 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:07.795364 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-d45e3096-0930-47de-a824-252baa847512 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f3e4c3c174942c492405c9b112667de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5b2911946848de81be8f9741faa90f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:34:07.804299 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-d45e3096-0930-47de-a824-252baa847512 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] 10.222.0.78 "GET /compute/v2.1/servers/b195626c-7ee1-4679-b956-f7ef7d6328f6" status: 200 len: 1358 microversion: 2.1 time: 0.241784 Feb 17 04:34:07.805082 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 481/873] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:34:07 2021] GET /compute/v2.1/servers/b195626c-7ee1-4679-b956-f7ef7d6328f6 => generated 1358 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:34:08.038718 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-84f6f36b-403c-46c1-a010-9271286cc70b tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2deb449189ba427a9b8fcb0e21f22566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2c8716a46f54187902492f8ce162f58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:34:08.048275 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-84f6f36b-403c-46c1-a010-9271286cc70b tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "GET /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529" status: 200 len: 1722 microversion: 2.1 time: 0.603814 Feb 17 04:34:08.048930 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 393/874] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:34:07 2021] GET /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529 => generated 1722 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:34:08.122165 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [req-01d229c4-fbf0-4d70-b6dc-2a11cab2723e req-dc22a23f-0b86-4e2a-bc3e-9e5735b10b5a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad42ab86-4168-46d3-9394-9fb44fc79d18", "name": "network-vif-deleted", "tag": "792b9d8e-6dd8-4b55-a5f2-852e8232b46b"}]} {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:34:08.123929 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:34:08.123929 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: warnings.warn(msg) Feb 17 04:34:08.132799 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [req-01d229c4-fbf0-4d70-b6dc-2a11cab2723e req-dc22a23f-0b86-4e2a-bc3e-9e5735b10b5a service nova] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:08.133287 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [req-01d229c4-fbf0-4d70-b6dc-2a11cab2723e req-dc22a23f-0b86-4e2a-bc3e-9e5735b10b5a service nova] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:08.153085 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.compute.server_external_events [req-01d229c4-fbf0-4d70-b6dc-2a11cab2723e req-dc22a23f-0b86-4e2a-bc3e-9e5735b10b5a service nova] Creating event network-vif-deleted:792b9d8e-6dd8-4b55-a5f2-852e8232b46b for instance ad42ab86-4168-46d3-9394-9fb44fc79d18 on hv-cinder-75998 Feb 17 04:34:08.157530 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-bd1fa577-3f56-4a0d-97e5-4302306fc6c0 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:34:08.159263 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-bd1fa577-3f56-4a0d-97e5-4302306fc6c0 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] [instance: ad42ab86-4168-46d3-9394-9fb44fc79d18] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:34:08.160313 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [req-01d229c4-fbf0-4d70-b6dc-2a11cab2723e req-dc22a23f-0b86-4e2a-bc3e-9e5735b10b5a service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042107 Feb 17 04:34:08.161107 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 482/875] 10.222.0.78 () {64 vars in 1308 bytes} [Wed Feb 17 04:34:08 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:34:08.168067 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-bd1fa577-3f56-4a0d-97e5-4302306fc6c0 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:08.168710 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-bd1fa577-3f56-4a0d-97e5-4302306fc6c0 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:08.169437 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-bd1fa577-3f56-4a0d-97e5-4302306fc6c0 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:08.169938 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-bd1fa577-3f56-4a0d-97e5-4302306fc6c0 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:08.284992 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-769e0c57-13c3-4a4b-8b71-8200d46b3c7f tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:34:08.285714 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-769e0c57-13c3-4a4b-8b71-8200d46b3c7f tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] [instance: c115a692-885c-492c-a345-4bda25cab425] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:34:08.294056 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-769e0c57-13c3-4a4b-8b71-8200d46b3c7f tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:08.294647 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-769e0c57-13c3-4a4b-8b71-8200d46b3c7f tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:08.295629 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-769e0c57-13c3-4a4b-8b71-8200d46b3c7f tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:08.296191 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-769e0c57-13c3-4a4b-8b71-8200d46b3c7f tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:08.423521 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-bd1fa577-3f56-4a0d-97e5-4302306fc6c0 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d68d4a6c12e4331b8df8191cdd7a669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2a1ca6347d4278899a1cc009d87d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:34:08.437010 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-bd1fa577-3f56-4a0d-97e5-4302306fc6c0 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] 10.222.0.78 "GET /compute/v2.1/servers/ad42ab86-4168-46d3-9394-9fb44fc79d18" status: 200 len: 1471 microversion: 2.1 time: 0.283424 Feb 17 04:34:08.437881 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 394/876] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:34:08 2021] GET /compute/v2.1/servers/ad42ab86-4168-46d3-9394-9fb44fc79d18 => generated 1471 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:34:08.474459 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.objects.instance [None req-769e0c57-13c3-4a4b-8b71-8200d46b3c7f tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Lazy-loading 'services' on Instance uuid c115a692-885c-492c-a345-4bda25cab425 {{(pid=98179) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Feb 17 04:34:08.621828 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-769e0c57-13c3-4a4b-8b71-8200d46b3c7f tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] 10.222.0.78 "DELETE /compute/v2.1/servers/c115a692-885c-492c-a345-4bda25cab425/os-volume_attachments/12d16ec8-050d-460a-b5d5-f49f4a2a8be8" status: 202 len: 0 microversion: 2.1 time: 0.340014 Feb 17 04:34:08.622484 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 483/877] 10.222.0.78 () {58 vars in 1406 bytes} [Wed Feb 17 04:34:08 2021] DELETE /compute/v2.1/servers/c115a692-885c-492c-a345-4bda25cab425/os-volume_attachments/12d16ec8-050d-460a-b5d5-f49f4a2a8be8 => generated 0 bytes in 343 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:34:08.823072 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-1630cfcb-cff8-432b-bf7e-201e962b8ad8 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:34:08.825299 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-1630cfcb-cff8-432b-bf7e-201e962b8ad8 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] [instance: b195626c-7ee1-4679-b956-f7ef7d6328f6] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:34:08.833127 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-1630cfcb-cff8-432b-bf7e-201e962b8ad8 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:08.833642 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-1630cfcb-cff8-432b-bf7e-201e962b8ad8 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:08.834567 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-1630cfcb-cff8-432b-bf7e-201e962b8ad8 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:08.835080 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-1630cfcb-cff8-432b-bf7e-201e962b8ad8 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:09.068364 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-d9b0de42-689c-41a1-a754-bf756bcd5f83 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:34:09.069282 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-d9b0de42-689c-41a1-a754-bf756bcd5f83 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: 29d1ce27-f63b-4523-88be-55f65a6a2529] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:34:09.078837 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-d9b0de42-689c-41a1-a754-bf756bcd5f83 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:09.079388 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-d9b0de42-689c-41a1-a754-bf756bcd5f83 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:09.080279 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-d9b0de42-689c-41a1-a754-bf756bcd5f83 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:09.080753 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-d9b0de42-689c-41a1-a754-bf756bcd5f83 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:09.274026 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-1630cfcb-cff8-432b-bf7e-201e962b8ad8 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f3e4c3c174942c492405c9b112667de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5b2911946848de81be8f9741faa90f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:34:09.283270 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-1630cfcb-cff8-432b-bf7e-201e962b8ad8 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] 10.222.0.78 "GET /compute/v2.1/servers/b195626c-7ee1-4679-b956-f7ef7d6328f6" status: 200 len: 1358 microversion: 2.1 time: 0.464614 Feb 17 04:34:09.283840 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 395/878] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:34:08 2021] GET /compute/v2.1/servers/b195626c-7ee1-4679-b956-f7ef7d6328f6 => generated 1358 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:34:09.347791 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-d9b0de42-689c-41a1-a754-bf756bcd5f83 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2deb449189ba427a9b8fcb0e21f22566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2c8716a46f54187902492f8ce162f58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:34:09.358051 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-d9b0de42-689c-41a1-a754-bf756bcd5f83 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "GET /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529" status: 200 len: 1722 microversion: 2.1 time: 0.294929 Feb 17 04:34:09.358672 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 484/879] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:34:09 2021] GET /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529 => generated 1722 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:34:09.457943 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-d6fe42fd-f4ef-4425-8f42-eeb2883e7d1e tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:34:09.458566 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-d6fe42fd-f4ef-4425-8f42-eeb2883e7d1e tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] [instance: ad42ab86-4168-46d3-9394-9fb44fc79d18] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:34:09.467049 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-d6fe42fd-f4ef-4425-8f42-eeb2883e7d1e tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:09.467565 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-d6fe42fd-f4ef-4425-8f42-eeb2883e7d1e tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:09.468417 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-d6fe42fd-f4ef-4425-8f42-eeb2883e7d1e tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:09.468913 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-d6fe42fd-f4ef-4425-8f42-eeb2883e7d1e tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:09.524316 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.wsgi [None req-d6fe42fd-f4ef-4425-8f42-eeb2883e7d1e tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] HTTP exception thrown: Instance ad42ab86-4168-46d3-9394-9fb44fc79d18 could not be found. Feb 17 04:34:09.525112 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-d6fe42fd-f4ef-4425-8f42-eeb2883e7d1e tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Returning 404 to user: Instance ad42ab86-4168-46d3-9394-9fb44fc79d18 could not be found. {{(pid=98178) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 17 04:34:09.526033 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-d6fe42fd-f4ef-4425-8f42-eeb2883e7d1e tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] 10.222.0.78 "GET /compute/v2.1/servers/ad42ab86-4168-46d3-9394-9fb44fc79d18" status: 404 len: 111 microversion: 2.1 time: 0.072228 Feb 17 04:34:09.527273 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 396/880] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:34:09 2021] GET /compute/v2.1/servers/ad42ab86-4168-46d3-9394-9fb44fc79d18 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 17 04:34:09.535794 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-94e58418-18a3-4604-ac9e-832ea87c4b1a tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:34:09.536347 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-94e58418-18a3-4604-ac9e-832ea87c4b1a tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] [instance: 555b8368-f196-4c6c-acf7-bc67d324c98a] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:34:09.544446 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-94e58418-18a3-4604-ac9e-832ea87c4b1a tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:09.544940 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-94e58418-18a3-4604-ac9e-832ea87c4b1a tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:09.545795 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-94e58418-18a3-4604-ac9e-832ea87c4b1a tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:09.546283 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-94e58418-18a3-4604-ac9e-832ea87c4b1a tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:09.612228 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-94e58418-18a3-4604-ac9e-832ea87c4b1a tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] [instance: 555b8368-f196-4c6c-acf7-bc67d324c98a] Going to try to terminate instance {{(pid=98179) delete /opt/stack/nova/nova/compute/api.py:2540}} Feb 17 04:34:09.732435 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-94e58418-18a3-4604-ac9e-832ea87c4b1a tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] 10.222.0.78 "DELETE /compute/v2.1/servers/555b8368-f196-4c6c-acf7-bc67d324c98a" status: 204 len: 0 microversion: 2.1 time: 0.200315 Feb 17 04:34:09.733094 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 485/881] 10.222.0.78 () {58 vars in 1229 bytes} [Wed Feb 17 04:34:09 2021] DELETE /compute/v2.1/servers/555b8368-f196-4c6c-acf7-bc67d324c98a => generated 0 bytes in 202 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Feb 17 04:34:09.743629 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-fc6dcedd-0af5-487a-84dd-b2c26c439f46 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:34:09.744367 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-fc6dcedd-0af5-487a-84dd-b2c26c439f46 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] [instance: 555b8368-f196-4c6c-acf7-bc67d324c98a] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:34:09.763188 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-fc6dcedd-0af5-487a-84dd-b2c26c439f46 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:09.763716 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-fc6dcedd-0af5-487a-84dd-b2c26c439f46 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:09.764751 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-fc6dcedd-0af5-487a-84dd-b2c26c439f46 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:09.765038 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-fc6dcedd-0af5-487a-84dd-b2c26c439f46 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:10.302221 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-1c0902c2-8a95-478a-ab14-05bcfaadad9b tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:34:10.302992 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-1c0902c2-8a95-478a-ab14-05bcfaadad9b tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] [instance: b195626c-7ee1-4679-b956-f7ef7d6328f6] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:34:10.307137 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-fc6dcedd-0af5-487a-84dd-b2c26c439f46 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d68d4a6c12e4331b8df8191cdd7a669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2a1ca6347d4278899a1cc009d87d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:34:10.311953 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-1c0902c2-8a95-478a-ab14-05bcfaadad9b tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:10.312477 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-1c0902c2-8a95-478a-ab14-05bcfaadad9b tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:10.313330 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-1c0902c2-8a95-478a-ab14-05bcfaadad9b tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:10.313833 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-1c0902c2-8a95-478a-ab14-05bcfaadad9b tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:10.317449 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-fc6dcedd-0af5-487a-84dd-b2c26c439f46 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] 10.222.0.78 "GET /compute/v2.1/servers/555b8368-f196-4c6c-acf7-bc67d324c98a" status: 200 len: 1513 microversion: 2.1 time: 0.579466 Feb 17 04:34:10.318262 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 397/882] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:34:09 2021] GET /compute/v2.1/servers/555b8368-f196-4c6c-acf7-bc67d324c98a => generated 1513 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:34:10.377890 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-917fe8a9-9624-4780-a55f-f1e5167f0ad6 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:34:10.378653 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-917fe8a9-9624-4780-a55f-f1e5167f0ad6 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: 29d1ce27-f63b-4523-88be-55f65a6a2529] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:34:10.386918 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-917fe8a9-9624-4780-a55f-f1e5167f0ad6 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:10.388856 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-917fe8a9-9624-4780-a55f-f1e5167f0ad6 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:10.389828 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-917fe8a9-9624-4780-a55f-f1e5167f0ad6 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:10.403411 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-917fe8a9-9624-4780-a55f-f1e5167f0ad6 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:10.546459 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-1c0902c2-8a95-478a-ab14-05bcfaadad9b tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f3e4c3c174942c492405c9b112667de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5b2911946848de81be8f9741faa90f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:34:10.557440 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-1c0902c2-8a95-478a-ab14-05bcfaadad9b tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] 10.222.0.78 "GET /compute/v2.1/servers/b195626c-7ee1-4679-b956-f7ef7d6328f6" status: 200 len: 1548 microversion: 2.1 time: 0.259728 Feb 17 04:34:10.558415 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 486/883] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:34:10 2021] GET /compute/v2.1/servers/b195626c-7ee1-4679-b956-f7ef7d6328f6 => generated 1548 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:34:10.575351 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-8c694f1e-0ffe-4cbe-af20-2ad9484214bf tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:34:10.576041 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-8c694f1e-0ffe-4cbe-af20-2ad9484214bf tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] [instance: b195626c-7ee1-4679-b956-f7ef7d6328f6] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:34:10.583955 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-8c694f1e-0ffe-4cbe-af20-2ad9484214bf tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:10.584478 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-8c694f1e-0ffe-4cbe-af20-2ad9484214bf tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:10.585347 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-8c694f1e-0ffe-4cbe-af20-2ad9484214bf tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:10.586160 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-8c694f1e-0ffe-4cbe-af20-2ad9484214bf tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:10.689208 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-917fe8a9-9624-4780-a55f-f1e5167f0ad6 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2deb449189ba427a9b8fcb0e21f22566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2c8716a46f54187902492f8ce162f58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:34:10.699166 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-917fe8a9-9624-4780-a55f-f1e5167f0ad6 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "GET /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529" status: 200 len: 1722 microversion: 2.1 time: 0.325193 Feb 17 04:34:10.699782 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 398/884] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:34:10 2021] GET /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529 => generated 1722 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:34:10.966434 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-484339f8-e6d1-46bd-91af-c29c9eb841e2 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:34:10.966995 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-484339f8-e6d1-46bd-91af-c29c9eb841e2 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] [instance: c115a692-885c-492c-a345-4bda25cab425] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:34:10.975114 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-484339f8-e6d1-46bd-91af-c29c9eb841e2 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:10.975600 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-484339f8-e6d1-46bd-91af-c29c9eb841e2 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:10.976467 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-484339f8-e6d1-46bd-91af-c29c9eb841e2 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:10.976961 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-484339f8-e6d1-46bd-91af-c29c9eb841e2 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:11.045200 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-484339f8-e6d1-46bd-91af-c29c9eb841e2 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] [instance: c115a692-885c-492c-a345-4bda25cab425] Going to try to terminate instance {{(pid=98178) delete /opt/stack/nova/nova/compute/api.py:2540}} Feb 17 04:34:11.151932 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-8c694f1e-0ffe-4cbe-af20-2ad9484214bf tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f3e4c3c174942c492405c9b112667de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5b2911946848de81be8f9741faa90f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:34:11.161523 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-8c694f1e-0ffe-4cbe-af20-2ad9484214bf tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] 10.222.0.78 "GET /compute/v2.1/servers/b195626c-7ee1-4679-b956-f7ef7d6328f6" status: 200 len: 1548 microversion: 2.1 time: 0.590156 Feb 17 04:34:11.162225 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 487/885] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:34:10 2021] GET /compute/v2.1/servers/b195626c-7ee1-4679-b956-f7ef7d6328f6 => generated 1548 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:34:11.178637 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-1ca1ca45-7f73-48a3-8efe-f1a57cc17a66 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:34:11.182508 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:34:11.182508 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: warnings.warn(msg) Feb 17 04:34:11.184212 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-1ca1ca45-7f73-48a3-8efe-f1a57cc17a66 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '4f3e4c3c174942c492405c9b112667de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5b2911946848de81be8f9741faa90f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:34:11.185152 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-1ca1ca45-7f73-48a3-8efe-f1a57cc17a66 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Searching by: {'deleted': False, 'project_id': '0d5b2911946848de81be8f9741faa90f'} {{(pid=98179) get_all /opt/stack/nova/nova/compute/api.py:2833}} Feb 17 04:34:11.191464 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-1ca1ca45-7f73-48a3-8efe-f1a57cc17a66 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:11.191877 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-484339f8-e6d1-46bd-91af-c29c9eb841e2 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] 10.222.0.78 "DELETE /compute/v2.1/servers/c115a692-885c-492c-a345-4bda25cab425" status: 204 len: 0 microversion: 2.1 time: 0.229346 Feb 17 04:34:11.192066 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-1ca1ca45-7f73-48a3-8efe-f1a57cc17a66 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:11.192883 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 399/886] 10.222.0.78 () {58 vars in 1229 bytes} [Wed Feb 17 04:34:10 2021] DELETE /compute/v2.1/servers/c115a692-885c-492c-a345-4bda25cab425 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Feb 17 04:34:11.193065 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-1ca1ca45-7f73-48a3-8efe-f1a57cc17a66 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:11.196645 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-1ca1ca45-7f73-48a3-8efe-f1a57cc17a66 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:11.204088 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-ad38d80f-6606-4aa4-a45f-5c1b10df9975 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:34:11.205078 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-ad38d80f-6606-4aa4-a45f-5c1b10df9975 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] [instance: c115a692-885c-492c-a345-4bda25cab425] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:34:11.213880 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-ad38d80f-6606-4aa4-a45f-5c1b10df9975 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:11.216115 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-ad38d80f-6606-4aa4-a45f-5c1b10df9975 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:11.217013 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-ad38d80f-6606-4aa4-a45f-5c1b10df9975 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:11.217654 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-ad38d80f-6606-4aa4-a45f-5c1b10df9975 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:11.297865 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.multi_cell_list [None req-1ca1ca45-7f73-48a3-8efe-f1a57cc17a66 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=98179) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:376}} Feb 17 04:34:11.404448 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-1ca1ca45-7f73-48a3-8efe-f1a57cc17a66 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] 10.222.0.78 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.229632 Feb 17 04:34:11.405211 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 488/887] 10.222.0.78 () {58 vars in 1115 bytes} [Wed Feb 17 04:34:11 2021] GET /compute/v2.1/servers => generated 342 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:34:11.416009 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-1f95eb48-74c5-4c17-be97-5acfe26f16d2 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:34:11.416696 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-1f95eb48-74c5-4c17-be97-5acfe26f16d2 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] [instance: 555b8368-f196-4c6c-acf7-bc67d324c98a] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:34:11.425054 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-1f95eb48-74c5-4c17-be97-5acfe26f16d2 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:11.425660 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-1f95eb48-74c5-4c17-be97-5acfe26f16d2 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:11.426621 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-1f95eb48-74c5-4c17-be97-5acfe26f16d2 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:11.427231 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-1f95eb48-74c5-4c17-be97-5acfe26f16d2 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:11.443848 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-ad38d80f-6606-4aa4-a45f-5c1b10df9975 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b4f65f82a97499dbb900d523924e946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440d4048a9ad43869a00218c7acb9614', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:34:11.453541 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-ad38d80f-6606-4aa4-a45f-5c1b10df9975 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] 10.222.0.78 "GET /compute/v2.1/servers/c115a692-885c-492c-a345-4bda25cab425" status: 200 len: 1513 microversion: 2.1 time: 0.254966 Feb 17 04:34:11.454163 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 400/888] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:34:11 2021] GET /compute/v2.1/servers/c115a692-885c-492c-a345-4bda25cab425 => generated 1513 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:34:11.465204 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-a459563b-9188-4b44-896b-924643470378 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:34:11.465204 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-a459563b-9188-4b44-896b-924643470378 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] [instance: b195626c-7ee1-4679-b956-f7ef7d6328f6] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:34:11.472928 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-a459563b-9188-4b44-896b-924643470378 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:11.473743 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-a459563b-9188-4b44-896b-924643470378 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:11.474607 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-a459563b-9188-4b44-896b-924643470378 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:11.475130 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-a459563b-9188-4b44-896b-924643470378 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:11.696954 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-a459563b-9188-4b44-896b-924643470378 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f3e4c3c174942c492405c9b112667de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5b2911946848de81be8f9741faa90f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:34:11.706399 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-a459563b-9188-4b44-896b-924643470378 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] 10.222.0.78 "GET /compute/v2.1/servers/b195626c-7ee1-4679-b956-f7ef7d6328f6" status: 200 len: 1548 microversion: 2.1 time: 0.251050 Feb 17 04:34:11.707217 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 401/889] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:34:11 2021] GET /compute/v2.1/servers/b195626c-7ee1-4679-b956-f7ef7d6328f6 => generated 1548 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:34:11.721130 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-cd71eca2-99c0-4483-bc9a-311678a55591 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:34:11.722309 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-cd71eca2-99c0-4483-bc9a-311678a55591 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: 29d1ce27-f63b-4523-88be-55f65a6a2529] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:34:11.734556 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-cd71eca2-99c0-4483-bc9a-311678a55591 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:11.735915 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-cd71eca2-99c0-4483-bc9a-311678a55591 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:11.737111 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-cd71eca2-99c0-4483-bc9a-311678a55591 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:11.738494 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-cd71eca2-99c0-4483-bc9a-311678a55591 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:11.931827 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-1f95eb48-74c5-4c17-be97-5acfe26f16d2 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d68d4a6c12e4331b8df8191cdd7a669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2a1ca6347d4278899a1cc009d87d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:34:11.944997 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-1f95eb48-74c5-4c17-be97-5acfe26f16d2 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] 10.222.0.78 "GET /compute/v2.1/servers/555b8368-f196-4c6c-acf7-bc67d324c98a" status: 200 len: 1513 microversion: 2.1 time: 0.532749 Feb 17 04:34:11.945753 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 489/890] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:34:11 2021] GET /compute/v2.1/servers/555b8368-f196-4c6c-acf7-bc67d324c98a => generated 1513 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:34:12.013783 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-cd71eca2-99c0-4483-bc9a-311678a55591 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2deb449189ba427a9b8fcb0e21f22566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2c8716a46f54187902492f8ce162f58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:34:12.024713 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-cd71eca2-99c0-4483-bc9a-311678a55591 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "GET /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529" status: 200 len: 1722 microversion: 2.1 time: 0.310701 Feb 17 04:34:12.025674 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 402/891] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:34:11 2021] GET /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529 => generated 1722 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:34:12.472720 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-e4e6f13f-3ab2-48ec-9308-e01d3445e466 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:34:12.473430 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-e4e6f13f-3ab2-48ec-9308-e01d3445e466 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] [instance: c115a692-885c-492c-a345-4bda25cab425] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:34:12.481534 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-e4e6f13f-3ab2-48ec-9308-e01d3445e466 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:12.482038 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-e4e6f13f-3ab2-48ec-9308-e01d3445e466 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:12.482866 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-e4e6f13f-3ab2-48ec-9308-e01d3445e466 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:12.483402 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-e4e6f13f-3ab2-48ec-9308-e01d3445e466 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:12.709615 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-e4e6f13f-3ab2-48ec-9308-e01d3445e466 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b4f65f82a97499dbb900d523924e946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440d4048a9ad43869a00218c7acb9614', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:34:12.719415 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-e4e6f13f-3ab2-48ec-9308-e01d3445e466 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] 10.222.0.78 "GET /compute/v2.1/servers/c115a692-885c-492c-a345-4bda25cab425" status: 200 len: 1513 microversion: 2.1 time: 0.250624 Feb 17 04:34:12.720016 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 490/892] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:34:12 2021] GET /compute/v2.1/servers/c115a692-885c-492c-a345-4bda25cab425 => generated 1513 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:34:12.964324 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-58097391-7026-4961-82e5-a1cfceb88cb4 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:34:12.965018 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-58097391-7026-4961-82e5-a1cfceb88cb4 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] [instance: 555b8368-f196-4c6c-acf7-bc67d324c98a] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:34:12.974050 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-58097391-7026-4961-82e5-a1cfceb88cb4 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:12.974571 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-58097391-7026-4961-82e5-a1cfceb88cb4 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:12.975491 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-58097391-7026-4961-82e5-a1cfceb88cb4 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:12.975999 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-58097391-7026-4961-82e5-a1cfceb88cb4 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:13.046025 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-d8d69bcc-304c-4c1a-938b-071ff3e7d867 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:34:13.046945 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-d8d69bcc-304c-4c1a-938b-071ff3e7d867 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: 29d1ce27-f63b-4523-88be-55f65a6a2529] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:34:13.056129 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-d8d69bcc-304c-4c1a-938b-071ff3e7d867 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:13.056949 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-d8d69bcc-304c-4c1a-938b-071ff3e7d867 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:13.058685 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-d8d69bcc-304c-4c1a-938b-071ff3e7d867 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:13.059277 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-d8d69bcc-304c-4c1a-938b-071ff3e7d867 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:13.287971 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-d8d69bcc-304c-4c1a-938b-071ff3e7d867 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2deb449189ba427a9b8fcb0e21f22566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2c8716a46f54187902492f8ce162f58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:34:13.300021 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-d8d69bcc-304c-4c1a-938b-071ff3e7d867 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "GET /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529" status: 200 len: 1722 microversion: 2.1 time: 0.259637 Feb 17 04:34:13.300845 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 491/893] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:34:13 2021] GET /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529 => generated 1722 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:34:13.604597 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-58097391-7026-4961-82e5-a1cfceb88cb4 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d68d4a6c12e4331b8df8191cdd7a669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2a1ca6347d4278899a1cc009d87d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:34:13.615000 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-58097391-7026-4961-82e5-a1cfceb88cb4 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] 10.222.0.78 "GET /compute/v2.1/servers/555b8368-f196-4c6c-acf7-bc67d324c98a" status: 200 len: 1513 microversion: 2.1 time: 0.654880 Feb 17 04:34:13.615879 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 403/894] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:34:12 2021] GET /compute/v2.1/servers/555b8368-f196-4c6c-acf7-bc67d324c98a => generated 1513 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:34:13.655967 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-0b52bd72-a16c-4a2a-b3c5-d55830202b52 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ec1eef41-849e-4737-ae92-2ac8b0099fa5"}} {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:34:13.657292 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-0b52bd72-a16c-4a2a-b3c5-d55830202b52 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] [instance: b195626c-7ee1-4679-b956-f7ef7d6328f6] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:34:13.665620 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-0b52bd72-a16c-4a2a-b3c5-d55830202b52 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:13.666128 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-0b52bd72-a16c-4a2a-b3c5-d55830202b52 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:13.667065 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-0b52bd72-a16c-4a2a-b3c5-d55830202b52 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:13.667948 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-0b52bd72-a16c-4a2a-b3c5-d55830202b52 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:13.739479 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-5340b4d9-5382-4ac2-a177-4cfb27b7bb9f tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:34:13.740864 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-5340b4d9-5382-4ac2-a177-4cfb27b7bb9f tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] [instance: c115a692-885c-492c-a345-4bda25cab425] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:34:13.749683 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-5340b4d9-5382-4ac2-a177-4cfb27b7bb9f tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:13.750201 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-5340b4d9-5382-4ac2-a177-4cfb27b7bb9f tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:13.751238 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-5340b4d9-5382-4ac2-a177-4cfb27b7bb9f tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:13.751745 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-5340b4d9-5382-4ac2-a177-4cfb27b7bb9f tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:14.124956 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-0b52bd72-a16c-4a2a-b3c5-d55830202b52 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] 10.222.0.78 "POST /compute/v2.1/servers/b195626c-7ee1-4679-b956-f7ef7d6328f6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.473435 Feb 17 04:34:14.125804 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 492/895] 10.222.0.78 () {60 vars in 1313 bytes} [Wed Feb 17 04:34:13 2021] POST /compute/v2.1/servers/b195626c-7ee1-4679-b956-f7ef7d6328f6/os-volume_attachments => generated 194 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:34:14.320299 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-8fc54f1c-bc79-42cf-9f1d-4d80ab8436b8 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:34:14.321065 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-8fc54f1c-bc79-42cf-9f1d-4d80ab8436b8 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: 29d1ce27-f63b-4523-88be-55f65a6a2529] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:34:14.330706 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-8fc54f1c-bc79-42cf-9f1d-4d80ab8436b8 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:14.331263 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-8fc54f1c-bc79-42cf-9f1d-4d80ab8436b8 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:14.332101 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-8fc54f1c-bc79-42cf-9f1d-4d80ab8436b8 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:14.332583 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-8fc54f1c-bc79-42cf-9f1d-4d80ab8436b8 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:14.563657 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-5340b4d9-5382-4ac2-a177-4cfb27b7bb9f tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b4f65f82a97499dbb900d523924e946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440d4048a9ad43869a00218c7acb9614', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:34:14.573034 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-5340b4d9-5382-4ac2-a177-4cfb27b7bb9f tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] 10.222.0.78 "GET /compute/v2.1/servers/c115a692-885c-492c-a345-4bda25cab425" status: 200 len: 1513 microversion: 2.1 time: 0.838968 Feb 17 04:34:14.574314 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 404/896] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:34:13 2021] GET /compute/v2.1/servers/c115a692-885c-492c-a345-4bda25cab425 => generated 1513 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:34:14.634485 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-5614d399-6ba0-488f-a2b2-36d58eb3251f tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:34:14.635318 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-5614d399-6ba0-488f-a2b2-36d58eb3251f tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] [instance: 555b8368-f196-4c6c-acf7-bc67d324c98a] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:34:14.643469 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-5614d399-6ba0-488f-a2b2-36d58eb3251f tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:14.644114 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-5614d399-6ba0-488f-a2b2-36d58eb3251f tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:14.645190 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-5614d399-6ba0-488f-a2b2-36d58eb3251f tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:14.645788 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-5614d399-6ba0-488f-a2b2-36d58eb3251f tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:14.847058 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-5614d399-6ba0-488f-a2b2-36d58eb3251f tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d68d4a6c12e4331b8df8191cdd7a669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2a1ca6347d4278899a1cc009d87d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:34:14.857516 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-5614d399-6ba0-488f-a2b2-36d58eb3251f tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] 10.222.0.78 "GET /compute/v2.1/servers/555b8368-f196-4c6c-acf7-bc67d324c98a" status: 200 len: 1471 microversion: 2.1 time: 0.227655 Feb 17 04:34:14.858932 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 405/897] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:34:14 2021] GET /compute/v2.1/servers/555b8368-f196-4c6c-acf7-bc67d324c98a => generated 1471 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:34:14.864594 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [req-90c5f955-56f1-44ff-a608-dbe23dd93e43 req-2b1a2cfc-ef7d-4a73-b9e2-4b95a586f84d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "555b8368-f196-4c6c-acf7-bc67d324c98a", "name": "network-vif-deleted", "tag": "65a369ca-8446-46ba-9c26-57d2b73c304a"}]} {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:34:14.866737 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:34:14.866737 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: warnings.warn(msg) Feb 17 04:34:14.876393 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [req-90c5f955-56f1-44ff-a608-dbe23dd93e43 req-2b1a2cfc-ef7d-4a73-b9e2-4b95a586f84d service nova] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:14.876944 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [req-90c5f955-56f1-44ff-a608-dbe23dd93e43 req-2b1a2cfc-ef7d-4a73-b9e2-4b95a586f84d service nova] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:14.895100 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.compute.server_external_events [req-90c5f955-56f1-44ff-a608-dbe23dd93e43 req-2b1a2cfc-ef7d-4a73-b9e2-4b95a586f84d service nova] Creating event network-vif-deleted:65a369ca-8446-46ba-9c26-57d2b73c304a for instance 555b8368-f196-4c6c-acf7-bc67d324c98a on hv-cinder-75998 Feb 17 04:34:14.898089 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-8fc54f1c-bc79-42cf-9f1d-4d80ab8436b8 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2deb449189ba427a9b8fcb0e21f22566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2c8716a46f54187902492f8ce162f58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:34:14.902093 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [req-90c5f955-56f1-44ff-a608-dbe23dd93e43 req-2b1a2cfc-ef7d-4a73-b9e2-4b95a586f84d service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040814 Feb 17 04:34:14.904815 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 406/898] 10.222.0.78 () {64 vars in 1308 bytes} [Wed Feb 17 04:34:14 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:34:14.922287 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-8fc54f1c-bc79-42cf-9f1d-4d80ab8436b8 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "GET /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529" status: 200 len: 1722 microversion: 2.1 time: 0.606535 Feb 17 04:34:14.922897 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 493/899] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:34:14 2021] GET /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529 => generated 1722 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:34:15.593961 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-28a56a49-b6e6-4a94-9af4-6c401d24dc96 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:34:15.595076 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-28a56a49-b6e6-4a94-9af4-6c401d24dc96 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] [instance: c115a692-885c-492c-a345-4bda25cab425] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:34:15.603087 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-28a56a49-b6e6-4a94-9af4-6c401d24dc96 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:15.603845 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-28a56a49-b6e6-4a94-9af4-6c401d24dc96 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:15.604743 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-28a56a49-b6e6-4a94-9af4-6c401d24dc96 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:15.605574 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-28a56a49-b6e6-4a94-9af4-6c401d24dc96 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:15.833946 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-28a56a49-b6e6-4a94-9af4-6c401d24dc96 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b4f65f82a97499dbb900d523924e946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440d4048a9ad43869a00218c7acb9614', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:34:15.843892 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-28a56a49-b6e6-4a94-9af4-6c401d24dc96 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] 10.222.0.78 "GET /compute/v2.1/servers/c115a692-885c-492c-a345-4bda25cab425" status: 200 len: 1471 microversion: 2.1 time: 0.254892 Feb 17 04:34:15.844619 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 407/900] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:34:15 2021] GET /compute/v2.1/servers/c115a692-885c-492c-a345-4bda25cab425 => generated 1471 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:34:15.877123 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-bdf366b2-e6e9-4e3f-acb1-8fe8be951ff9 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:34:15.878406 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-bdf366b2-e6e9-4e3f-acb1-8fe8be951ff9 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] [instance: 555b8368-f196-4c6c-acf7-bc67d324c98a] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:34:15.887215 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-bdf366b2-e6e9-4e3f-acb1-8fe8be951ff9 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:15.888119 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-bdf366b2-e6e9-4e3f-acb1-8fe8be951ff9 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:15.889184 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-bdf366b2-e6e9-4e3f-acb1-8fe8be951ff9 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:15.889861 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-bdf366b2-e6e9-4e3f-acb1-8fe8be951ff9 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:15.940448 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-510f0a21-4e47-4b7d-a44a-32c26848b3a9 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:34:15.941133 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-510f0a21-4e47-4b7d-a44a-32c26848b3a9 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: 29d1ce27-f63b-4523-88be-55f65a6a2529] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:34:15.952151 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.wsgi [None req-bdf366b2-e6e9-4e3f-acb1-8fe8be951ff9 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] HTTP exception thrown: Instance 555b8368-f196-4c6c-acf7-bc67d324c98a could not be found. Feb 17 04:34:15.952370 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-510f0a21-4e47-4b7d-a44a-32c26848b3a9 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:15.952846 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-bdf366b2-e6e9-4e3f-acb1-8fe8be951ff9 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Returning 404 to user: Instance 555b8368-f196-4c6c-acf7-bc67d324c98a could not be found. {{(pid=98179) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 17 04:34:15.953308 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-510f0a21-4e47-4b7d-a44a-32c26848b3a9 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:15.953855 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-bdf366b2-e6e9-4e3f-acb1-8fe8be951ff9 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] 10.222.0.78 "GET /compute/v2.1/servers/555b8368-f196-4c6c-acf7-bc67d324c98a" status: 404 len: 111 microversion: 2.1 time: 0.081028 Feb 17 04:34:15.954199 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-510f0a21-4e47-4b7d-a44a-32c26848b3a9 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:15.954517 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 494/901] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:34:15 2021] GET /compute/v2.1/servers/555b8368-f196-4c6c-acf7-bc67d324c98a => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 17 04:34:15.955068 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-510f0a21-4e47-4b7d-a44a-32c26848b3a9 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:16.213321 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-510f0a21-4e47-4b7d-a44a-32c26848b3a9 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2deb449189ba427a9b8fcb0e21f22566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2c8716a46f54187902492f8ce162f58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:34:16.236326 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-510f0a21-4e47-4b7d-a44a-32c26848b3a9 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "GET /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529" status: 200 len: 1722 microversion: 2.1 time: 0.299698 Feb 17 04:34:16.238650 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 408/902] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:34:15 2021] GET /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529 => generated 1722 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:34:16.863428 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-aebd4415-a360-4608-b279-ef1c1907b2a5 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:34:16.864457 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-aebd4415-a360-4608-b279-ef1c1907b2a5 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] [instance: c115a692-885c-492c-a345-4bda25cab425] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:34:16.873871 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-aebd4415-a360-4608-b279-ef1c1907b2a5 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:16.874389 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-aebd4415-a360-4608-b279-ef1c1907b2a5 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:16.875310 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-aebd4415-a360-4608-b279-ef1c1907b2a5 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:16.875808 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-aebd4415-a360-4608-b279-ef1c1907b2a5 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:16.920209 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [req-29fb0531-47c2-4278-8d47-dd7ebc6f7332 req-0156e56d-38ae-43c9-bb23-d8c3c90e8b3c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c115a692-885c-492c-a345-4bda25cab425", "name": "network-vif-deleted", "tag": "3b5d6b78-08fe-4167-befa-eaa4e9d6c970"}]} {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:34:16.923260 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:34:16.923260 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: warnings.warn(msg) Feb 17 04:34:16.932206 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.wsgi [None req-aebd4415-a360-4608-b279-ef1c1907b2a5 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] HTTP exception thrown: Instance c115a692-885c-492c-a345-4bda25cab425 could not be found. Feb 17 04:34:16.932867 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-aebd4415-a360-4608-b279-ef1c1907b2a5 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] Returning 404 to user: Instance c115a692-885c-492c-a345-4bda25cab425 could not be found. {{(pid=98179) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 17 04:34:16.935044 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-aebd4415-a360-4608-b279-ef1c1907b2a5 tempest-VolumesSnapshotTestJSON-1968858157 tempest-VolumesSnapshotTestJSON-1968858157-project] 10.222.0.78 "GET /compute/v2.1/servers/c115a692-885c-492c-a345-4bda25cab425" status: 404 len: 111 microversion: 2.1 time: 0.076363 Feb 17 04:34:16.937250 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [req-29fb0531-47c2-4278-8d47-dd7ebc6f7332 req-0156e56d-38ae-43c9-bb23-d8c3c90e8b3c service nova] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:16.937983 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [req-29fb0531-47c2-4278-8d47-dd7ebc6f7332 req-0156e56d-38ae-43c9-bb23-d8c3c90e8b3c service nova] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:16.941426 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 495/903] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:34:16 2021] GET /compute/v2.1/servers/c115a692-885c-492c-a345-4bda25cab425 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 17 04:34:16.959055 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.compute.server_external_events [req-29fb0531-47c2-4278-8d47-dd7ebc6f7332 req-0156e56d-38ae-43c9-bb23-d8c3c90e8b3c service nova] Creating event network-vif-deleted:3b5d6b78-08fe-4167-befa-eaa4e9d6c970 for instance c115a692-885c-492c-a345-4bda25cab425 on hv-cinder-75998 Feb 17 04:34:16.964105 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [req-29fb0531-47c2-4278-8d47-dd7ebc6f7332 req-0156e56d-38ae-43c9-bb23-d8c3c90e8b3c service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049087 Feb 17 04:34:16.964833 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 409/904] 10.222.0.78 () {64 vars in 1308 bytes} [Wed Feb 17 04:34:16 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:34:17.256125 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-2eb42f89-af18-4367-b683-4741aea1a41e tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:34:17.257333 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-2eb42f89-af18-4367-b683-4741aea1a41e tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: 29d1ce27-f63b-4523-88be-55f65a6a2529] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:34:17.259378 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-ace012bb-1420-482f-ba58-19a2cbfcca14 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:34:17.259970 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-ace012bb-1420-482f-ba58-19a2cbfcca14 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] [instance: 21edfff0-5c5c-43a5-a4e5-22ddd5f452eb] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:34:17.271227 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-2eb42f89-af18-4367-b683-4741aea1a41e tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:17.271819 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-2eb42f89-af18-4367-b683-4741aea1a41e tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:17.272734 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-2eb42f89-af18-4367-b683-4741aea1a41e tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:17.273699 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-2eb42f89-af18-4367-b683-4741aea1a41e tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:17.296992 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-ace012bb-1420-482f-ba58-19a2cbfcca14 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:17.297508 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-ace012bb-1420-482f-ba58-19a2cbfcca14 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:17.298394 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-ace012bb-1420-482f-ba58-19a2cbfcca14 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:17.298889 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-ace012bb-1420-482f-ba58-19a2cbfcca14 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:17.480433 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-ace012bb-1420-482f-ba58-19a2cbfcca14 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] [instance: 21edfff0-5c5c-43a5-a4e5-22ddd5f452eb] Going to try to terminate instance {{(pid=98179) delete /opt/stack/nova/nova/compute/api.py:2540}} Feb 17 04:34:17.637235 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-ace012bb-1420-482f-ba58-19a2cbfcca14 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] 10.222.0.78 "DELETE /compute/v2.1/servers/21edfff0-5c5c-43a5-a4e5-22ddd5f452eb" status: 204 len: 0 microversion: 2.1 time: 0.388474 Feb 17 04:34:17.638063 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 496/905] 10.222.0.78 () {58 vars in 1229 bytes} [Wed Feb 17 04:34:17 2021] DELETE /compute/v2.1/servers/21edfff0-5c5c-43a5-a4e5-22ddd5f452eb => generated 0 bytes in 391 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 17 04:34:17.647673 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-7508b325-618a-4ecf-86eb-cb41acb1034c tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:34:17.648486 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-7508b325-618a-4ecf-86eb-cb41acb1034c tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] [instance: 21edfff0-5c5c-43a5-a4e5-22ddd5f452eb] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:34:17.657743 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-7508b325-618a-4ecf-86eb-cb41acb1034c tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:17.658255 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-7508b325-618a-4ecf-86eb-cb41acb1034c tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:17.659114 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-7508b325-618a-4ecf-86eb-cb41acb1034c tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:17.659609 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-7508b325-618a-4ecf-86eb-cb41acb1034c tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:17.742562 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-2eb42f89-af18-4367-b683-4741aea1a41e tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2deb449189ba427a9b8fcb0e21f22566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2c8716a46f54187902492f8ce162f58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:34:17.754112 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-2eb42f89-af18-4367-b683-4741aea1a41e tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "GET /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529" status: 200 len: 1722 microversion: 2.1 time: 0.502246 Feb 17 04:34:17.754844 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 410/906] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:34:17 2021] GET /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529 => generated 1722 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:34:17.882044 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-7508b325-618a-4ecf-86eb-cb41acb1034c tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d68d4a6c12e4331b8df8191cdd7a669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2a1ca6347d4278899a1cc009d87d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:34:17.892169 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-7508b325-618a-4ecf-86eb-cb41acb1034c tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] 10.222.0.78 "GET /compute/v2.1/servers/21edfff0-5c5c-43a5-a4e5-22ddd5f452eb" status: 200 len: 1514 microversion: 2.1 time: 0.249596 Feb 17 04:34:17.892779 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 497/907] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:34:17 2021] GET /compute/v2.1/servers/21edfff0-5c5c-43a5-a4e5-22ddd5f452eb => generated 1514 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:34:18.774121 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-63913f8c-a816-4e46-a483-55852f292f72 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:34:18.775384 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-63913f8c-a816-4e46-a483-55852f292f72 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: 29d1ce27-f63b-4523-88be-55f65a6a2529] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:34:18.784244 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-63913f8c-a816-4e46-a483-55852f292f72 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:18.785014 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-63913f8c-a816-4e46-a483-55852f292f72 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:18.786035 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-63913f8c-a816-4e46-a483-55852f292f72 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:18.786694 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-63913f8c-a816-4e46-a483-55852f292f72 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:18.912011 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-0f0301ac-c7a5-4872-89c2-cf1eac930558 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:34:18.912704 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-0f0301ac-c7a5-4872-89c2-cf1eac930558 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] [instance: 21edfff0-5c5c-43a5-a4e5-22ddd5f452eb] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:34:18.921194 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-0f0301ac-c7a5-4872-89c2-cf1eac930558 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:18.921709 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-0f0301ac-c7a5-4872-89c2-cf1eac930558 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:18.922581 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-0f0301ac-c7a5-4872-89c2-cf1eac930558 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:18.923106 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-0f0301ac-c7a5-4872-89c2-cf1eac930558 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:19.195710 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-0f0301ac-c7a5-4872-89c2-cf1eac930558 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d68d4a6c12e4331b8df8191cdd7a669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2a1ca6347d4278899a1cc009d87d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:34:19.205884 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-0f0301ac-c7a5-4872-89c2-cf1eac930558 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] 10.222.0.78 "GET /compute/v2.1/servers/21edfff0-5c5c-43a5-a4e5-22ddd5f452eb" status: 200 len: 1514 microversion: 2.1 time: 0.297863 Feb 17 04:34:19.206485 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 498/908] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:34:18 2021] GET /compute/v2.1/servers/21edfff0-5c5c-43a5-a4e5-22ddd5f452eb => generated 1514 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:34:19.547526 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-63913f8c-a816-4e46-a483-55852f292f72 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2deb449189ba427a9b8fcb0e21f22566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2c8716a46f54187902492f8ce162f58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:34:19.557159 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-63913f8c-a816-4e46-a483-55852f292f72 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "GET /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529" status: 200 len: 1722 microversion: 2.1 time: 0.787036 Feb 17 04:34:19.567322 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 411/909] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:34:18 2021] GET /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529 => generated 1722 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:34:20.224370 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-a5e4272e-1ca0-44b2-8a6a-337d8c542a7a tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:34:20.225830 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-a5e4272e-1ca0-44b2-8a6a-337d8c542a7a tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] [instance: 21edfff0-5c5c-43a5-a4e5-22ddd5f452eb] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:34:20.234370 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-a5e4272e-1ca0-44b2-8a6a-337d8c542a7a tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:20.234795 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-a5e4272e-1ca0-44b2-8a6a-337d8c542a7a tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:20.236413 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-a5e4272e-1ca0-44b2-8a6a-337d8c542a7a tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:20.236912 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-a5e4272e-1ca0-44b2-8a6a-337d8c542a7a tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:20.468949 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-a5e4272e-1ca0-44b2-8a6a-337d8c542a7a tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d68d4a6c12e4331b8df8191cdd7a669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2a1ca6347d4278899a1cc009d87d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:34:20.477872 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-a5e4272e-1ca0-44b2-8a6a-337d8c542a7a tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] 10.222.0.78 "GET /compute/v2.1/servers/21edfff0-5c5c-43a5-a4e5-22ddd5f452eb" status: 200 len: 1514 microversion: 2.1 time: 0.257648 Feb 17 04:34:20.478477 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 499/910] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:34:20 2021] GET /compute/v2.1/servers/21edfff0-5c5c-43a5-a4e5-22ddd5f452eb => generated 1514 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:34:20.577211 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-e73a337c-2eea-4ce1-8907-9bc6a692e985 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:34:20.577986 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-e73a337c-2eea-4ce1-8907-9bc6a692e985 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: 29d1ce27-f63b-4523-88be-55f65a6a2529] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:34:20.586075 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-e73a337c-2eea-4ce1-8907-9bc6a692e985 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:20.586697 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-e73a337c-2eea-4ce1-8907-9bc6a692e985 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:20.587655 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-e73a337c-2eea-4ce1-8907-9bc6a692e985 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:20.588250 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-e73a337c-2eea-4ce1-8907-9bc6a692e985 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:21.283803 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-e73a337c-2eea-4ce1-8907-9bc6a692e985 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2deb449189ba427a9b8fcb0e21f22566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2c8716a46f54187902492f8ce162f58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:34:21.294328 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-e73a337c-2eea-4ce1-8907-9bc6a692e985 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "GET /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529" status: 200 len: 1699 microversion: 2.1 time: 0.721819 Feb 17 04:34:21.299099 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 412/911] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:34:20 2021] GET /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529 => generated 1699 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:34:21.313068 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-0b6fbda4-2747-4e2a-8bbe-62720017195b tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:34:21.321146 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-0b6fbda4-2747-4e2a-8bbe-62720017195b tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:21.321661 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-0b6fbda4-2747-4e2a-8bbe-62720017195b tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:21.388675 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-0b6fbda4-2747-4e2a-8bbe-62720017195b tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: 29d1ce27-f63b-4523-88be-55f65a6a2529] Going to try to start instance {{(pid=98179) start /opt/stack/nova/nova/compute/api.py:2603}} Feb 17 04:34:21.472008 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-0b6fbda4-2747-4e2a-8bbe-62720017195b tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "POST /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529/action" status: 202 len: 0 microversion: 2.1 time: 0.162802 Feb 17 04:34:21.472831 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 500/912] 10.222.0.78 () {60 vars in 1268 bytes} [Wed Feb 17 04:34:21 2021] POST /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529/action => generated 0 bytes in 165 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:34:21.482074 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-7dad3881-f2db-474d-bcdb-b95d7cd17ea0 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:34:21.482794 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-7dad3881-f2db-474d-bcdb-b95d7cd17ea0 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: 29d1ce27-f63b-4523-88be-55f65a6a2529] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:34:21.492252 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-7dad3881-f2db-474d-bcdb-b95d7cd17ea0 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:21.492765 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-7dad3881-f2db-474d-bcdb-b95d7cd17ea0 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:21.493598 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-7dad3881-f2db-474d-bcdb-b95d7cd17ea0 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:21.494103 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-7dad3881-f2db-474d-bcdb-b95d7cd17ea0 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:21.498178 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-69f8a8d7-02bd-4b91-9953-85b5ce09fe8e tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:34:21.499291 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-69f8a8d7-02bd-4b91-9953-85b5ce09fe8e tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] [instance: 21edfff0-5c5c-43a5-a4e5-22ddd5f452eb] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:34:21.509130 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-69f8a8d7-02bd-4b91-9953-85b5ce09fe8e tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:21.510230 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-69f8a8d7-02bd-4b91-9953-85b5ce09fe8e tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:21.511946 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-69f8a8d7-02bd-4b91-9953-85b5ce09fe8e tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:21.512724 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-69f8a8d7-02bd-4b91-9953-85b5ce09fe8e tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:21.752308 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-69f8a8d7-02bd-4b91-9953-85b5ce09fe8e tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d68d4a6c12e4331b8df8191cdd7a669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2a1ca6347d4278899a1cc009d87d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:34:21.762285 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-69f8a8d7-02bd-4b91-9953-85b5ce09fe8e tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] 10.222.0.78 "GET /compute/v2.1/servers/21edfff0-5c5c-43a5-a4e5-22ddd5f452eb" status: 200 len: 1514 microversion: 2.1 time: 0.268852 Feb 17 04:34:21.762888 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 501/913] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:34:21 2021] GET /compute/v2.1/servers/21edfff0-5c5c-43a5-a4e5-22ddd5f452eb => generated 1514 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:34:21.919926 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-7dad3881-f2db-474d-bcdb-b95d7cd17ea0 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2deb449189ba427a9b8fcb0e21f22566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2c8716a46f54187902492f8ce162f58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:34:21.941343 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-7dad3881-f2db-474d-bcdb-b95d7cd17ea0 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "GET /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529" status: 200 len: 1708 microversion: 2.1 time: 0.463630 Feb 17 04:34:21.941589 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 413/914] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:34:21 2021] GET /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529 => generated 1708 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:34:22.781079 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-ec3b0ab8-98e9-4fc8-ad08-def7ca0c4076 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:34:22.781758 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-ec3b0ab8-98e9-4fc8-ad08-def7ca0c4076 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] [instance: 21edfff0-5c5c-43a5-a4e5-22ddd5f452eb] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:34:22.790186 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-ec3b0ab8-98e9-4fc8-ad08-def7ca0c4076 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:22.790692 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-ec3b0ab8-98e9-4fc8-ad08-def7ca0c4076 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:22.791607 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-ec3b0ab8-98e9-4fc8-ad08-def7ca0c4076 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:22.792100 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-ec3b0ab8-98e9-4fc8-ad08-def7ca0c4076 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:22.961091 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-b8460864-767a-48f1-a068-59c83f77efc5 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:34:22.962004 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-b8460864-767a-48f1-a068-59c83f77efc5 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: 29d1ce27-f63b-4523-88be-55f65a6a2529] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:34:22.971943 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-b8460864-767a-48f1-a068-59c83f77efc5 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:22.972663 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-b8460864-767a-48f1-a068-59c83f77efc5 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:22.973795 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-b8460864-767a-48f1-a068-59c83f77efc5 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:22.974590 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-b8460864-767a-48f1-a068-59c83f77efc5 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:23.251792 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-b8460864-767a-48f1-a068-59c83f77efc5 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2deb449189ba427a9b8fcb0e21f22566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2c8716a46f54187902492f8ce162f58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:34:23.261874 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-b8460864-767a-48f1-a068-59c83f77efc5 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "GET /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529" status: 200 len: 1708 microversion: 2.1 time: 0.305188 Feb 17 04:34:23.265243 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 414/915] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:34:22 2021] GET /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529 => generated 1708 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:34:23.342444 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-ec3b0ab8-98e9-4fc8-ad08-def7ca0c4076 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d68d4a6c12e4331b8df8191cdd7a669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2a1ca6347d4278899a1cc009d87d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:34:23.351647 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-ec3b0ab8-98e9-4fc8-ad08-def7ca0c4076 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] 10.222.0.78 "GET /compute/v2.1/servers/21edfff0-5c5c-43a5-a4e5-22ddd5f452eb" status: 200 len: 1514 microversion: 2.1 time: 0.575922 Feb 17 04:34:23.352954 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 502/916] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:34:22 2021] GET /compute/v2.1/servers/21edfff0-5c5c-43a5-a4e5-22ddd5f452eb => generated 1514 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:34:24.283803 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-0b371f2f-a9b7-4f92-a6b9-292dfb35dfa5 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:34:24.285419 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-0b371f2f-a9b7-4f92-a6b9-292dfb35dfa5 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: 29d1ce27-f63b-4523-88be-55f65a6a2529] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:34:24.304419 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-0b371f2f-a9b7-4f92-a6b9-292dfb35dfa5 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:24.304925 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-0b371f2f-a9b7-4f92-a6b9-292dfb35dfa5 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:24.310224 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-0b371f2f-a9b7-4f92-a6b9-292dfb35dfa5 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:24.311075 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-0b371f2f-a9b7-4f92-a6b9-292dfb35dfa5 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:24.369965 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-303a06b5-be44-4cd8-879d-c6915ba0f55f tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:34:24.370928 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-303a06b5-be44-4cd8-879d-c6915ba0f55f tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] [instance: 21edfff0-5c5c-43a5-a4e5-22ddd5f452eb] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:34:24.392320 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-303a06b5-be44-4cd8-879d-c6915ba0f55f tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:24.392835 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-303a06b5-be44-4cd8-879d-c6915ba0f55f tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:24.393709 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-303a06b5-be44-4cd8-879d-c6915ba0f55f tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:24.394207 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-303a06b5-be44-4cd8-879d-c6915ba0f55f tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:24.880769 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-303a06b5-be44-4cd8-879d-c6915ba0f55f tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d68d4a6c12e4331b8df8191cdd7a669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2a1ca6347d4278899a1cc009d87d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:34:24.899456 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-303a06b5-be44-4cd8-879d-c6915ba0f55f tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] 10.222.0.78 "GET /compute/v2.1/servers/21edfff0-5c5c-43a5-a4e5-22ddd5f452eb" status: 200 len: 1514 microversion: 2.1 time: 0.533235 Feb 17 04:34:24.902739 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 503/917] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:34:24 2021] GET /compute/v2.1/servers/21edfff0-5c5c-43a5-a4e5-22ddd5f452eb => generated 1514 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:34:25.604007 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-0b371f2f-a9b7-4f92-a6b9-292dfb35dfa5 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2deb449189ba427a9b8fcb0e21f22566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2c8716a46f54187902492f8ce162f58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:34:25.621380 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-0b371f2f-a9b7-4f92-a6b9-292dfb35dfa5 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "GET /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529" status: 200 len: 1708 microversion: 2.1 time: 1.337977 Feb 17 04:34:25.622166 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 415/918] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:34:24 2021] GET /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529 => generated 1708 bytes in 1346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:34:25.877845 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [req-a02aaab7-d06e-4c96-b0bd-868dcada282e req-a7f344ed-8819-4f8f-9633-1b138f2bb4f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21edfff0-5c5c-43a5-a4e5-22ddd5f452eb", "name": "network-vif-deleted", "tag": "e825e7f4-3daa-4bfe-9c61-a440fc5474f1"}]} {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:34:25.880713 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:34:25.880713 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: warnings.warn(msg) Feb 17 04:34:25.882235 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-986f21a9-8b23-4319-aa2d-0f7b84471b6e tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:34:25.882904 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-986f21a9-8b23-4319-aa2d-0f7b84471b6e tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] [instance: b195626c-7ee1-4679-b956-f7ef7d6328f6] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:34:25.894695 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-986f21a9-8b23-4319-aa2d-0f7b84471b6e tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:25.895511 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-986f21a9-8b23-4319-aa2d-0f7b84471b6e tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:25.896620 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-986f21a9-8b23-4319-aa2d-0f7b84471b6e tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:25.897283 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-986f21a9-8b23-4319-aa2d-0f7b84471b6e tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:25.906568 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [req-a02aaab7-d06e-4c96-b0bd-868dcada282e req-a7f344ed-8819-4f8f-9633-1b138f2bb4f1 service nova] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:25.914608 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [req-a02aaab7-d06e-4c96-b0bd-868dcada282e req-a7f344ed-8819-4f8f-9633-1b138f2bb4f1 service nova] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:25.963825 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.compute.server_external_events [req-a02aaab7-d06e-4c96-b0bd-868dcada282e req-a7f344ed-8819-4f8f-9633-1b138f2bb4f1 service nova] Creating event network-vif-deleted:e825e7f4-3daa-4bfe-9c61-a440fc5474f1 for instance 21edfff0-5c5c-43a5-a4e5-22ddd5f452eb on hv-cinder-75998 Feb 17 04:34:25.970073 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [req-a02aaab7-d06e-4c96-b0bd-868dcada282e req-a7f344ed-8819-4f8f-9633-1b138f2bb4f1 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097242 Feb 17 04:34:25.970956 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 504/919] 10.222.0.78 () {64 vars in 1308 bytes} [Wed Feb 17 04:34:25 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:34:25.980562 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-58b90608-dd19-4362-bac8-8cebb4e4fd22 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:34:25.982888 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-58b90608-dd19-4362-bac8-8cebb4e4fd22 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] [instance: 21edfff0-5c5c-43a5-a4e5-22ddd5f452eb] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:34:25.991982 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-58b90608-dd19-4362-bac8-8cebb4e4fd22 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:25.992812 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-58b90608-dd19-4362-bac8-8cebb4e4fd22 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:25.994152 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-58b90608-dd19-4362-bac8-8cebb4e4fd22 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:25.994842 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-58b90608-dd19-4362-bac8-8cebb4e4fd22 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:26.193046 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-58b90608-dd19-4362-bac8-8cebb4e4fd22 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d68d4a6c12e4331b8df8191cdd7a669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2a1ca6347d4278899a1cc009d87d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:34:26.208127 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-58b90608-dd19-4362-bac8-8cebb4e4fd22 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] 10.222.0.78 "GET /compute/v2.1/servers/21edfff0-5c5c-43a5-a4e5-22ddd5f452eb" status: 200 len: 1303 microversion: 2.1 time: 0.234575 Feb 17 04:34:26.212048 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 505/920] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:34:25 2021] GET /compute/v2.1/servers/21edfff0-5c5c-43a5-a4e5-22ddd5f452eb => generated 1303 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:34:26.426425 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-91f970a6-0f9f-4d63-879f-bf8687305627 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Action: 'create', calling method: .version_select at 0x7f57c93d3950>, body: {"keypair": {"name": "tempest-keypair-2038219863"}} {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:34:26.471737 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.quota [None req-91f970a6-0f9f-4d63-879f-bf8687305627 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Getting quotas for project 0bdc99fc094d4c3fb38cad060f2dc825. Resources: {'key_pairs'} {{(pid=98179) _get_quotas /opt/stack/nova/nova/quota.py:388}} Feb 17 04:34:26.488334 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.quota [None req-91f970a6-0f9f-4d63-879f-bf8687305627 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Getting quotas for user c1ae36a432a24019803fac4d68061a24 and project 0bdc99fc094d4c3fb38cad060f2dc825. Resources: {'key_pairs'} {{(pid=98179) _get_quotas /opt/stack/nova/nova/quota.py:380}} Feb 17 04:34:26.801955 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-986f21a9-8b23-4319-aa2d-0f7b84471b6e tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f3e4c3c174942c492405c9b112667de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5b2911946848de81be8f9741faa90f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:34:26.817013 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-986f21a9-8b23-4319-aa2d-0f7b84471b6e tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] 10.222.0.78 "GET /compute/v2.1/servers/b195626c-7ee1-4679-b956-f7ef7d6328f6" status: 200 len: 1594 microversion: 2.1 time: 0.938622 Feb 17 04:34:26.818187 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 416/921] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:34:25 2021] GET /compute/v2.1/servers/b195626c-7ee1-4679-b956-f7ef7d6328f6 => generated 1594 bytes in 944 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:34:26.824789 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-d014f480-c70d-4cd1-b50f-d9f1a46c3dd2 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:34:26.825657 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-d014f480-c70d-4cd1-b50f-d9f1a46c3dd2 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: 29d1ce27-f63b-4523-88be-55f65a6a2529] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:34:26.836717 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-d014f480-c70d-4cd1-b50f-d9f1a46c3dd2 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:26.837495 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-d014f480-c70d-4cd1-b50f-d9f1a46c3dd2 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:26.839508 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-d014f480-c70d-4cd1-b50f-d9f1a46c3dd2 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:26.840181 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-d014f480-c70d-4cd1-b50f-d9f1a46c3dd2 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:26.907892 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.quota [None req-91f970a6-0f9f-4d63-879f-bf8687305627 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Getting quotas for project 0bdc99fc094d4c3fb38cad060f2dc825. Resources: {'key_pairs'} {{(pid=98179) _get_quotas /opt/stack/nova/nova/quota.py:388}} Feb 17 04:34:26.914451 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.quota [None req-91f970a6-0f9f-4d63-879f-bf8687305627 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Getting quotas for user c1ae36a432a24019803fac4d68061a24 and project 0bdc99fc094d4c3fb38cad060f2dc825. Resources: {'key_pairs'} {{(pid=98179) _get_quotas /opt/stack/nova/nova/quota.py:380}} Feb 17 04:34:26.934196 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-91f970a6-0f9f-4d63-879f-bf8687305627 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 201 len: 2316 microversion: 2.20 time: 0.662806 Feb 17 04:34:26.936023 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 506/922] 10.222.0.78 () {62 vars in 1189 bytes} [Wed Feb 17 04:34:26 2021] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 665 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Feb 17 04:34:26.943218 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-c0bfd326-0bf5-4b91-a3a3-35edca9811ad tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Action: 'create', calling method: .version_select at 0x7f57c88f1598>, body: {"pool": null} {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:34:27.108055 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-d014f480-c70d-4cd1-b50f-d9f1a46c3dd2 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2deb449189ba427a9b8fcb0e21f22566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2c8716a46f54187902492f8ce162f58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:34:27.118972 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-d014f480-c70d-4cd1-b50f-d9f1a46c3dd2 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "GET /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529" status: 200 len: 1708 microversion: 2.1 time: 0.299410 Feb 17 04:34:27.143280 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 417/923] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:34:26 2021] GET /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529 => generated 1708 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:34:27.230511 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-6b4e5b77-e27f-4afc-8dab-d2347283e596 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:34:27.231187 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-6b4e5b77-e27f-4afc-8dab-d2347283e596 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] [instance: 21edfff0-5c5c-43a5-a4e5-22ddd5f452eb] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:34:27.240343 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-6b4e5b77-e27f-4afc-8dab-d2347283e596 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:27.240857 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-6b4e5b77-e27f-4afc-8dab-d2347283e596 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:27.241717 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-6b4e5b77-e27f-4afc-8dab-d2347283e596 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:27.242190 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-6b4e5b77-e27f-4afc-8dab-d2347283e596 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:27.298753 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.wsgi [None req-6b4e5b77-e27f-4afc-8dab-d2347283e596 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] HTTP exception thrown: Instance 21edfff0-5c5c-43a5-a4e5-22ddd5f452eb could not be found. Feb 17 04:34:27.299513 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-6b4e5b77-e27f-4afc-8dab-d2347283e596 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] Returning 404 to user: Instance 21edfff0-5c5c-43a5-a4e5-22ddd5f452eb could not be found. {{(pid=98178) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 17 04:34:27.300369 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-6b4e5b77-e27f-4afc-8dab-d2347283e596 tempest-AttachVolumeNegativeTest-1414785991 tempest-AttachVolumeNegativeTest-1414785991-project] 10.222.0.78 "GET /compute/v2.1/servers/21edfff0-5c5c-43a5-a4e5-22ddd5f452eb" status: 404 len: 111 microversion: 2.1 time: 0.074500 Feb 17 04:34:27.300990 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 418/924] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:34:27 2021] GET /compute/v2.1/servers/21edfff0-5c5c-43a5-a4e5-22ddd5f452eb => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 17 04:34:28.151285 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-6d3c75b0-58cb-4d27-bba4-0d6fc23385f1 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:34:28.166068 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-6d3c75b0-58cb-4d27-bba4-0d6fc23385f1 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: 29d1ce27-f63b-4523-88be-55f65a6a2529] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:34:28.196911 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-6d3c75b0-58cb-4d27-bba4-0d6fc23385f1 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:28.207825 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-6d3c75b0-58cb-4d27-bba4-0d6fc23385f1 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:28.213494 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-6d3c75b0-58cb-4d27-bba4-0d6fc23385f1 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:28.215066 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-6d3c75b0-58cb-4d27-bba4-0d6fc23385f1 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:29.047852 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-6d3c75b0-58cb-4d27-bba4-0d6fc23385f1 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2deb449189ba427a9b8fcb0e21f22566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2c8716a46f54187902492f8ce162f58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:34:29.058588 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-6d3c75b0-58cb-4d27-bba4-0d6fc23385f1 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "GET /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529" status: 200 len: 1708 microversion: 2.1 time: 0.924563 Feb 17 04:34:29.059816 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 419/925] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:34:28 2021] GET /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529 => generated 1708 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:34:30.077958 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-6a818d09-1f36-45f7-b4fb-11a0ee613b21 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:34:30.079717 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-6a818d09-1f36-45f7-b4fb-11a0ee613b21 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: 29d1ce27-f63b-4523-88be-55f65a6a2529] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:34:30.092319 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-6a818d09-1f36-45f7-b4fb-11a0ee613b21 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:30.093177 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-6a818d09-1f36-45f7-b4fb-11a0ee613b21 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:30.094236 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-6a818d09-1f36-45f7-b4fb-11a0ee613b21 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:30.094941 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-6a818d09-1f36-45f7-b4fb-11a0ee613b21 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:30.536572 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-6a818d09-1f36-45f7-b4fb-11a0ee613b21 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2deb449189ba427a9b8fcb0e21f22566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2c8716a46f54187902492f8ce162f58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:34:30.548315 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-6a818d09-1f36-45f7-b4fb-11a0ee613b21 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "GET /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529" status: 200 len: 1712 microversion: 2.1 time: 0.474194 Feb 17 04:34:30.549199 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 420/926] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:34:30 2021] GET /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529 => generated 1712 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:34:30.621913 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-c0bfd326-0bf5-4b91-a3a3-35edca9811ad tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] 10.222.0.78 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 3.684448 Feb 17 04:34:30.622554 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 507/927] 10.222.0.78 () {60 vars in 1160 bytes} [Wed Feb 17 04:34:26 2021] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 3686 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:34:30.634354 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-17b07c96-98d1-4d5a-b29b-b82dfc743336 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Action: 'action', calling method: .version_select at 0x7f57ca00bae8>, body: {"addFloatingIp": {"address": "172.27.1.36"}} {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:34:30.635589 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-17b07c96-98d1-4d5a-b29b-b82dfc743336 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] [instance: b195626c-7ee1-4679-b956-f7ef7d6328f6] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:34:30.644142 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-17b07c96-98d1-4d5a-b29b-b82dfc743336 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:30.644625 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-17b07c96-98d1-4d5a-b29b-b82dfc743336 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:30.645669 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-17b07c96-98d1-4d5a-b29b-b82dfc743336 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:30.646160 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-17b07c96-98d1-4d5a-b29b-b82dfc743336 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:30.712695 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-17b07c96-98d1-4d5a-b29b-b82dfc743336 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Acquired lock "refresh_cache-b195626c-7ee1-4679-b956-f7ef7d6328f6" {{(pid=98178) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:266}} Feb 17 04:34:31.849471 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-e1cc2558-b33c-4549-8f2e-ed6061bbf07b tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-107477331", "imageRef": "b005ed36-a85a-4c46-ba22-9fa8c5ec62e5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f55343ed-6cd4-4a05-83fb-6b9ff396686a"}], "security_groups": [{"name": "tempest-securitygroup--1905641348"}], "key_name": "tempest-keypair-2038219863", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:34:32.045281 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.network.neutron [None req-e1cc2558-b33c-4549-8f2e-ed6061bbf07b tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] validate_networks() for [('f55343ed-6cd4-4a05-83fb-6b9ff396686a', None, None, None)] {{(pid=98179) validate_networks /opt/stack/nova/nova/network/neutron.py:2345}} Feb 17 04:34:32.897277 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.virt.hardware [None req-e1cc2558-b33c-4549-8f2e-ed6061bbf07b tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Flavor limits 0:0:0 {{(pid=98179) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 17 04:34:32.897751 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.virt.hardware [None req-e1cc2558-b33c-4549-8f2e-ed6061bbf07b tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Image limits 0:0:0 {{(pid=98179) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Feb 17 04:34:32.898288 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.virt.hardware [None req-e1cc2558-b33c-4549-8f2e-ed6061bbf07b tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Flavor pref 0:0:0 {{(pid=98179) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 17 04:34:32.898766 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.virt.hardware [None req-e1cc2558-b33c-4549-8f2e-ed6061bbf07b tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Image pref 0:0:0 {{(pid=98179) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Feb 17 04:34:32.899274 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.virt.hardware [None req-e1cc2558-b33c-4549-8f2e-ed6061bbf07b tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98179) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Feb 17 04:34:32.909395 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-e1cc2558-b33c-4549-8f2e-ed6061bbf07b tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:32.909910 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-e1cc2558-b33c-4549-8f2e-ed6061bbf07b tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:32.910803 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-e1cc2558-b33c-4549-8f2e-ed6061bbf07b tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:32.911353 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-e1cc2558-b33c-4549-8f2e-ed6061bbf07b tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:32.932409 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.quota [None req-e1cc2558-b33c-4549-8f2e-ed6061bbf07b tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Getting quotas for project 0bdc99fc094d4c3fb38cad060f2dc825. Resources: {'ram', 'cores', 'instances'} {{(pid=98179) _get_quotas /opt/stack/nova/nova/quota.py:388}} Feb 17 04:34:32.939971 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.quota [None req-e1cc2558-b33c-4549-8f2e-ed6061bbf07b tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Getting quotas for user c1ae36a432a24019803fac4d68061a24 and project 0bdc99fc094d4c3fb38cad060f2dc825. Resources: {'ram', 'cores', 'instances'} {{(pid=98179) _get_quotas /opt/stack/nova/nova/quota.py:380}} Feb 17 04:34:32.956318 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-e1cc2558-b33c-4549-8f2e-ed6061bbf07b tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Going to run 1 instances... {{(pid=98179) _provision_instances /opt/stack/nova/nova/compute/api.py:1264}} Feb 17 04:34:32.958968 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-e1cc2558-b33c-4549-8f2e-ed6061bbf07b tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b005ed36-a85a-4c46-ba22-9fa8c5ec62e5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98179) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1666}} Feb 17 04:34:33.016761 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-e1cc2558-b33c-4549-8f2e-ed6061bbf07b tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.179308 Feb 17 04:34:33.017535 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 508/928] 10.222.0.78 () {62 vars in 1178 bytes} [Wed Feb 17 04:34:31 2021] POST /compute/v2.1/servers => generated 402 bytes in 1181 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Feb 17 04:34:33.186641 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-8011baa9-a397-417e-861a-1a2069febb4a tempest-VolumesGetTestJSON-291690384 tempest-VolumesGetTestJSON-291690384-project] Action: 'create', calling method: .version_select at 0x7f57c88f18c8>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1394673832", "metadata": {"Type": "work"}}} {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:34:33.267173 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.network.neutron [None req-17b07c96-98d1-4d5a-b29b-b82dfc743336 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] [instance: b195626c-7ee1-4679-b956-f7ef7d6328f6] Building network info cache for instance {{(pid=98178) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1836}} Feb 17 04:34:33.955467 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-8011baa9-a397-417e-861a-1a2069febb4a tempest-VolumesGetTestJSON-291690384 tempest-VolumesGetTestJSON-291690384-project] 10.222.0.78 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.936774 Feb 17 04:34:33.959550 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 509/929] 10.222.0.78 () {60 vars in 1146 bytes} [Wed Feb 17 04:34:33 2021] POST /compute/v2.1/os-volumes => generated 353 bytes in 941 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Feb 17 04:34:33.970848 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-1a70cc34-521c-4892-bd9f-62ff5c9cde43 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:34:33.971695 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-1a70cc34-521c-4892-bd9f-62ff5c9cde43 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:34:33.981426 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-1a70cc34-521c-4892-bd9f-62ff5c9cde43 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:33.982169 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-1a70cc34-521c-4892-bd9f-62ff5c9cde43 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:33.983453 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-1a70cc34-521c-4892-bd9f-62ff5c9cde43 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:33.984173 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-1a70cc34-521c-4892-bd9f-62ff5c9cde43 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:34.122994 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-1a70cc34-521c-4892-bd9f-62ff5c9cde43 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:34:34.133293 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-1a70cc34-521c-4892-bd9f-62ff5c9cde43 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:34:34.135054 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-1a70cc34-521c-4892-bd9f-62ff5c9cde43 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:34:34.136608 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-1a70cc34-521c-4892-bd9f-62ff5c9cde43 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "GET /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9" status: 200 len: 1285 microversion: 2.20 time: 0.175403 Feb 17 04:34:34.137068 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 510/930] 10.222.0.78 () {60 vars in 1267 bytes} [Wed Feb 17 04:34:33 2021] GET /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9 => generated 1285 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:34:34.153725 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [req-92337c05-a6f2-4a8a-b8a5-81858ae05c06 req-b6d30acc-a16d-44f0-b280-1f331a9bcd29 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b195626c-7ee1-4679-b956-f7ef7d6328f6", "tag": "b60a0e42-338e-46c0-ba43-9b2027219e08"}]} {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:34:34.156151 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:34:34.156151 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: warnings.warn(msg) Feb 17 04:34:34.166527 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [req-92337c05-a6f2-4a8a-b8a5-81858ae05c06 req-b6d30acc-a16d-44f0-b280-1f331a9bcd29 service nova] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:34.168288 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [req-92337c05-a6f2-4a8a-b8a5-81858ae05c06 req-b6d30acc-a16d-44f0-b280-1f331a9bcd29 service nova] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:34.187393 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.compute.server_external_events [req-92337c05-a6f2-4a8a-b8a5-81858ae05c06 req-b6d30acc-a16d-44f0-b280-1f331a9bcd29 service nova] Creating event network-changed:b60a0e42-338e-46c0-ba43-9b2027219e08 for instance b195626c-7ee1-4679-b956-f7ef7d6328f6 on hv-cinder-75998 Feb 17 04:34:34.204495 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [req-92337c05-a6f2-4a8a-b8a5-81858ae05c06 req-b6d30acc-a16d-44f0-b280-1f331a9bcd29 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055856 Feb 17 04:34:34.205383 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 511/931] 10.222.0.78 () {64 vars in 1308 bytes} [Wed Feb 17 04:34:34 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:34:34.217592 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-1968952a-1b7e-4e9d-a291-d6ec777204c2 tempest-VolumesGetTestJSON-291690384 tempest-VolumesGetTestJSON-291690384-project] Calling method '.version_select at 0x7f57c88f1378>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:34:34.347616 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-1968952a-1b7e-4e9d-a291-d6ec777204c2 tempest-VolumesGetTestJSON-291690384 tempest-VolumesGetTestJSON-291690384-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/93457cfe-09f6-4237-9267-76fc641fd580" status: 200 len: 353 microversion: 2.1 time: 0.140223 Feb 17 04:34:34.348568 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 512/932] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Feb 17 04:34:34 2021] GET /compute/v2.1/os-volumes/93457cfe-09f6-4237-9267-76fc641fd580 => generated 353 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:34:34.442658 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.network.neutron [None req-17b07c96-98d1-4d5a-b29b-b82dfc743336 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] [instance: b195626c-7ee1-4679-b956-f7ef7d6328f6] Updating instance_info_cache with network_info: [{"id": "b60a0e42-338e-46c0-ba43-9b2027219e08", "address": "fa:16:3e:12:7d:d7", "network": {"id": "10e65970-91b2-49d9-93cf-ec97654274a6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1096464601-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.27.1.36", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "0d5b2911946848de81be8f9741faa90f", "mtu": 1450, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, "devname": "tapb60a0e42-33", "ovs_interfaceid": "b60a0e42-338e-46c0-ba43-9b2027219e08", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "meta": {}}] {{(pid=98178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Feb 17 04:34:34.455889 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-17b07c96-98d1-4d5a-b29b-b82dfc743336 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Releasing lock "refresh_cache-b195626c-7ee1-4679-b956-f7ef7d6328f6" {{(pid=98178) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:282}} Feb 17 04:34:34.456825 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-17b07c96-98d1-4d5a-b29b-b82dfc743336 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] 10.222.0.78 "POST /compute/v2.1/servers/b195626c-7ee1-4679-b956-f7ef7d6328f6/action" status: 202 len: 0 microversion: 2.1 time: 3.826950 Feb 17 04:34:34.457474 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 421/933] 10.222.0.78 () {60 vars in 1268 bytes} [Wed Feb 17 04:34:30 2021] POST /compute/v2.1/servers/b195626c-7ee1-4679-b956-f7ef7d6328f6/action => generated 0 bytes in 3828 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Feb 17 04:34:34.467617 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-f41aa4a8-167a-4caf-81a5-4a323e7ead95 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Action: 'create', calling method: .version_select at 0x7f57c88f1950>, body: {"security_group": {"name": "tempest-TestMinimumBasicScenario-678213976", "description": "tempest-TestMinimumBasicScenario-678213976 description"}} {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:34:34.678604 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-f41aa4a8-167a-4caf-81a5-4a323e7ead95 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] 10.222.0.78 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.216258 Feb 17 04:34:34.679637 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 513/934] 10.222.0.78 () {60 vars in 1170 bytes} [Wed Feb 17 04:34:34 2021] POST /compute/v2.1/os-security-groups => generated 255 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:34:34.691682 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-45e390d7-66fe-4a4f-80ce-cc3ff42b6c29 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Action: 'create', calling method: .version_select at 0x7f57c93ea268>, body: {"security_group_rule": {"parent_group_id": "914f5156-aeff-4c7c-abd4-a5e7718c83fd", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "cidr": "0.0.0.0/0"}} {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:34:35.159162 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-a972d153-58b5-49ea-a8a6-70267d797213 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:34:35.164712 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-a972d153-58b5-49ea-a8a6-70267d797213 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:34:35.175442 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-45e390d7-66fe-4a4f-80ce-cc3ff42b6c29 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] 10.222.0.78 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.487664 Feb 17 04:34:35.181006 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 422/935] 10.222.0.78 () {60 vars in 1185 bytes} [Wed Feb 17 04:34:34 2021] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:34:35.193820 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-cfec72e4-e66a-480e-a8b5-b8c73d80e48b tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Action: 'create', calling method: .version_select at 0x7f57c8980400>, body: {"security_group_rule": {"parent_group_id": "914f5156-aeff-4c7c-abd4-a5e7718c83fd", "ip_protocol": "icmp", "from_port": -1, "to_port": -1, "cidr": "0.0.0.0/0"}} {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:34:35.200248 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-a972d153-58b5-49ea-a8a6-70267d797213 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:35.200699 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-a972d153-58b5-49ea-a8a6-70267d797213 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:35.202399 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-a972d153-58b5-49ea-a8a6-70267d797213 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:35.203338 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-a972d153-58b5-49ea-a8a6-70267d797213 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:35.438626 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-a972d153-58b5-49ea-a8a6-70267d797213 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:34:35.450550 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-a972d153-58b5-49ea-a8a6-70267d797213 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:34:35.452719 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-a972d153-58b5-49ea-a8a6-70267d797213 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:34:35.454530 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-a972d153-58b5-49ea-a8a6-70267d797213 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "GET /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9" status: 200 len: 1351 microversion: 2.20 time: 0.301622 Feb 17 04:34:35.455356 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 514/936] 10.222.0.78 () {60 vars in 1267 bytes} [Wed Feb 17 04:34:35 2021] GET /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9 => generated 1351 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:34:35.476883 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-9b00ebda-a07e-4315-b90a-5a5134ad5001 tempest-VolumesGetTestJSON-291690384 tempest-VolumesGetTestJSON-291690384-project] Calling method '.version_select at 0x7f57c8719158>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:34:35.595022 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-9b00ebda-a07e-4315-b90a-5a5134ad5001 tempest-VolumesGetTestJSON-291690384 tempest-VolumesGetTestJSON-291690384-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/93457cfe-09f6-4237-9267-76fc641fd580" status: 200 len: 353 microversion: 2.1 time: 0.123276 Feb 17 04:34:35.595863 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 515/937] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Feb 17 04:34:35 2021] GET /compute/v2.1/os-volumes/93457cfe-09f6-4237-9267-76fc641fd580 => generated 353 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:34:36.081539 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-cfec72e4-e66a-480e-a8b5-b8c73d80e48b tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] 10.222.0.78 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 233 microversion: 2.1 time: 0.891831 Feb 17 04:34:36.082377 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 423/938] 10.222.0.78 () {60 vars in 1185 bytes} [Wed Feb 17 04:34:35 2021] POST /compute/v2.1/os-security-group-rules => generated 233 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 17 04:34:36.094232 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-2088ec49-d238-4139-b5dc-cf14fa6ecbe8 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-TestMinimumBasicScenario-678213976"}} {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:34:36.095082 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-2088ec49-d238-4139-b5dc-cf14fa6ecbe8 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] [instance: b195626c-7ee1-4679-b956-f7ef7d6328f6] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:34:36.108487 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-2088ec49-d238-4139-b5dc-cf14fa6ecbe8 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:36.109002 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-2088ec49-d238-4139-b5dc-cf14fa6ecbe8 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:36.110120 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-2088ec49-d238-4139-b5dc-cf14fa6ecbe8 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:36.110611 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-2088ec49-d238-4139-b5dc-cf14fa6ecbe8 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:36.345284 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.network.security_group_api [None req-2088ec49-d238-4139-b5dc-cf14fa6ecbe8 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Adding security group 914f5156-aeff-4c7c-abd4-a5e7718c83fd to port b60a0e42-338e-46c0-ba43-9b2027219e08 Feb 17 04:34:36.486955 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-a4095b60-00aa-4aeb-99fe-9634a4ab48c4 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:34:36.499636 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-a4095b60-00aa-4aeb-99fe-9634a4ab48c4 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:34:36.517738 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-a4095b60-00aa-4aeb-99fe-9634a4ab48c4 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:36.518265 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-a4095b60-00aa-4aeb-99fe-9634a4ab48c4 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:36.519164 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-a4095b60-00aa-4aeb-99fe-9634a4ab48c4 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:36.519898 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-a4095b60-00aa-4aeb-99fe-9634a4ab48c4 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:36.666829 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-a4095b60-00aa-4aeb-99fe-9634a4ab48c4 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:34:36.676819 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-a4095b60-00aa-4aeb-99fe-9634a4ab48c4 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:34:36.678529 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-a4095b60-00aa-4aeb-99fe-9634a4ab48c4 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:34:36.679824 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-a4095b60-00aa-4aeb-99fe-9634a4ab48c4 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "GET /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9" status: 200 len: 1339 microversion: 2.20 time: 0.202738 Feb 17 04:34:36.680521 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 424/939] 10.222.0.78 () {60 vars in 1267 bytes} [Wed Feb 17 04:34:36 2021] GET /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9 => generated 1339 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 17 04:34:36.685389 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-53032f12-57ac-4f6a-88ea-ead7e97b3109 tempest-VolumesGetTestJSON-291690384 tempest-VolumesGetTestJSON-291690384-project] Calling method '.version_select at 0x7f57c89808c8>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:34:36.788252 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-53032f12-57ac-4f6a-88ea-ead7e97b3109 tempest-VolumesGetTestJSON-291690384 tempest-VolumesGetTestJSON-291690384-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/93457cfe-09f6-4237-9267-76fc641fd580" status: 200 len: 354 microversion: 2.1 time: 0.106344 Feb 17 04:34:36.797193 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 425/940] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Feb 17 04:34:36 2021] GET /compute/v2.1/os-volumes/93457cfe-09f6-4237-9267-76fc641fd580 => generated 354 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:34:36.802761 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-1672ddb2-a29f-441b-8988-f9bc3e1966e1 tempest-VolumesGetTestJSON-291690384 tempest-VolumesGetTestJSON-291690384-project] Calling method '.version_select at 0x7f57c8980c80>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:34:36.916662 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-1672ddb2-a29f-441b-8988-f9bc3e1966e1 tempest-VolumesGetTestJSON-291690384 tempest-VolumesGetTestJSON-291690384-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/93457cfe-09f6-4237-9267-76fc641fd580" status: 200 len: 354 microversion: 2.1 time: 0.117651 Feb 17 04:34:36.918069 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 426/941] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Feb 17 04:34:36 2021] GET /compute/v2.1/os-volumes/93457cfe-09f6-4237-9267-76fc641fd580 => generated 354 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:34:36.937938 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-1f8e7dc6-0d52-4a02-97d4-c93e89f1f9da tempest-VolumesGetTestJSON-291690384 tempest-VolumesGetTestJSON-291690384-project] Calling method '.version_select at 0x7f57c8980f28>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:34:37.043886 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-1f8e7dc6-0d52-4a02-97d4-c93e89f1f9da tempest-VolumesGetTestJSON-291690384 tempest-VolumesGetTestJSON-291690384-project] 10.222.0.78 "DELETE /compute/v2.1/os-volumes/93457cfe-09f6-4237-9267-76fc641fd580" status: 202 len: 0 microversion: 2.1 time: 0.110323 Feb 17 04:34:37.044493 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 427/942] 10.222.0.78 () {58 vars in 1238 bytes} [Wed Feb 17 04:34:36 2021] DELETE /compute/v2.1/os-volumes/93457cfe-09f6-4237-9267-76fc641fd580 => generated 0 bytes in 112 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Feb 17 04:34:37.052651 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-02c2ff93-2c5f-4290-b388-426f57b6f66b tempest-VolumesGetTestJSON-291690384 tempest-VolumesGetTestJSON-291690384-project] Calling method '.version_select at 0x7f57c8980048>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:34:37.163954 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-2088ec49-d238-4139-b5dc-cf14fa6ecbe8 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] 10.222.0.78 "POST /compute/v2.1/servers/b195626c-7ee1-4679-b956-f7ef7d6328f6/action" status: 202 len: 0 microversion: 2.1 time: 1.074325 Feb 17 04:34:37.164607 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 516/943] 10.222.0.78 () {60 vars in 1268 bytes} [Wed Feb 17 04:34:36 2021] POST /compute/v2.1/servers/b195626c-7ee1-4679-b956-f7ef7d6328f6/action => generated 0 bytes in 1076 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:34:37.174207 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-60cd6e9a-8cb9-4972-8aa7-dcde95233b34 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:34:37.174887 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-60cd6e9a-8cb9-4972-8aa7-dcde95233b34 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] [instance: b195626c-7ee1-4679-b956-f7ef7d6328f6] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:34:37.192303 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-60cd6e9a-8cb9-4972-8aa7-dcde95233b34 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:37.193003 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-60cd6e9a-8cb9-4972-8aa7-dcde95233b34 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:37.194209 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-60cd6e9a-8cb9-4972-8aa7-dcde95233b34 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:37.194855 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-60cd6e9a-8cb9-4972-8aa7-dcde95233b34 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:37.214632 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-02c2ff93-2c5f-4290-b388-426f57b6f66b tempest-VolumesGetTestJSON-291690384 tempest-VolumesGetTestJSON-291690384-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/93457cfe-09f6-4237-9267-76fc641fd580" status: 200 len: 353 microversion: 2.1 time: 0.165181 Feb 17 04:34:37.216699 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 428/944] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Feb 17 04:34:37 2021] GET /compute/v2.1/os-volumes/93457cfe-09f6-4237-9267-76fc641fd580 => generated 353 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:34:37.327360 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [req-a47985c8-dba2-488d-b710-9cc7051e4427 req-1c8f8587-f6f2-4cdf-afd9-54738579bcee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b195626c-7ee1-4679-b956-f7ef7d6328f6", "tag": "b60a0e42-338e-46c0-ba43-9b2027219e08"}]} {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:34:37.329574 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:34:37.329574 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: warnings.warn(msg) Feb 17 04:34:37.341252 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [req-a47985c8-dba2-488d-b710-9cc7051e4427 req-1c8f8587-f6f2-4cdf-afd9-54738579bcee service nova] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:37.343373 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [req-a47985c8-dba2-488d-b710-9cc7051e4427 req-1c8f8587-f6f2-4cdf-afd9-54738579bcee service nova] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:37.383705 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.compute.server_external_events [req-a47985c8-dba2-488d-b710-9cc7051e4427 req-1c8f8587-f6f2-4cdf-afd9-54738579bcee service nova] Creating event network-changed:b60a0e42-338e-46c0-ba43-9b2027219e08 for instance b195626c-7ee1-4679-b956-f7ef7d6328f6 on hv-cinder-75998 Feb 17 04:34:37.405900 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [req-a47985c8-dba2-488d-b710-9cc7051e4427 req-1c8f8587-f6f2-4cdf-afd9-54738579bcee service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.181683 Feb 17 04:34:37.409140 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 429/945] 10.222.0.78 () {64 vars in 1308 bytes} [Wed Feb 17 04:34:37 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:34:37.462368 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-60cd6e9a-8cb9-4972-8aa7-dcde95233b34 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f3e4c3c174942c492405c9b112667de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5b2911946848de81be8f9741faa90f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:34:37.474234 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-60cd6e9a-8cb9-4972-8aa7-dcde95233b34 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] 10.222.0.78 "GET /compute/v2.1/servers/b195626c-7ee1-4679-b956-f7ef7d6328f6" status: 200 len: 1768 microversion: 2.1 time: 0.304405 Feb 17 04:34:37.488226 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 517/946] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:34:37 2021] GET /compute/v2.1/servers/b195626c-7ee1-4679-b956-f7ef7d6328f6 => generated 1768 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:34:37.700898 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-793e05b9-0d12-41e8-8e0c-e81e7254120e tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:34:37.701684 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-793e05b9-0d12-41e8-8e0c-e81e7254120e tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:34:37.710085 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-793e05b9-0d12-41e8-8e0c-e81e7254120e tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:37.710467 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-793e05b9-0d12-41e8-8e0c-e81e7254120e tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:37.711338 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-793e05b9-0d12-41e8-8e0c-e81e7254120e tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:37.711815 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-793e05b9-0d12-41e8-8e0c-e81e7254120e tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:38.229879 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-60edafda-e2f8-43dd-96c1-274da554d510 tempest-VolumesGetTestJSON-291690384 tempest-VolumesGetTestJSON-291690384-project] Calling method '.version_select at 0x7f57c8719ae8>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:34:38.297259 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.wsgi [None req-60edafda-e2f8-43dd-96c1-274da554d510 tempest-VolumesGetTestJSON-291690384 tempest-VolumesGetTestJSON-291690384-project] HTTP exception thrown: Volume 93457cfe-09f6-4237-9267-76fc641fd580 could not be found. Feb 17 04:34:38.298181 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-60edafda-e2f8-43dd-96c1-274da554d510 tempest-VolumesGetTestJSON-291690384 tempest-VolumesGetTestJSON-291690384-project] Returning 404 to user: Volume 93457cfe-09f6-4237-9267-76fc641fd580 could not be found. {{(pid=98179) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 17 04:34:38.298913 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-60edafda-e2f8-43dd-96c1-274da554d510 tempest-VolumesGetTestJSON-291690384 tempest-VolumesGetTestJSON-291690384-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/93457cfe-09f6-4237-9267-76fc641fd580" status: 404 len: 109 microversion: 2.1 time: 0.073939 Feb 17 04:34:38.302727 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 518/947] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Feb 17 04:34:38 2021] GET /compute/v2.1/os-volumes/93457cfe-09f6-4237-9267-76fc641fd580 => generated 109 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Feb 17 04:34:38.477249 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-793e05b9-0d12-41e8-8e0c-e81e7254120e tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:34:38.493354 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-793e05b9-0d12-41e8-8e0c-e81e7254120e tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:34:38.495214 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-793e05b9-0d12-41e8-8e0c-e81e7254120e tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:34:38.496814 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-793e05b9-0d12-41e8-8e0c-e81e7254120e tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "GET /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9" status: 200 len: 1407 microversion: 2.20 time: 0.800908 Feb 17 04:34:38.498241 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 430/948] 10.222.0.78 () {60 vars in 1267 bytes} [Wed Feb 17 04:34:37 2021] GET /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9 => generated 1407 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:34:39.519291 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-5d98a6d3-adfc-4fe3-b31b-169a703b05b2 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:34:39.520682 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-5d98a6d3-adfc-4fe3-b31b-169a703b05b2 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:34:39.532903 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-5d98a6d3-adfc-4fe3-b31b-169a703b05b2 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:39.533772 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-5d98a6d3-adfc-4fe3-b31b-169a703b05b2 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:39.534873 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-5d98a6d3-adfc-4fe3-b31b-169a703b05b2 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:39.535395 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-5d98a6d3-adfc-4fe3-b31b-169a703b05b2 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:39.818639 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [req-22d38b24-5a3e-44f9-9c06-20710f02ab6d req-ca46bef5-c2d4-42d2-a2c4-1bc54711d944 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9", "tag": "05ddcb41-fa3f-4fa9-a81d-e152e7b80f04"}]} {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:34:39.823830 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:34:39.823830 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: warnings.warn(msg) Feb 17 04:34:39.825319 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-5d98a6d3-adfc-4fe3-b31b-169a703b05b2 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:34:39.835656 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-5d98a6d3-adfc-4fe3-b31b-169a703b05b2 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:34:39.835947 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [req-22d38b24-5a3e-44f9-9c06-20710f02ab6d req-ca46bef5-c2d4-42d2-a2c4-1bc54711d944 service nova] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:39.836706 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [req-22d38b24-5a3e-44f9-9c06-20710f02ab6d req-ca46bef5-c2d4-42d2-a2c4-1bc54711d944 service nova] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:39.837395 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-5d98a6d3-adfc-4fe3-b31b-169a703b05b2 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:34:39.838507 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-5d98a6d3-adfc-4fe3-b31b-169a703b05b2 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "GET /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9" status: 200 len: 1407 microversion: 2.20 time: 0.323456 Feb 17 04:34:39.839820 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 519/949] 10.222.0.78 () {60 vars in 1267 bytes} [Wed Feb 17 04:34:39 2021] GET /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9 => generated 1407 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:34:39.881398 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.compute.server_external_events [req-22d38b24-5a3e-44f9-9c06-20710f02ab6d req-ca46bef5-c2d4-42d2-a2c4-1bc54711d944 service nova] Creating event network-changed:05ddcb41-fa3f-4fa9-a81d-e152e7b80f04 for instance 8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9 on hv-cinder-75998 Feb 17 04:34:39.886910 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [req-22d38b24-5a3e-44f9-9c06-20710f02ab6d req-ca46bef5-c2d4-42d2-a2c4-1bc54711d944 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084204 Feb 17 04:34:39.888184 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 431/950] 10.222.0.78 () {64 vars in 1308 bytes} [Wed Feb 17 04:34:39 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:34:40.859695 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-cf40258e-928d-48a9-a2c8-5ff4170d6ed3 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:34:40.860703 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-cf40258e-928d-48a9-a2c8-5ff4170d6ed3 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:34:40.869109 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-cf40258e-928d-48a9-a2c8-5ff4170d6ed3 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:40.869695 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-cf40258e-928d-48a9-a2c8-5ff4170d6ed3 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:40.871317 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-cf40258e-928d-48a9-a2c8-5ff4170d6ed3 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:40.872031 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-cf40258e-928d-48a9-a2c8-5ff4170d6ed3 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:41.125208 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-cf40258e-928d-48a9-a2c8-5ff4170d6ed3 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:34:41.134959 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-cf40258e-928d-48a9-a2c8-5ff4170d6ed3 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:34:41.137020 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-cf40258e-928d-48a9-a2c8-5ff4170d6ed3 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:34:41.138463 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-cf40258e-928d-48a9-a2c8-5ff4170d6ed3 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "GET /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9" status: 200 len: 1407 microversion: 2.20 time: 0.284267 Feb 17 04:34:41.139355 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 520/951] 10.222.0.78 () {60 vars in 1267 bytes} [Wed Feb 17 04:34:40 2021] GET /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9 => generated 1407 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:34:42.158664 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-8fb842d8-3f68-4959-8e81-cdfa3a67c22d tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:34:42.159592 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-8fb842d8-3f68-4959-8e81-cdfa3a67c22d tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:34:42.168401 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-8fb842d8-3f68-4959-8e81-cdfa3a67c22d tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:42.168911 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-8fb842d8-3f68-4959-8e81-cdfa3a67c22d tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:42.169769 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-8fb842d8-3f68-4959-8e81-cdfa3a67c22d tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:42.170263 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-8fb842d8-3f68-4959-8e81-cdfa3a67c22d tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:42.388466 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-8fb842d8-3f68-4959-8e81-cdfa3a67c22d tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:34:42.398719 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-8fb842d8-3f68-4959-8e81-cdfa3a67c22d tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:34:42.400408 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-8fb842d8-3f68-4959-8e81-cdfa3a67c22d tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:34:42.401721 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-8fb842d8-3f68-4959-8e81-cdfa3a67c22d tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "GET /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9" status: 200 len: 1407 microversion: 2.20 time: 0.247700 Feb 17 04:34:42.402374 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 432/952] 10.222.0.78 () {60 vars in 1267 bytes} [Wed Feb 17 04:34:42 2021] GET /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9 => generated 1407 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:34:43.421246 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-23c80c97-f83b-4450-a4b2-134b6fac145b tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:34:43.421920 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-23c80c97-f83b-4450-a4b2-134b6fac145b tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:34:43.429765 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-23c80c97-f83b-4450-a4b2-134b6fac145b tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:43.430256 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-23c80c97-f83b-4450-a4b2-134b6fac145b tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:43.431345 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-23c80c97-f83b-4450-a4b2-134b6fac145b tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:43.431847 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-23c80c97-f83b-4450-a4b2-134b6fac145b tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:43.647226 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-23c80c97-f83b-4450-a4b2-134b6fac145b tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:34:43.656708 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-23c80c97-f83b-4450-a4b2-134b6fac145b tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:34:43.658306 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-23c80c97-f83b-4450-a4b2-134b6fac145b tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:34:43.659503 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-23c80c97-f83b-4450-a4b2-134b6fac145b tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "GET /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9" status: 200 len: 1407 microversion: 2.20 time: 0.242513 Feb 17 04:34:43.660092 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 521/953] 10.222.0.78 () {60 vars in 1267 bytes} [Wed Feb 17 04:34:43 2021] GET /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9 => generated 1407 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:34:44.678039 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-013cbe3b-4319-4069-8823-bfd6eb615d2e tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:34:44.678832 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-013cbe3b-4319-4069-8823-bfd6eb615d2e tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:34:44.686938 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-013cbe3b-4319-4069-8823-bfd6eb615d2e tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:44.687607 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-013cbe3b-4319-4069-8823-bfd6eb615d2e tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:44.688539 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-013cbe3b-4319-4069-8823-bfd6eb615d2e tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:44.689110 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-013cbe3b-4319-4069-8823-bfd6eb615d2e tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:44.914845 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-013cbe3b-4319-4069-8823-bfd6eb615d2e tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:34:44.924940 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-013cbe3b-4319-4069-8823-bfd6eb615d2e tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:34:44.926529 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-013cbe3b-4319-4069-8823-bfd6eb615d2e tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:34:44.927710 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-013cbe3b-4319-4069-8823-bfd6eb615d2e tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "GET /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9" status: 200 len: 1407 microversion: 2.20 time: 0.253788 Feb 17 04:34:44.928301 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 433/954] 10.222.0.78 () {60 vars in 1267 bytes} [Wed Feb 17 04:34:44 2021] GET /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9 => generated 1407 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:34:45.948013 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-08eee5d7-24ae-4289-93ea-58afe01b100b tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:34:45.948850 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-08eee5d7-24ae-4289-93ea-58afe01b100b tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:34:45.957958 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-08eee5d7-24ae-4289-93ea-58afe01b100b tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:45.958520 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-08eee5d7-24ae-4289-93ea-58afe01b100b tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:45.959520 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-08eee5d7-24ae-4289-93ea-58afe01b100b tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:45.960022 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-08eee5d7-24ae-4289-93ea-58afe01b100b tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:46.191484 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-08eee5d7-24ae-4289-93ea-58afe01b100b tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:34:46.201278 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-08eee5d7-24ae-4289-93ea-58afe01b100b tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:34:46.202874 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-08eee5d7-24ae-4289-93ea-58afe01b100b tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:34:46.204046 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-08eee5d7-24ae-4289-93ea-58afe01b100b tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "GET /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9" status: 200 len: 1407 microversion: 2.20 time: 0.260215 Feb 17 04:34:46.204636 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 522/955] 10.222.0.78 () {60 vars in 1267 bytes} [Wed Feb 17 04:34:45 2021] GET /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9 => generated 1407 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 17 04:34:47.223932 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-8c74b032-4d34-44bb-822c-d6c049fdeed5 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:34:47.224827 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-8c74b032-4d34-44bb-822c-d6c049fdeed5 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:34:47.244509 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-8c74b032-4d34-44bb-822c-d6c049fdeed5 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:47.244509 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-8c74b032-4d34-44bb-822c-d6c049fdeed5 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:47.244509 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-8c74b032-4d34-44bb-822c-d6c049fdeed5 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:47.244509 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-8c74b032-4d34-44bb-822c-d6c049fdeed5 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:47.459531 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-8c74b032-4d34-44bb-822c-d6c049fdeed5 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:34:47.470058 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-8c74b032-4d34-44bb-822c-d6c049fdeed5 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:34:47.471980 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-8c74b032-4d34-44bb-822c-d6c049fdeed5 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:34:47.473151 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-8c74b032-4d34-44bb-822c-d6c049fdeed5 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "GET /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9" status: 200 len: 1407 microversion: 2.20 time: 0.253357 Feb 17 04:34:47.473851 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 434/956] 10.222.0.78 () {60 vars in 1267 bytes} [Wed Feb 17 04:34:47 2021] GET /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9 => generated 1407 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:34:48.493090 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-ee1637b7-9e0e-46b4-9ae0-e0b64988d654 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:34:48.493741 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-ee1637b7-9e0e-46b4-9ae0-e0b64988d654 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:34:48.503461 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-ee1637b7-9e0e-46b4-9ae0-e0b64988d654 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:48.504130 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-ee1637b7-9e0e-46b4-9ae0-e0b64988d654 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:48.504968 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-ee1637b7-9e0e-46b4-9ae0-e0b64988d654 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:48.505459 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-ee1637b7-9e0e-46b4-9ae0-e0b64988d654 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:49.011000 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-ee1637b7-9e0e-46b4-9ae0-e0b64988d654 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:34:49.021806 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-ee1637b7-9e0e-46b4-9ae0-e0b64988d654 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:34:49.023404 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-ee1637b7-9e0e-46b4-9ae0-e0b64988d654 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:34:49.024537 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-ee1637b7-9e0e-46b4-9ae0-e0b64988d654 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "GET /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9" status: 200 len: 1407 microversion: 2.20 time: 0.536072 Feb 17 04:34:49.025110 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 523/957] 10.222.0.78 () {60 vars in 1267 bytes} [Wed Feb 17 04:34:48 2021] GET /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9 => generated 1407 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:34:49.147781 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [req-c94a41aa-b6bf-432e-ac25-3fe0e8af7ba0 req-03c4b594-03fb-4bdb-8c13-240710fc230c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9", "name": "network-vif-plugged", "status": "completed", "tag": "05ddcb41-fa3f-4fa9-a81d-e152e7b80f04"}]} {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:34:49.149512 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:34:49.149512 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: warnings.warn(msg) Feb 17 04:34:49.159722 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [req-c94a41aa-b6bf-432e-ac25-3fe0e8af7ba0 req-03c4b594-03fb-4bdb-8c13-240710fc230c service nova] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:49.160226 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [req-c94a41aa-b6bf-432e-ac25-3fe0e8af7ba0 req-03c4b594-03fb-4bdb-8c13-240710fc230c service nova] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:49.183293 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.compute.server_external_events [req-c94a41aa-b6bf-432e-ac25-3fe0e8af7ba0 req-03c4b594-03fb-4bdb-8c13-240710fc230c service nova] Creating event network-vif-plugged:05ddcb41-fa3f-4fa9-a81d-e152e7b80f04 for instance 8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9 on hv-cinder-75998 Feb 17 04:34:49.188666 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [req-c94a41aa-b6bf-432e-ac25-3fe0e8af7ba0 req-03c4b594-03fb-4bdb-8c13-240710fc230c service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.275444 Feb 17 04:34:49.189312 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 435/958] 10.222.0.78 () {64 vars in 1308 bytes} [Wed Feb 17 04:34:48 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:34:50.044849 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-9e036e2a-e7df-424a-bca2-0223a3248234 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:34:50.045512 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-9e036e2a-e7df-424a-bca2-0223a3248234 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:34:50.053378 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-9e036e2a-e7df-424a-bca2-0223a3248234 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:50.053879 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-9e036e2a-e7df-424a-bca2-0223a3248234 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:50.054755 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-9e036e2a-e7df-424a-bca2-0223a3248234 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:50.055273 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-9e036e2a-e7df-424a-bca2-0223a3248234 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:50.281976 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-9e036e2a-e7df-424a-bca2-0223a3248234 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:34:50.296177 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-9e036e2a-e7df-424a-bca2-0223a3248234 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:34:50.296177 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-9e036e2a-e7df-424a-bca2-0223a3248234 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:34:50.296177 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-9e036e2a-e7df-424a-bca2-0223a3248234 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "GET /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9" status: 200 len: 1407 microversion: 2.20 time: 0.255703 Feb 17 04:34:50.296632 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 524/959] 10.222.0.78 () {60 vars in 1267 bytes} [Wed Feb 17 04:34:50 2021] GET /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9 => generated 1407 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:34:51.321814 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-1165979d-1cf3-497b-afc6-61f51655c1eb tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:34:51.323531 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-1165979d-1cf3-497b-afc6-61f51655c1eb tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:34:51.333759 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-1165979d-1cf3-497b-afc6-61f51655c1eb tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:51.334333 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-1165979d-1cf3-497b-afc6-61f51655c1eb tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:51.335327 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-1165979d-1cf3-497b-afc6-61f51655c1eb tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:51.335953 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-1165979d-1cf3-497b-afc6-61f51655c1eb tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:52.326937 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-1165979d-1cf3-497b-afc6-61f51655c1eb tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:34:52.337710 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-1165979d-1cf3-497b-afc6-61f51655c1eb tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:34:52.340678 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-1165979d-1cf3-497b-afc6-61f51655c1eb tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:34:52.341907 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-1165979d-1cf3-497b-afc6-61f51655c1eb tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "GET /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9" status: 200 len: 1407 microversion: 2.20 time: 1.026191 Feb 17 04:34:52.342842 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 436/960] 10.222.0.78 () {60 vars in 1267 bytes} [Wed Feb 17 04:34:51 2021] GET /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9 => generated 1407 bytes in 1028 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:34:53.361425 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-c04bdaef-5bd7-4ab9-9310-f621e09b33ea tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:34:53.362376 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-c04bdaef-5bd7-4ab9-9310-f621e09b33ea tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:34:53.372144 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-c04bdaef-5bd7-4ab9-9310-f621e09b33ea tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:53.372767 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-c04bdaef-5bd7-4ab9-9310-f621e09b33ea tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:53.374038 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-c04bdaef-5bd7-4ab9-9310-f621e09b33ea tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:53.374649 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-c04bdaef-5bd7-4ab9-9310-f621e09b33ea tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:53.647549 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-c04bdaef-5bd7-4ab9-9310-f621e09b33ea tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:34:53.659568 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-c04bdaef-5bd7-4ab9-9310-f621e09b33ea tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:34:53.661873 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-c04bdaef-5bd7-4ab9-9310-f621e09b33ea tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:34:53.663332 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-c04bdaef-5bd7-4ab9-9310-f621e09b33ea tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "GET /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9" status: 200 len: 1599 microversion: 2.20 time: 0.306432 Feb 17 04:34:53.664038 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 525/961] 10.222.0.78 () {60 vars in 1267 bytes} [Wed Feb 17 04:34:53 2021] GET /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9 => generated 1599 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:34:53.684064 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-86ec1a0e-0e65-4f9e-9ac9-e73e988e900e tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:34:53.684844 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-86ec1a0e-0e65-4f9e-9ac9-e73e988e900e tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:34:53.701493 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-86ec1a0e-0e65-4f9e-9ac9-e73e988e900e tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:53.702008 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-86ec1a0e-0e65-4f9e-9ac9-e73e988e900e tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:53.705182 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-86ec1a0e-0e65-4f9e-9ac9-e73e988e900e tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:53.705694 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-86ec1a0e-0e65-4f9e-9ac9-e73e988e900e tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:54.057741 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-86ec1a0e-0e65-4f9e-9ac9-e73e988e900e tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "GET /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.378217 Feb 17 04:34:54.058490 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 437/962] 10.222.0.78 () {60 vars in 1306 bytes} [Wed Feb 17 04:34:53 2021] GET /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9/os-interface => generated 284 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 04:34:56.810797 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-f4c3c9b6-0ed8-46c0-807b-c009c13024e6 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:34:56.812553 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-f4c3c9b6-0ed8-46c0-807b-c009c13024e6 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:34:56.828712 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-f4c3c9b6-0ed8-46c0-807b-c009c13024e6 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:56.847454 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-f4c3c9b6-0ed8-46c0-807b-c009c13024e6 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:56.849168 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [req-74acc214-92fc-40b9-a52b-5955ff375b65 req-60badadf-879d-459a-b1ed-c4b7d2cf13fb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9", "tag": "05ddcb41-fa3f-4fa9-a81d-e152e7b80f04"}]} {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:34:56.850829 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-f4c3c9b6-0ed8-46c0-807b-c009c13024e6 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:56.850973 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:34:56.850973 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: warnings.warn(msg) Feb 17 04:34:56.856749 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-f4c3c9b6-0ed8-46c0-807b-c009c13024e6 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:56.870023 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [req-74acc214-92fc-40b9-a52b-5955ff375b65 req-60badadf-879d-459a-b1ed-c4b7d2cf13fb service nova] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:56.873468 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [req-74acc214-92fc-40b9-a52b-5955ff375b65 req-60badadf-879d-459a-b1ed-c4b7d2cf13fb service nova] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:56.917076 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.compute.server_external_events [req-74acc214-92fc-40b9-a52b-5955ff375b65 req-60badadf-879d-459a-b1ed-c4b7d2cf13fb service nova] Creating event network-changed:05ddcb41-fa3f-4fa9-a81d-e152e7b80f04 for instance 8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9 on hv-cinder-75998 Feb 17 04:34:56.931704 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [req-74acc214-92fc-40b9-a52b-5955ff375b65 req-60badadf-879d-459a-b1ed-c4b7d2cf13fb service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086610 Feb 17 04:34:56.933717 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 438/963] 10.222.0.78 () {64 vars in 1308 bytes} [Wed Feb 17 04:34:56 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:34:57.059950 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-f4c3c9b6-0ed8-46c0-807b-c009c13024e6 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "POST /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9/action" status: 200 len: 14 microversion: 2.20 time: 0.252850 Feb 17 04:34:57.060660 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 526/964] 10.222.0.78 () {62 vars in 1309 bytes} [Wed Feb 17 04:34:56 2021] POST /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9/action => generated 14 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:34:58.073032 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-b778d58c-e0e2-4c08-b7d2-be2df1daa8b0 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:34:58.074928 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-b778d58c-e0e2-4c08-b7d2-be2df1daa8b0 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:34:58.090924 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-b778d58c-e0e2-4c08-b7d2-be2df1daa8b0 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:58.093200 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-b778d58c-e0e2-4c08-b7d2-be2df1daa8b0 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:58.094267 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-b778d58c-e0e2-4c08-b7d2-be2df1daa8b0 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:58.095593 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-b778d58c-e0e2-4c08-b7d2-be2df1daa8b0 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:58.324557 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-b778d58c-e0e2-4c08-b7d2-be2df1daa8b0 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "POST /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9/action" status: 200 len: 14 microversion: 2.20 time: 0.256150 Feb 17 04:34:58.325235 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 439/965] 10.222.0.78 () {62 vars in 1309 bytes} [Wed Feb 17 04:34:58 2021] POST /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9/action => generated 14 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:34:59.337148 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-d0260ca6-d792-4b6f-83bc-18ebd5a47852 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:34:59.339396 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-d0260ca6-d792-4b6f-83bc-18ebd5a47852 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:34:59.349112 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-d0260ca6-d792-4b6f-83bc-18ebd5a47852 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:59.349707 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-d0260ca6-d792-4b6f-83bc-18ebd5a47852 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:59.350650 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-d0260ca6-d792-4b6f-83bc-18ebd5a47852 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:59.351260 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-d0260ca6-d792-4b6f-83bc-18ebd5a47852 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:59.487826 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-d0260ca6-d792-4b6f-83bc-18ebd5a47852 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "POST /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9/action" status: 200 len: 14 microversion: 2.20 time: 0.154823 Feb 17 04:34:59.489595 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 527/966] 10.222.0.78 () {62 vars in 1309 bytes} [Wed Feb 17 04:34:59 2021] POST /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9/action => generated 14 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:35:00.501292 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-c9162552-5b9a-4c19-8832-134f14245d24 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:35:00.502584 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-c9162552-5b9a-4c19-8832-134f14245d24 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:35:00.522782 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-c9162552-5b9a-4c19-8832-134f14245d24 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:00.523451 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-c9162552-5b9a-4c19-8832-134f14245d24 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:00.524794 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-c9162552-5b9a-4c19-8832-134f14245d24 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:00.528863 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-c9162552-5b9a-4c19-8832-134f14245d24 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:00.672112 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-c9162552-5b9a-4c19-8832-134f14245d24 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "POST /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9/action" status: 200 len: 14 microversion: 2.20 time: 0.175374 Feb 17 04:35:00.673240 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 440/967] 10.222.0.78 () {62 vars in 1309 bytes} [Wed Feb 17 04:35:00 2021] POST /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9/action => generated 14 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:35:01.685021 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-3003ee28-9166-424b-9550-dda023a32b85 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:35:01.686277 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-3003ee28-9166-424b-9550-dda023a32b85 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:35:01.695127 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-3003ee28-9166-424b-9550-dda023a32b85 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:01.695593 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-3003ee28-9166-424b-9550-dda023a32b85 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:01.696433 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-3003ee28-9166-424b-9550-dda023a32b85 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:01.696925 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-3003ee28-9166-424b-9550-dda023a32b85 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:01.845796 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-3003ee28-9166-424b-9550-dda023a32b85 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "POST /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9/action" status: 200 len: 14 microversion: 2.20 time: 0.165707 Feb 17 04:35:01.847137 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 528/968] 10.222.0.78 () {62 vars in 1309 bytes} [Wed Feb 17 04:35:01 2021] POST /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9/action => generated 14 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:35:02.860655 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-5297cd4c-3539-4da5-b1c0-eeb07e8c5cc5 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:35:02.862839 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-5297cd4c-3539-4da5-b1c0-eeb07e8c5cc5 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:35:02.874447 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-5297cd4c-3539-4da5-b1c0-eeb07e8c5cc5 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:02.875387 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-5297cd4c-3539-4da5-b1c0-eeb07e8c5cc5 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:02.880487 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-5297cd4c-3539-4da5-b1c0-eeb07e8c5cc5 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:02.880994 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-5297cd4c-3539-4da5-b1c0-eeb07e8c5cc5 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:03.045617 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-5297cd4c-3539-4da5-b1c0-eeb07e8c5cc5 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "POST /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9/action" status: 200 len: 14 microversion: 2.20 time: 0.190094 Feb 17 04:35:03.046312 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 441/969] 10.222.0.78 () {62 vars in 1309 bytes} [Wed Feb 17 04:35:02 2021] POST /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9/action => generated 14 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:35:04.058208 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-4e689e02-82db-4365-b472-f7f39a131dc0 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:35:04.059390 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-4e689e02-82db-4365-b472-f7f39a131dc0 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:35:04.071999 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-4e689e02-82db-4365-b472-f7f39a131dc0 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:04.073394 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-4e689e02-82db-4365-b472-f7f39a131dc0 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:04.074402 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-4e689e02-82db-4365-b472-f7f39a131dc0 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:04.075401 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-4e689e02-82db-4365-b472-f7f39a131dc0 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:04.236355 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-4e689e02-82db-4365-b472-f7f39a131dc0 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "POST /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9/action" status: 200 len: 14 microversion: 2.20 time: 0.182857 Feb 17 04:35:04.237793 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 529/970] 10.222.0.78 () {62 vars in 1309 bytes} [Wed Feb 17 04:35:04 2021] POST /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9/action => generated 14 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:35:05.249545 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-3fb39be3-45ca-436c-9e8f-4bfbb7e39271 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:35:05.250786 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-3fb39be3-45ca-436c-9e8f-4bfbb7e39271 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:35:05.288078 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-3fb39be3-45ca-436c-9e8f-4bfbb7e39271 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:05.288901 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-3fb39be3-45ca-436c-9e8f-4bfbb7e39271 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:05.290358 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-3fb39be3-45ca-436c-9e8f-4bfbb7e39271 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:05.291140 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-3fb39be3-45ca-436c-9e8f-4bfbb7e39271 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:05.481954 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-3fb39be3-45ca-436c-9e8f-4bfbb7e39271 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "POST /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9/action" status: 200 len: 14 microversion: 2.20 time: 0.237699 Feb 17 04:35:05.483108 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 442/971] 10.222.0.78 () {62 vars in 1309 bytes} [Wed Feb 17 04:35:05 2021] POST /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9/action => generated 14 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:35:06.499151 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-095ef8b6-d914-4e7a-9202-e39a513effd4 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:35:06.501722 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-095ef8b6-d914-4e7a-9202-e39a513effd4 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:35:06.517496 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-095ef8b6-d914-4e7a-9202-e39a513effd4 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:06.518710 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-095ef8b6-d914-4e7a-9202-e39a513effd4 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:06.519883 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-095ef8b6-d914-4e7a-9202-e39a513effd4 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:06.520892 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-095ef8b6-d914-4e7a-9202-e39a513effd4 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:06.720557 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-095ef8b6-d914-4e7a-9202-e39a513effd4 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "POST /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9/action" status: 200 len: 6451 microversion: 2.20 time: 0.229525 Feb 17 04:35:06.721549 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 530/972] 10.222.0.78 () {62 vars in 1309 bytes} [Wed Feb 17 04:35:06 2021] POST /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9/action => generated 6451 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:35:07.735936 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-4146daa5-1c82-475f-85a5-7ba05e45176f tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:35:07.738489 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-4146daa5-1c82-475f-85a5-7ba05e45176f tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:35:07.752189 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-4146daa5-1c82-475f-85a5-7ba05e45176f tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:07.752866 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-4146daa5-1c82-475f-85a5-7ba05e45176f tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:07.753896 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-4146daa5-1c82-475f-85a5-7ba05e45176f tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:07.754526 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-4146daa5-1c82-475f-85a5-7ba05e45176f tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:07.927818 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-4146daa5-1c82-475f-85a5-7ba05e45176f tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "POST /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9/action" status: 200 len: 15025 microversion: 2.20 time: 0.198589 Feb 17 04:35:07.928867 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 443/973] 10.222.0.78 () {62 vars in 1309 bytes} [Wed Feb 17 04:35:07 2021] POST /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9/action => generated 15025 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:35:08.942017 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-1c1fbb1b-f8cb-4b37-9d61-e79853b5858e tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:35:08.943215 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-1c1fbb1b-f8cb-4b37-9d61-e79853b5858e tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:35:08.952387 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-1c1fbb1b-f8cb-4b37-9d61-e79853b5858e tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:08.953309 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-1c1fbb1b-f8cb-4b37-9d61-e79853b5858e tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:08.954329 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-1c1fbb1b-f8cb-4b37-9d61-e79853b5858e tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:08.954984 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-1c1fbb1b-f8cb-4b37-9d61-e79853b5858e tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:09.146047 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-1c1fbb1b-f8cb-4b37-9d61-e79853b5858e tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "POST /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9/action" status: 200 len: 18356 microversion: 2.20 time: 0.209090 Feb 17 04:35:09.151287 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 531/974] 10.222.0.78 () {62 vars in 1309 bytes} [Wed Feb 17 04:35:08 2021] POST /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9/action => generated 18356 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:35:09.230981 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-d3828d9b-acbb-4dc4-b8ca-522c79b27d0a tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Action: 'create', calling method: .version_select at 0x7f57c93eac80>, body: {"keypair": {"name": "tempest-TestShelveInstance-585983373"}} {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:35:09.255606 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.quota [None req-d3828d9b-acbb-4dc4-b8ca-522c79b27d0a tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Getting quotas for project 79050d22ac3d4c7eb85cd6a19be9ef10. Resources: {'key_pairs'} {{(pid=98178) _get_quotas /opt/stack/nova/nova/quota.py:388}} Feb 17 04:35:09.260363 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.quota [None req-d3828d9b-acbb-4dc4-b8ca-522c79b27d0a tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Getting quotas for user fb8b6c44468c498f9dc0d3a8776433d5 and project 79050d22ac3d4c7eb85cd6a19be9ef10. Resources: {'key_pairs'} {{(pid=98178) _get_quotas /opt/stack/nova/nova/quota.py:380}} Feb 17 04:35:09.272916 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: ERROR oslo.messaging._drivers.impl_rabbit [None req-d3828d9b-acbb-4dc4-b8ca-522c79b27d0a tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] [80760b8a-e51f-469a-99bc-31027d20b7e5] AMQP server on 10.222.0.78:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Feb 17 04:35:10.160396 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-9c734218-4cf3-483d-8d18-5388a6616962 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:35:10.161811 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-9c734218-4cf3-483d-8d18-5388a6616962 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:35:10.172300 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-9c734218-4cf3-483d-8d18-5388a6616962 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:10.173289 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-9c734218-4cf3-483d-8d18-5388a6616962 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:10.174379 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-9c734218-4cf3-483d-8d18-5388a6616962 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:10.175125 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-9c734218-4cf3-483d-8d18-5388a6616962 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:10.289410 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO oslo.messaging._drivers.impl_rabbit [None req-d3828d9b-acbb-4dc4-b8ca-522c79b27d0a tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] [80760b8a-e51f-469a-99bc-31027d20b7e5] Reconnected to AMQP server on 10.222.0.78:5672 via [amqp] client with port 57532. Feb 17 04:35:10.327723 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-9c734218-4cf3-483d-8d18-5388a6616962 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "POST /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9/action" status: 200 len: 19342 microversion: 2.20 time: 0.171544 Feb 17 04:35:10.329257 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 532/975] 10.222.0.78 () {62 vars in 1309 bytes} [Wed Feb 17 04:35:10 2021] POST /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9/action => generated 19342 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Feb 17 04:35:10.620509 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.quota [None req-d3828d9b-acbb-4dc4-b8ca-522c79b27d0a tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Getting quotas for project 79050d22ac3d4c7eb85cd6a19be9ef10. Resources: {'key_pairs'} {{(pid=98178) _get_quotas /opt/stack/nova/nova/quota.py:388}} Feb 17 04:35:10.625175 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.quota [None req-d3828d9b-acbb-4dc4-b8ca-522c79b27d0a tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Getting quotas for user fb8b6c44468c498f9dc0d3a8776433d5 and project 79050d22ac3d4c7eb85cd6a19be9ef10. Resources: {'key_pairs'} {{(pid=98178) _get_quotas /opt/stack/nova/nova/quota.py:380}} Feb 17 04:35:10.640782 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-d3828d9b-acbb-4dc4-b8ca-522c79b27d0a tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 2315 microversion: 2.1 time: 1.658128 Feb 17 04:35:10.642024 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 444/976] 10.222.0.78 () {60 vars in 1148 bytes} [Wed Feb 17 04:35:08 2021] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 1660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:35:10.653609 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-9345dc16-59b1-4245-bd39-73be67583faa tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Action: 'create', calling method: .version_select at 0x7f57c94198c8>, body: {"security_group": {"name": "tempest-TestShelveInstance-915650034", "description": "tempest-TestShelveInstance-915650034 description"}} {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:35:10.871516 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-9345dc16-59b1-4245-bd39-73be67583faa tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] 10.222.0.78 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.222737 Feb 17 04:35:10.872341 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 533/977] 10.222.0.78 () {60 vars in 1170 bytes} [Wed Feb 17 04:35:10 2021] POST /compute/v2.1/os-security-groups => generated 243 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:35:10.883961 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-bc5e13bc-85c3-4bf1-b307-ac3bc90030c1 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Action: 'create', calling method: .version_select at 0x7f57c8721f28>, body: {"security_group_rule": {"parent_group_id": "874b7eeb-b4d6-4567-8340-88cb5924cc7f", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "cidr": "0.0.0.0/0"}} {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:35:11.155897 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-bc5e13bc-85c3-4bf1-b307-ac3bc90030c1 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] 10.222.0.78 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.275318 Feb 17 04:35:11.157008 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 445/978] 10.222.0.78 () {60 vars in 1185 bytes} [Wed Feb 17 04:35:10 2021] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:35:11.168591 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-53e7c8b5-3684-4b88-94ff-cb2decbd09e7 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Action: 'create', calling method: .version_select at 0x7f57c8719048>, body: {"security_group_rule": {"parent_group_id": "874b7eeb-b4d6-4567-8340-88cb5924cc7f", "ip_protocol": "icmp", "from_port": -1, "to_port": -1, "cidr": "0.0.0.0/0"}} {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:35:11.343052 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-cbd7feef-2ac9-4407-92c2-e4163ffdfcfb tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:35:11.344842 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-cbd7feef-2ac9-4407-92c2-e4163ffdfcfb tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:35:11.358885 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-cbd7feef-2ac9-4407-92c2-e4163ffdfcfb tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:11.359678 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-cbd7feef-2ac9-4407-92c2-e4163ffdfcfb tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:11.360536 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-cbd7feef-2ac9-4407-92c2-e4163ffdfcfb tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:11.361027 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-cbd7feef-2ac9-4407-92c2-e4163ffdfcfb tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:11.453103 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-53e7c8b5-3684-4b88-94ff-cb2decbd09e7 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] 10.222.0.78 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 233 microversion: 2.1 time: 0.289029 Feb 17 04:35:11.453733 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 534/979] 10.222.0.78 () {60 vars in 1185 bytes} [Wed Feb 17 04:35:11 2021] POST /compute/v2.1/os-security-group-rules => generated 233 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:35:11.538029 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-cbd7feef-2ac9-4407-92c2-e4163ffdfcfb tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "POST /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9/action" status: 200 len: 21966 microversion: 2.20 time: 0.201123 Feb 17 04:35:11.539662 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 446/980] 10.222.0.78 () {62 vars in 1309 bytes} [Wed Feb 17 04:35:11 2021] POST /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9/action => generated 21966 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:35:12.554209 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-d23ccfb1-837b-4b7f-8eba-aefebc0dc65e tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:35:12.558693 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-d23ccfb1-837b-4b7f-8eba-aefebc0dc65e tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:35:12.575079 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-d23ccfb1-837b-4b7f-8eba-aefebc0dc65e tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:12.576090 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-d23ccfb1-837b-4b7f-8eba-aefebc0dc65e tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:12.577604 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-d23ccfb1-837b-4b7f-8eba-aefebc0dc65e tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:12.578455 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-d23ccfb1-837b-4b7f-8eba-aefebc0dc65e tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:12.776643 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-d23ccfb1-837b-4b7f-8eba-aefebc0dc65e tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "POST /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9/action" status: 200 len: 23228 microversion: 2.20 time: 0.229750 Feb 17 04:35:12.778149 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 535/981] 10.222.0.78 () {62 vars in 1309 bytes} [Wed Feb 17 04:35:12 2021] POST /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9/action => generated 23228 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:35:13.789474 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-b3b5436a-d610-478f-adab-d38b2c9309a1 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:35:13.790534 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-b3b5436a-d610-478f-adab-d38b2c9309a1 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:35:13.800828 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-b3b5436a-d610-478f-adab-d38b2c9309a1 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:13.801338 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-b3b5436a-d610-478f-adab-d38b2c9309a1 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:13.802189 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-b3b5436a-d610-478f-adab-d38b2c9309a1 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:13.802680 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-b3b5436a-d610-478f-adab-d38b2c9309a1 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:13.959849 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-b3b5436a-d610-478f-adab-d38b2c9309a1 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "POST /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9/action" status: 200 len: 24364 microversion: 2.20 time: 0.175178 Feb 17 04:35:13.964774 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 447/982] 10.222.0.78 () {62 vars in 1309 bytes} [Wed Feb 17 04:35:13 2021] POST /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9/action => generated 24364 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:35:14.973181 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-15cc6f88-e01c-45cd-be40-ff44d4ac55f8 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:35:14.974371 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-15cc6f88-e01c-45cd-be40-ff44d4ac55f8 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:35:14.983619 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-15cc6f88-e01c-45cd-be40-ff44d4ac55f8 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:14.984133 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-15cc6f88-e01c-45cd-be40-ff44d4ac55f8 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:14.985227 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-15cc6f88-e01c-45cd-be40-ff44d4ac55f8 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:14.985889 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-15cc6f88-e01c-45cd-be40-ff44d4ac55f8 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:15.169170 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-15cc6f88-e01c-45cd-be40-ff44d4ac55f8 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "POST /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9/action" status: 200 len: 25660 microversion: 2.20 time: 0.200427 Feb 17 04:35:15.169880 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 536/983] 10.222.0.78 () {62 vars in 1309 bytes} [Wed Feb 17 04:35:14 2021] POST /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9/action => generated 25660 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:35:16.183451 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-ea7a160d-eff0-4484-8b44-624585fb7ba0 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:35:16.184469 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-ea7a160d-eff0-4484-8b44-624585fb7ba0 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:35:16.193944 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-ea7a160d-eff0-4484-8b44-624585fb7ba0 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:16.194463 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-ea7a160d-eff0-4484-8b44-624585fb7ba0 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:16.195376 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-ea7a160d-eff0-4484-8b44-624585fb7ba0 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:16.195880 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-ea7a160d-eff0-4484-8b44-624585fb7ba0 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:16.374237 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-ea7a160d-eff0-4484-8b44-624585fb7ba0 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "POST /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9/action" status: 200 len: 26657 microversion: 2.20 time: 0.195969 Feb 17 04:35:16.375327 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 448/984] 10.222.0.78 () {62 vars in 1309 bytes} [Wed Feb 17 04:35:16 2021] POST /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9/action => generated 26657 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:35:17.388724 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-856c481b-722e-4c44-9af4-897d21e1869d tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:35:17.390053 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-856c481b-722e-4c44-9af4-897d21e1869d tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:35:17.400180 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-856c481b-722e-4c44-9af4-897d21e1869d tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:17.400928 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-856c481b-722e-4c44-9af4-897d21e1869d tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:17.401825 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-856c481b-722e-4c44-9af4-897d21e1869d tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:17.402326 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-856c481b-722e-4c44-9af4-897d21e1869d tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:17.575849 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-856c481b-722e-4c44-9af4-897d21e1869d tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "POST /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9/action" status: 200 len: 27395 microversion: 2.20 time: 0.192144 Feb 17 04:35:17.576752 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 537/985] 10.222.0.78 () {62 vars in 1309 bytes} [Wed Feb 17 04:35:17 2021] POST /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9/action => generated 27395 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:35:18.589767 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-806c0b58-9949-40a9-8a33-ed8d82e895a1 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:35:18.590911 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-806c0b58-9949-40a9-8a33-ed8d82e895a1 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:35:18.599447 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-806c0b58-9949-40a9-8a33-ed8d82e895a1 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:18.599953 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-806c0b58-9949-40a9-8a33-ed8d82e895a1 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:18.600792 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-806c0b58-9949-40a9-8a33-ed8d82e895a1 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:18.601285 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-806c0b58-9949-40a9-8a33-ed8d82e895a1 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:18.755910 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-806c0b58-9949-40a9-8a33-ed8d82e895a1 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "POST /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9/action" status: 200 len: 27724 microversion: 2.20 time: 0.171121 Feb 17 04:35:18.761142 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 449/986] 10.222.0.78 () {62 vars in 1309 bytes} [Wed Feb 17 04:35:18 2021] POST /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9/action => generated 27724 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:35:19.770291 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-66711d45-8280-4489-a9a5-0bde95de24cd tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:35:19.771553 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-66711d45-8280-4489-a9a5-0bde95de24cd tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:35:19.780820 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-66711d45-8280-4489-a9a5-0bde95de24cd tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:19.781412 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-66711d45-8280-4489-a9a5-0bde95de24cd tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:19.782294 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-66711d45-8280-4489-a9a5-0bde95de24cd tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:19.782784 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-66711d45-8280-4489-a9a5-0bde95de24cd tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:19.924588 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-66711d45-8280-4489-a9a5-0bde95de24cd tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "POST /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9/action" status: 200 len: 27933 microversion: 2.20 time: 0.158876 Feb 17 04:35:19.925342 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 538/987] 10.222.0.78 () {62 vars in 1309 bytes} [Wed Feb 17 04:35:19 2021] POST /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9/action => generated 27933 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:35:20.940591 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-582636b0-3f79-4361-b238-69a667cabb8e tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:35:20.942396 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-582636b0-3f79-4361-b238-69a667cabb8e tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:35:20.951777 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-582636b0-3f79-4361-b238-69a667cabb8e tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:20.952410 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-582636b0-3f79-4361-b238-69a667cabb8e tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:20.953266 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-582636b0-3f79-4361-b238-69a667cabb8e tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:20.953959 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-582636b0-3f79-4361-b238-69a667cabb8e tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:21.097382 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-582636b0-3f79-4361-b238-69a667cabb8e tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "POST /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9/action" status: 200 len: 28051 microversion: 2.20 time: 0.162092 Feb 17 04:35:21.098775 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 450/988] 10.222.0.78 () {62 vars in 1309 bytes} [Wed Feb 17 04:35:20 2021] POST /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9/action => generated 28051 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:35:22.112078 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-8bd481a9-27cd-4a72-a6cb-9b52b5806255 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:35:22.113321 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-8bd481a9-27cd-4a72-a6cb-9b52b5806255 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:35:22.124929 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-8bd481a9-27cd-4a72-a6cb-9b52b5806255 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:22.125565 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-8bd481a9-27cd-4a72-a6cb-9b52b5806255 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:22.126498 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-8bd481a9-27cd-4a72-a6cb-9b52b5806255 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:22.127261 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-8bd481a9-27cd-4a72-a6cb-9b52b5806255 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:22.291242 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-8bd481a9-27cd-4a72-a6cb-9b52b5806255 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "POST /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9/action" status: 200 len: 28168 microversion: 2.20 time: 0.183465 Feb 17 04:35:22.295523 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 539/989] 10.222.0.78 () {62 vars in 1309 bytes} [Wed Feb 17 04:35:22 2021] POST /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9/action => generated 28168 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:35:23.304695 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-ddd29bd9-2cf9-4abf-a20b-6c78920b814a tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:35:23.305916 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-ddd29bd9-2cf9-4abf-a20b-6c78920b814a tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:35:23.315419 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-ddd29bd9-2cf9-4abf-a20b-6c78920b814a tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:23.315940 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-ddd29bd9-2cf9-4abf-a20b-6c78920b814a tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:23.316779 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-ddd29bd9-2cf9-4abf-a20b-6c78920b814a tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:23.317281 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-ddd29bd9-2cf9-4abf-a20b-6c78920b814a tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:23.459951 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-ddd29bd9-2cf9-4abf-a20b-6c78920b814a tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "POST /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9/action" status: 200 len: 28168 microversion: 2.20 time: 0.159506 Feb 17 04:35:23.460642 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 451/990] 10.222.0.78 () {62 vars in 1309 bytes} [Wed Feb 17 04:35:23 2021] POST /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9/action => generated 28168 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:35:24.158438 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-2660f6d7-c0af-460f-9b01-77b933bbd928 tempest-VolumesNegativeTest-40300628 tempest-VolumesNegativeTest-40300628-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1010576205", "imageRef": "b005ed36-a85a-4c46-ba22-9fa8c5ec62e5", "flavorRef": "452"}} {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:35:24.230813 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.network.neutron [None req-2660f6d7-c0af-460f-9b01-77b933bbd928 tempest-VolumesNegativeTest-40300628 tempest-VolumesNegativeTest-40300628-project] validate_networks() for None {{(pid=98179) validate_networks /opt/stack/nova/nova/network/neutron.py:2345}} Feb 17 04:35:24.474522 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-593f5960-2e74-497f-a642-3f888720d008 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:35:24.477937 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-593f5960-2e74-497f-a642-3f888720d008 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:35:24.488102 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-593f5960-2e74-497f-a642-3f888720d008 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:24.488621 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-593f5960-2e74-497f-a642-3f888720d008 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:24.489491 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-593f5960-2e74-497f-a642-3f888720d008 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:24.489990 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-593f5960-2e74-497f-a642-3f888720d008 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:24.643485 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-593f5960-2e74-497f-a642-3f888720d008 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "POST /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9/action" status: 200 len: 28168 microversion: 2.20 time: 0.174206 Feb 17 04:35:24.644723 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 452/991] 10.222.0.78 () {62 vars in 1309 bytes} [Wed Feb 17 04:35:24 2021] POST /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9/action => generated 28168 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:35:24.749833 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.virt.hardware [None req-2660f6d7-c0af-460f-9b01-77b933bbd928 tempest-VolumesNegativeTest-40300628 tempest-VolumesNegativeTest-40300628-project] Flavor limits 0:0:0 {{(pid=98179) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 17 04:35:24.750339 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.virt.hardware [None req-2660f6d7-c0af-460f-9b01-77b933bbd928 tempest-VolumesNegativeTest-40300628 tempest-VolumesNegativeTest-40300628-project] Image limits 0:0:0 {{(pid=98179) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Feb 17 04:35:24.750891 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.virt.hardware [None req-2660f6d7-c0af-460f-9b01-77b933bbd928 tempest-VolumesNegativeTest-40300628 tempest-VolumesNegativeTest-40300628-project] Flavor pref 0:0:0 {{(pid=98179) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 17 04:35:24.751434 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.virt.hardware [None req-2660f6d7-c0af-460f-9b01-77b933bbd928 tempest-VolumesNegativeTest-40300628 tempest-VolumesNegativeTest-40300628-project] Image pref 0:0:0 {{(pid=98179) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Feb 17 04:35:24.751905 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.virt.hardware [None req-2660f6d7-c0af-460f-9b01-77b933bbd928 tempest-VolumesNegativeTest-40300628 tempest-VolumesNegativeTest-40300628-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98179) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Feb 17 04:35:24.761034 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-2660f6d7-c0af-460f-9b01-77b933bbd928 tempest-VolumesNegativeTest-40300628 tempest-VolumesNegativeTest-40300628-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:24.761546 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-2660f6d7-c0af-460f-9b01-77b933bbd928 tempest-VolumesNegativeTest-40300628 tempest-VolumesNegativeTest-40300628-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:24.762432 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-2660f6d7-c0af-460f-9b01-77b933bbd928 tempest-VolumesNegativeTest-40300628 tempest-VolumesNegativeTest-40300628-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:24.762931 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-2660f6d7-c0af-460f-9b01-77b933bbd928 tempest-VolumesNegativeTest-40300628 tempest-VolumesNegativeTest-40300628-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:24.781999 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.quota [None req-2660f6d7-c0af-460f-9b01-77b933bbd928 tempest-VolumesNegativeTest-40300628 tempest-VolumesNegativeTest-40300628-project] Getting quotas for project cb7ff276610646ec9b39f6a9c08024c2. Resources: {'ram', 'cores', 'instances'} {{(pid=98179) _get_quotas /opt/stack/nova/nova/quota.py:388}} Feb 17 04:35:24.786388 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.quota [None req-2660f6d7-c0af-460f-9b01-77b933bbd928 tempest-VolumesNegativeTest-40300628 tempest-VolumesNegativeTest-40300628-project] Getting quotas for user 60d0d0233aaa4d59afd95d651c8d596f and project cb7ff276610646ec9b39f6a9c08024c2. Resources: {'ram', 'cores', 'instances'} {{(pid=98179) _get_quotas /opt/stack/nova/nova/quota.py:380}} Feb 17 04:35:24.800018 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-2660f6d7-c0af-460f-9b01-77b933bbd928 tempest-VolumesNegativeTest-40300628 tempest-VolumesNegativeTest-40300628-project] Going to run 1 instances... {{(pid=98179) _provision_instances /opt/stack/nova/nova/compute/api.py:1264}} Feb 17 04:35:24.802750 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-2660f6d7-c0af-460f-9b01-77b933bbd928 tempest-VolumesNegativeTest-40300628 tempest-VolumesNegativeTest-40300628-project] [instance: 8e8ff2f6-f13f-4d01-b305-21d7428638a3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b005ed36-a85a-4c46-ba22-9fa8c5ec62e5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98179) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1666}} Feb 17 04:35:24.855924 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-2660f6d7-c0af-460f-9b01-77b933bbd928 tempest-VolumesNegativeTest-40300628 tempest-VolumesNegativeTest-40300628-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.702578 Feb 17 04:35:24.856684 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 540/992] 10.222.0.78 () {60 vars in 1137 bytes} [Wed Feb 17 04:35:24 2021] POST /compute/v2.1/servers => generated 380 bytes in 704 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 17 04:35:24.868287 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-9af582a8-a044-44fb-bf32-446aac7fda00 tempest-VolumesNegativeTest-40300628 tempest-VolumesNegativeTest-40300628-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:35:24.869707 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-9af582a8-a044-44fb-bf32-446aac7fda00 tempest-VolumesNegativeTest-40300628 tempest-VolumesNegativeTest-40300628-project] [instance: 8e8ff2f6-f13f-4d01-b305-21d7428638a3] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:35:24.952103 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-9af582a8-a044-44fb-bf32-446aac7fda00 tempest-VolumesNegativeTest-40300628 tempest-VolumesNegativeTest-40300628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d0d0233aaa4d59afd95d651c8d596f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb7ff276610646ec9b39f6a9c08024c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:35:24.960823 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-9af582a8-a044-44fb-bf32-446aac7fda00 tempest-VolumesNegativeTest-40300628 tempest-VolumesNegativeTest-40300628-project] 10.222.0.78 "GET /compute/v2.1/servers/8e8ff2f6-f13f-4d01-b305-21d7428638a3" status: 200 len: 1215 microversion: 2.1 time: 0.096977 Feb 17 04:35:24.961427 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 453/993] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:35:24 2021] GET /compute/v2.1/servers/8e8ff2f6-f13f-4d01-b305-21d7428638a3 => generated 1215 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:35:25.657045 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-27d42d1c-df70-475e-95e1-3ecc517c7782 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:35:25.658340 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-27d42d1c-df70-475e-95e1-3ecc517c7782 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:35:25.667944 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-27d42d1c-df70-475e-95e1-3ecc517c7782 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:25.668451 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-27d42d1c-df70-475e-95e1-3ecc517c7782 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:25.669290 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-27d42d1c-df70-475e-95e1-3ecc517c7782 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:25.669808 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-27d42d1c-df70-475e-95e1-3ecc517c7782 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:25.821635 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-27d42d1c-df70-475e-95e1-3ecc517c7782 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "POST /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9/action" status: 200 len: 28168 microversion: 2.20 time: 0.169033 Feb 17 04:35:25.823325 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 541/994] 10.222.0.78 () {62 vars in 1309 bytes} [Wed Feb 17 04:35:25 2021] POST /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9/action => generated 28168 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:35:25.980294 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-0a2445ea-21ca-4257-a41c-0d6d42b4b5e6 tempest-VolumesNegativeTest-40300628 tempest-VolumesNegativeTest-40300628-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:35:25.980955 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-0a2445ea-21ca-4257-a41c-0d6d42b4b5e6 tempest-VolumesNegativeTest-40300628 tempest-VolumesNegativeTest-40300628-project] [instance: 8e8ff2f6-f13f-4d01-b305-21d7428638a3] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:35:25.990386 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-0a2445ea-21ca-4257-a41c-0d6d42b4b5e6 tempest-VolumesNegativeTest-40300628 tempest-VolumesNegativeTest-40300628-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:25.990892 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-0a2445ea-21ca-4257-a41c-0d6d42b4b5e6 tempest-VolumesNegativeTest-40300628 tempest-VolumesNegativeTest-40300628-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:25.991762 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-0a2445ea-21ca-4257-a41c-0d6d42b4b5e6 tempest-VolumesNegativeTest-40300628 tempest-VolumesNegativeTest-40300628-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:25.992254 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-0a2445ea-21ca-4257-a41c-0d6d42b4b5e6 tempest-VolumesNegativeTest-40300628 tempest-VolumesNegativeTest-40300628-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:26.125372 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-0a2445ea-21ca-4257-a41c-0d6d42b4b5e6 tempest-VolumesNegativeTest-40300628 tempest-VolumesNegativeTest-40300628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d0d0233aaa4d59afd95d651c8d596f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb7ff276610646ec9b39f6a9c08024c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:35:26.134299 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-0a2445ea-21ca-4257-a41c-0d6d42b4b5e6 tempest-VolumesNegativeTest-40300628 tempest-VolumesNegativeTest-40300628-project] 10.222.0.78 "GET /compute/v2.1/servers/8e8ff2f6-f13f-4d01-b305-21d7428638a3" status: 200 len: 1267 microversion: 2.1 time: 0.158433 Feb 17 04:35:26.139956 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 454/995] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:35:25 2021] GET /compute/v2.1/servers/8e8ff2f6-f13f-4d01-b305-21d7428638a3 => generated 1267 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:35:26.835080 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-0bae1efa-bc1c-4099-8cfe-fb132e37b325 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:35:26.836843 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-0bae1efa-bc1c-4099-8cfe-fb132e37b325 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:35:26.845725 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-0bae1efa-bc1c-4099-8cfe-fb132e37b325 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:26.846233 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-0bae1efa-bc1c-4099-8cfe-fb132e37b325 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:26.847076 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-0bae1efa-bc1c-4099-8cfe-fb132e37b325 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:26.847756 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-0bae1efa-bc1c-4099-8cfe-fb132e37b325 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:26.995749 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-0bae1efa-bc1c-4099-8cfe-fb132e37b325 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "POST /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9/action" status: 200 len: 28168 microversion: 2.20 time: 0.163998 Feb 17 04:35:26.996597 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 542/996] 10.222.0.78 () {62 vars in 1309 bytes} [Wed Feb 17 04:35:26 2021] POST /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9/action => generated 28168 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:35:27.154830 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-80f11f7c-ba8e-4d5e-9a5c-f89e4ace8999 tempest-VolumesNegativeTest-40300628 tempest-VolumesNegativeTest-40300628-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:35:27.155817 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-80f11f7c-ba8e-4d5e-9a5c-f89e4ace8999 tempest-VolumesNegativeTest-40300628 tempest-VolumesNegativeTest-40300628-project] [instance: 8e8ff2f6-f13f-4d01-b305-21d7428638a3] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:35:27.164094 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-80f11f7c-ba8e-4d5e-9a5c-f89e4ace8999 tempest-VolumesNegativeTest-40300628 tempest-VolumesNegativeTest-40300628-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:27.164609 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-80f11f7c-ba8e-4d5e-9a5c-f89e4ace8999 tempest-VolumesNegativeTest-40300628 tempest-VolumesNegativeTest-40300628-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:27.165669 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-80f11f7c-ba8e-4d5e-9a5c-f89e4ace8999 tempest-VolumesNegativeTest-40300628 tempest-VolumesNegativeTest-40300628-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:27.166767 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-80f11f7c-ba8e-4d5e-9a5c-f89e4ace8999 tempest-VolumesNegativeTest-40300628 tempest-VolumesNegativeTest-40300628-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:27.308579 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-80f11f7c-ba8e-4d5e-9a5c-f89e4ace8999 tempest-VolumesNegativeTest-40300628 tempest-VolumesNegativeTest-40300628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d0d0233aaa4d59afd95d651c8d596f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb7ff276610646ec9b39f6a9c08024c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:35:27.317307 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-80f11f7c-ba8e-4d5e-9a5c-f89e4ace8999 tempest-VolumesNegativeTest-40300628 tempest-VolumesNegativeTest-40300628-project] 10.222.0.78 "GET /compute/v2.1/servers/8e8ff2f6-f13f-4d01-b305-21d7428638a3" status: 200 len: 1273 microversion: 2.1 time: 0.168408 Feb 17 04:35:27.317907 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 455/997] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:35:27 2021] GET /compute/v2.1/servers/8e8ff2f6-f13f-4d01-b305-21d7428638a3 => generated 1273 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:35:28.009127 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-2bef847c-2598-4ce5-81d6-3ab719084952 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:35:28.011549 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-2bef847c-2598-4ce5-81d6-3ab719084952 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:35:28.020502 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-2bef847c-2598-4ce5-81d6-3ab719084952 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:28.021096 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-2bef847c-2598-4ce5-81d6-3ab719084952 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:28.021936 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-2bef847c-2598-4ce5-81d6-3ab719084952 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:28.022434 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-2bef847c-2598-4ce5-81d6-3ab719084952 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:28.172998 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-2bef847c-2598-4ce5-81d6-3ab719084952 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "POST /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9/action" status: 200 len: 28168 microversion: 2.20 time: 0.168139 Feb 17 04:35:28.173778 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 543/998] 10.222.0.78 () {62 vars in 1309 bytes} [Wed Feb 17 04:35:28 2021] POST /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9/action => generated 28168 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:35:28.336429 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-29cb7f97-8d5e-4311-963b-4a79507ae651 tempest-VolumesNegativeTest-40300628 tempest-VolumesNegativeTest-40300628-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:35:28.337102 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-29cb7f97-8d5e-4311-963b-4a79507ae651 tempest-VolumesNegativeTest-40300628 tempest-VolumesNegativeTest-40300628-project] [instance: 8e8ff2f6-f13f-4d01-b305-21d7428638a3] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:35:28.345549 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-29cb7f97-8d5e-4311-963b-4a79507ae651 tempest-VolumesNegativeTest-40300628 tempest-VolumesNegativeTest-40300628-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:28.346026 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-29cb7f97-8d5e-4311-963b-4a79507ae651 tempest-VolumesNegativeTest-40300628 tempest-VolumesNegativeTest-40300628-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:28.346873 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-29cb7f97-8d5e-4311-963b-4a79507ae651 tempest-VolumesNegativeTest-40300628 tempest-VolumesNegativeTest-40300628-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:28.347413 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-29cb7f97-8d5e-4311-963b-4a79507ae651 tempest-VolumesNegativeTest-40300628 tempest-VolumesNegativeTest-40300628-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:28.934187 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-29cb7f97-8d5e-4311-963b-4a79507ae651 tempest-VolumesNegativeTest-40300628 tempest-VolumesNegativeTest-40300628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d0d0233aaa4d59afd95d651c8d596f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb7ff276610646ec9b39f6a9c08024c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:35:28.943742 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-29cb7f97-8d5e-4311-963b-4a79507ae651 tempest-VolumesNegativeTest-40300628 tempest-VolumesNegativeTest-40300628-project] 10.222.0.78 "GET /compute/v2.1/servers/8e8ff2f6-f13f-4d01-b305-21d7428638a3" status: 200 len: 1315 microversion: 2.1 time: 0.611127 Feb 17 04:35:28.944349 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 456/999] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:35:28 2021] GET /compute/v2.1/servers/8e8ff2f6-f13f-4d01-b305-21d7428638a3 => generated 1315 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:35:29.186044 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-f79cc332-839f-4d94-bf56-1c9b3a3215e8 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:35:29.187274 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-f79cc332-839f-4d94-bf56-1c9b3a3215e8 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:35:29.196362 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-f79cc332-839f-4d94-bf56-1c9b3a3215e8 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:29.196891 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-f79cc332-839f-4d94-bf56-1c9b3a3215e8 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:29.198522 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-f79cc332-839f-4d94-bf56-1c9b3a3215e8 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:29.199470 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-f79cc332-839f-4d94-bf56-1c9b3a3215e8 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:29.356107 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [req-358c2d45-ddc5-4769-bd9b-02c690cd0bdd req-75709e54-1810-425e-8143-f59ec93f80f1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8e8ff2f6-f13f-4d01-b305-21d7428638a3", "tag": "e9621f3c-aa13-4fb3-93f1-d457d6828a83"}]} {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:35:29.358015 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:35:29.358015 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: warnings.warn(msg) Feb 17 04:35:29.364622 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-f79cc332-839f-4d94-bf56-1c9b3a3215e8 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "POST /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9/action" status: 200 len: 28168 microversion: 2.20 time: 0.169152 Feb 17 04:35:29.365533 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 544/1000] 10.222.0.78 () {62 vars in 1309 bytes} [Wed Feb 17 04:35:29 2021] POST /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9/action => generated 28168 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:35:29.374885 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [req-358c2d45-ddc5-4769-bd9b-02c690cd0bdd req-75709e54-1810-425e-8143-f59ec93f80f1 service nova] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:29.375351 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [req-358c2d45-ddc5-4769-bd9b-02c690cd0bdd req-75709e54-1810-425e-8143-f59ec93f80f1 service nova] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:29.394373 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.compute.server_external_events [req-358c2d45-ddc5-4769-bd9b-02c690cd0bdd req-75709e54-1810-425e-8143-f59ec93f80f1 service nova] Creating event network-changed:e9621f3c-aa13-4fb3-93f1-d457d6828a83 for instance 8e8ff2f6-f13f-4d01-b305-21d7428638a3 on hv-cinder-75998 Feb 17 04:35:29.399433 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [req-358c2d45-ddc5-4769-bd9b-02c690cd0bdd req-75709e54-1810-425e-8143-f59ec93f80f1 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047228 Feb 17 04:35:29.400103 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 457/1001] 10.222.0.78 () {64 vars in 1308 bytes} [Wed Feb 17 04:35:29 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 17 04:35:29.962619 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-05e31297-d55c-4b26-88ad-9e4002dda110 tempest-VolumesNegativeTest-40300628 tempest-VolumesNegativeTest-40300628-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:35:29.964366 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-05e31297-d55c-4b26-88ad-9e4002dda110 tempest-VolumesNegativeTest-40300628 tempest-VolumesNegativeTest-40300628-project] [instance: 8e8ff2f6-f13f-4d01-b305-21d7428638a3] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:35:29.972956 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-05e31297-d55c-4b26-88ad-9e4002dda110 tempest-VolumesNegativeTest-40300628 tempest-VolumesNegativeTest-40300628-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:29.973461 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-05e31297-d55c-4b26-88ad-9e4002dda110 tempest-VolumesNegativeTest-40300628 tempest-VolumesNegativeTest-40300628-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:29.974297 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-05e31297-d55c-4b26-88ad-9e4002dda110 tempest-VolumesNegativeTest-40300628 tempest-VolumesNegativeTest-40300628-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:29.974783 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-05e31297-d55c-4b26-88ad-9e4002dda110 tempest-VolumesNegativeTest-40300628 tempest-VolumesNegativeTest-40300628-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:30.192996 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-05e31297-d55c-4b26-88ad-9e4002dda110 tempest-VolumesNegativeTest-40300628 tempest-VolumesNegativeTest-40300628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d0d0233aaa4d59afd95d651c8d596f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb7ff276610646ec9b39f6a9c08024c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:35:30.202325 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-05e31297-d55c-4b26-88ad-9e4002dda110 tempest-VolumesNegativeTest-40300628 tempest-VolumesNegativeTest-40300628-project] 10.222.0.78 "GET /compute/v2.1/servers/8e8ff2f6-f13f-4d01-b305-21d7428638a3" status: 200 len: 1315 microversion: 2.1 time: 0.244237 Feb 17 04:35:30.202927 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 545/1002] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:35:29 2021] GET /compute/v2.1/servers/8e8ff2f6-f13f-4d01-b305-21d7428638a3 => generated 1315 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:35:30.378943 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-c27a2afc-7ae0-484b-b5ef-0bec59e312dc tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:35:30.380230 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-c27a2afc-7ae0-484b-b5ef-0bec59e312dc tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:35:30.389015 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-c27a2afc-7ae0-484b-b5ef-0bec59e312dc tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:30.389584 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-c27a2afc-7ae0-484b-b5ef-0bec59e312dc tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:30.390441 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-c27a2afc-7ae0-484b-b5ef-0bec59e312dc tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:30.390940 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-c27a2afc-7ae0-484b-b5ef-0bec59e312dc tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:30.630132 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-c27a2afc-7ae0-484b-b5ef-0bec59e312dc tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "POST /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9/action" status: 200 len: 28168 microversion: 2.20 time: 0.255538 Feb 17 04:35:30.634353 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 458/1003] 10.222.0.78 () {62 vars in 1309 bytes} [Wed Feb 17 04:35:30 2021] POST /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9/action => generated 28168 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:35:31.220653 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-43a8fd78-ce0f-4f35-9c6a-24a09ebdd341 tempest-VolumesNegativeTest-40300628 tempest-VolumesNegativeTest-40300628-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:35:31.221326 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-43a8fd78-ce0f-4f35-9c6a-24a09ebdd341 tempest-VolumesNegativeTest-40300628 tempest-VolumesNegativeTest-40300628-project] [instance: 8e8ff2f6-f13f-4d01-b305-21d7428638a3] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:35:31.229873 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-43a8fd78-ce0f-4f35-9c6a-24a09ebdd341 tempest-VolumesNegativeTest-40300628 tempest-VolumesNegativeTest-40300628-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:31.230352 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-43a8fd78-ce0f-4f35-9c6a-24a09ebdd341 tempest-VolumesNegativeTest-40300628 tempest-VolumesNegativeTest-40300628-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:31.231195 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-43a8fd78-ce0f-4f35-9c6a-24a09ebdd341 tempest-VolumesNegativeTest-40300628 tempest-VolumesNegativeTest-40300628-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:31.231680 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-43a8fd78-ce0f-4f35-9c6a-24a09ebdd341 tempest-VolumesNegativeTest-40300628 tempest-VolumesNegativeTest-40300628-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:31.444758 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-43a8fd78-ce0f-4f35-9c6a-24a09ebdd341 tempest-VolumesNegativeTest-40300628 tempest-VolumesNegativeTest-40300628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d0d0233aaa4d59afd95d651c8d596f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb7ff276610646ec9b39f6a9c08024c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:35:31.457651 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-43a8fd78-ce0f-4f35-9c6a-24a09ebdd341 tempest-VolumesNegativeTest-40300628 tempest-VolumesNegativeTest-40300628-project] 10.222.0.78 "GET /compute/v2.1/servers/8e8ff2f6-f13f-4d01-b305-21d7428638a3" status: 200 len: 1315 microversion: 2.1 time: 0.241071 Feb 17 04:35:31.458271 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 546/1004] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:35:31 2021] GET /compute/v2.1/servers/8e8ff2f6-f13f-4d01-b305-21d7428638a3 => generated 1315 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:35:31.643274 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-e4228cee-4abf-4078-9022-78f42b12002d tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:35:31.644534 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-e4228cee-4abf-4078-9022-78f42b12002d tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:35:31.653226 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-e4228cee-4abf-4078-9022-78f42b12002d tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:31.653746 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-e4228cee-4abf-4078-9022-78f42b12002d tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:31.654598 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-e4228cee-4abf-4078-9022-78f42b12002d tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:31.655119 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-e4228cee-4abf-4078-9022-78f42b12002d tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:31.831790 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-e4228cee-4abf-4078-9022-78f42b12002d tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "POST /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9/action" status: 200 len: 28168 microversion: 2.20 time: 0.192796 Feb 17 04:35:31.832495 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 459/1005] 10.222.0.78 () {62 vars in 1309 bytes} [Wed Feb 17 04:35:31 2021] POST /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9/action => generated 28168 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:35:32.476429 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-66cd6231-1e81-43fc-92e9-515a8309a384 tempest-VolumesNegativeTest-40300628 tempest-VolumesNegativeTest-40300628-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:35:32.477157 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-66cd6231-1e81-43fc-92e9-515a8309a384 tempest-VolumesNegativeTest-40300628 tempest-VolumesNegativeTest-40300628-project] [instance: 8e8ff2f6-f13f-4d01-b305-21d7428638a3] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:35:32.485283 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-66cd6231-1e81-43fc-92e9-515a8309a384 tempest-VolumesNegativeTest-40300628 tempest-VolumesNegativeTest-40300628-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:32.485793 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-66cd6231-1e81-43fc-92e9-515a8309a384 tempest-VolumesNegativeTest-40300628 tempest-VolumesNegativeTest-40300628-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:32.486681 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-66cd6231-1e81-43fc-92e9-515a8309a384 tempest-VolumesNegativeTest-40300628 tempest-VolumesNegativeTest-40300628-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:32.487204 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-66cd6231-1e81-43fc-92e9-515a8309a384 tempest-VolumesNegativeTest-40300628 tempest-VolumesNegativeTest-40300628-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:32.697136 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-66cd6231-1e81-43fc-92e9-515a8309a384 tempest-VolumesNegativeTest-40300628 tempest-VolumesNegativeTest-40300628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d0d0233aaa4d59afd95d651c8d596f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb7ff276610646ec9b39f6a9c08024c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:35:32.705902 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-66cd6231-1e81-43fc-92e9-515a8309a384 tempest-VolumesNegativeTest-40300628 tempest-VolumesNegativeTest-40300628-project] 10.222.0.78 "GET /compute/v2.1/servers/8e8ff2f6-f13f-4d01-b305-21d7428638a3" status: 200 len: 1315 microversion: 2.1 time: 0.233467 Feb 17 04:35:32.706516 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 547/1006] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:35:32 2021] GET /compute/v2.1/servers/8e8ff2f6-f13f-4d01-b305-21d7428638a3 => generated 1315 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:35:32.844282 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-c4f964b0-8651-4c6c-9677-695bd5c1adf9 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:35:32.845405 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-c4f964b0-8651-4c6c-9677-695bd5c1adf9 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:35:32.854630 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-c4f964b0-8651-4c6c-9677-695bd5c1adf9 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:32.855165 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-c4f964b0-8651-4c6c-9677-695bd5c1adf9 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:32.856015 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-c4f964b0-8651-4c6c-9677-695bd5c1adf9 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:32.856525 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-c4f964b0-8651-4c6c-9677-695bd5c1adf9 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:32.989652 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-c4f964b0-8651-4c6c-9677-695bd5c1adf9 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "POST /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9/action" status: 200 len: 28168 microversion: 2.20 time: 0.149812 Feb 17 04:35:32.990431 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 460/1007] 10.222.0.78 () {62 vars in 1309 bytes} [Wed Feb 17 04:35:32 2021] POST /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9/action => generated 28168 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:35:33.724031 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-b42c34cc-47f5-4e73-94c9-4dc1cb9683a4 tempest-VolumesNegativeTest-40300628 tempest-VolumesNegativeTest-40300628-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:35:33.724700 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-b42c34cc-47f5-4e73-94c9-4dc1cb9683a4 tempest-VolumesNegativeTest-40300628 tempest-VolumesNegativeTest-40300628-project] [instance: 8e8ff2f6-f13f-4d01-b305-21d7428638a3] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:35:33.733738 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-b42c34cc-47f5-4e73-94c9-4dc1cb9683a4 tempest-VolumesNegativeTest-40300628 tempest-VolumesNegativeTest-40300628-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:33.734495 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-b42c34cc-47f5-4e73-94c9-4dc1cb9683a4 tempest-VolumesNegativeTest-40300628 tempest-VolumesNegativeTest-40300628-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:33.735361 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-b42c34cc-47f5-4e73-94c9-4dc1cb9683a4 tempest-VolumesNegativeTest-40300628 tempest-VolumesNegativeTest-40300628-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:33.735857 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-b42c34cc-47f5-4e73-94c9-4dc1cb9683a4 tempest-VolumesNegativeTest-40300628 tempest-VolumesNegativeTest-40300628-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:33.946051 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-b42c34cc-47f5-4e73-94c9-4dc1cb9683a4 tempest-VolumesNegativeTest-40300628 tempest-VolumesNegativeTest-40300628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d0d0233aaa4d59afd95d651c8d596f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb7ff276610646ec9b39f6a9c08024c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:35:33.954725 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-b42c34cc-47f5-4e73-94c9-4dc1cb9683a4 tempest-VolumesNegativeTest-40300628 tempest-VolumesNegativeTest-40300628-project] 10.222.0.78 "GET /compute/v2.1/servers/8e8ff2f6-f13f-4d01-b305-21d7428638a3" status: 200 len: 1315 microversion: 2.1 time: 0.234687 Feb 17 04:35:33.955379 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 548/1008] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:35:33 2021] GET /compute/v2.1/servers/8e8ff2f6-f13f-4d01-b305-21d7428638a3 => generated 1315 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:35:34.002881 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-94d7ffd4-daa8-4a7f-a3ba-e6dd63216ffe tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:35:34.003984 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-94d7ffd4-daa8-4a7f-a3ba-e6dd63216ffe tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:35:34.013359 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-94d7ffd4-daa8-4a7f-a3ba-e6dd63216ffe tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:34.013877 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-94d7ffd4-daa8-4a7f-a3ba-e6dd63216ffe tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:34.014736 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-94d7ffd4-daa8-4a7f-a3ba-e6dd63216ffe tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:34.015271 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-94d7ffd4-daa8-4a7f-a3ba-e6dd63216ffe tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:34.356293 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-94d7ffd4-daa8-4a7f-a3ba-e6dd63216ffe tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "POST /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9/action" status: 200 len: 28168 microversion: 2.20 time: 0.357805 Feb 17 04:35:34.356935 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 461/1009] 10.222.0.78 () {62 vars in 1309 bytes} [Wed Feb 17 04:35:33 2021] POST /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9/action => generated 28168 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:35:34.973388 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-68b7233d-902a-4e0e-ac88-4912f9939014 tempest-VolumesNegativeTest-40300628 tempest-VolumesNegativeTest-40300628-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:35:34.974070 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-68b7233d-902a-4e0e-ac88-4912f9939014 tempest-VolumesNegativeTest-40300628 tempest-VolumesNegativeTest-40300628-project] [instance: 8e8ff2f6-f13f-4d01-b305-21d7428638a3] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:35:34.982065 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-68b7233d-902a-4e0e-ac88-4912f9939014 tempest-VolumesNegativeTest-40300628 tempest-VolumesNegativeTest-40300628-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:34.982575 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-68b7233d-902a-4e0e-ac88-4912f9939014 tempest-VolumesNegativeTest-40300628 tempest-VolumesNegativeTest-40300628-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:34.983435 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-68b7233d-902a-4e0e-ac88-4912f9939014 tempest-VolumesNegativeTest-40300628 tempest-VolumesNegativeTest-40300628-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:34.983929 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-68b7233d-902a-4e0e-ac88-4912f9939014 tempest-VolumesNegativeTest-40300628 tempest-VolumesNegativeTest-40300628-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:35.200094 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-68b7233d-902a-4e0e-ac88-4912f9939014 tempest-VolumesNegativeTest-40300628 tempest-VolumesNegativeTest-40300628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d0d0233aaa4d59afd95d651c8d596f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb7ff276610646ec9b39f6a9c08024c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:35:35.209031 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-68b7233d-902a-4e0e-ac88-4912f9939014 tempest-VolumesNegativeTest-40300628 tempest-VolumesNegativeTest-40300628-project] 10.222.0.78 "GET /compute/v2.1/servers/8e8ff2f6-f13f-4d01-b305-21d7428638a3" status: 200 len: 1315 microversion: 2.1 time: 0.239765 Feb 17 04:35:35.209625 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 549/1010] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:35:34 2021] GET /compute/v2.1/servers/8e8ff2f6-f13f-4d01-b305-21d7428638a3 => generated 1315 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:35:35.369149 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-f33f8bbd-90c0-4d63-bd07-4222874819be tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:35:35.370280 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-f33f8bbd-90c0-4d63-bd07-4222874819be tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:35:35.378810 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-f33f8bbd-90c0-4d63-bd07-4222874819be tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:35.379356 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-f33f8bbd-90c0-4d63-bd07-4222874819be tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:35.380198 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-f33f8bbd-90c0-4d63-bd07-4222874819be tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:35.380695 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-f33f8bbd-90c0-4d63-bd07-4222874819be tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:35.528740 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-f33f8bbd-90c0-4d63-bd07-4222874819be tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "POST /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9/action" status: 200 len: 28168 microversion: 2.20 time: 0.163710 Feb 17 04:35:35.530029 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 462/1011] 10.222.0.78 () {62 vars in 1309 bytes} [Wed Feb 17 04:35:35 2021] POST /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9/action => generated 28168 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Feb 17 04:35:36.228072 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-923a8912-8cc5-4819-b094-0128f1fc5ee8 tempest-VolumesNegativeTest-40300628 tempest-VolumesNegativeTest-40300628-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:35:36.228800 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-923a8912-8cc5-4819-b094-0128f1fc5ee8 tempest-VolumesNegativeTest-40300628 tempest-VolumesNegativeTest-40300628-project] [instance: 8e8ff2f6-f13f-4d01-b305-21d7428638a3] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:35:36.237043 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-923a8912-8cc5-4819-b094-0128f1fc5ee8 tempest-VolumesNegativeTest-40300628 tempest-VolumesNegativeTest-40300628-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:36.237545 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-923a8912-8cc5-4819-b094-0128f1fc5ee8 tempest-VolumesNegativeTest-40300628 tempest-VolumesNegativeTest-40300628-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:36.238369 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-923a8912-8cc5-4819-b094-0128f1fc5ee8 tempest-VolumesNegativeTest-40300628 tempest-VolumesNegativeTest-40300628-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:36.238854 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-923a8912-8cc5-4819-b094-0128f1fc5ee8 tempest-VolumesNegativeTest-40300628 tempest-VolumesNegativeTest-40300628-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:36.452849 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-923a8912-8cc5-4819-b094-0128f1fc5ee8 tempest-VolumesNegativeTest-40300628 tempest-VolumesNegativeTest-40300628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d0d0233aaa4d59afd95d651c8d596f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb7ff276610646ec9b39f6a9c08024c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:35:36.461653 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-923a8912-8cc5-4819-b094-0128f1fc5ee8 tempest-VolumesNegativeTest-40300628 tempest-VolumesNegativeTest-40300628-project] 10.222.0.78 "GET /compute/v2.1/servers/8e8ff2f6-f13f-4d01-b305-21d7428638a3" status: 200 len: 1315 microversion: 2.1 time: 0.237512 Feb 17 04:35:36.462243 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 550/1012] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:35:36 2021] GET /compute/v2.1/servers/8e8ff2f6-f13f-4d01-b305-21d7428638a3 => generated 1315 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:35:36.541925 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-32420270-57e2-4077-8b91-c9bd09427581 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:35:36.543622 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-32420270-57e2-4077-8b91-c9bd09427581 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:35:36.552199 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-32420270-57e2-4077-8b91-c9bd09427581 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:36.552716 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-32420270-57e2-4077-8b91-c9bd09427581 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:36.553560 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-32420270-57e2-4077-8b91-c9bd09427581 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:36.554065 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-32420270-57e2-4077-8b91-c9bd09427581 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:36.705138 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-32420270-57e2-4077-8b91-c9bd09427581 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "POST /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9/action" status: 200 len: 28168 microversion: 2.20 time: 0.167509 Feb 17 04:35:36.706069 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 463/1013] 10.222.0.78 () {62 vars in 1309 bytes} [Wed Feb 17 04:35:36 2021] POST /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9/action => generated 28168 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:35:37.481804 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-dd1e5fdc-044c-445b-ae5f-9c93df6e4bea tempest-VolumesNegativeTest-40300628 tempest-VolumesNegativeTest-40300628-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:35:37.482481 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-dd1e5fdc-044c-445b-ae5f-9c93df6e4bea tempest-VolumesNegativeTest-40300628 tempest-VolumesNegativeTest-40300628-project] [instance: 8e8ff2f6-f13f-4d01-b305-21d7428638a3] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:35:37.490646 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-dd1e5fdc-044c-445b-ae5f-9c93df6e4bea tempest-VolumesNegativeTest-40300628 tempest-VolumesNegativeTest-40300628-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:37.491215 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-dd1e5fdc-044c-445b-ae5f-9c93df6e4bea tempest-VolumesNegativeTest-40300628 tempest-VolumesNegativeTest-40300628-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:37.492061 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-dd1e5fdc-044c-445b-ae5f-9c93df6e4bea tempest-VolumesNegativeTest-40300628 tempest-VolumesNegativeTest-40300628-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:37.492549 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-dd1e5fdc-044c-445b-ae5f-9c93df6e4bea tempest-VolumesNegativeTest-40300628 tempest-VolumesNegativeTest-40300628-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:37.709197 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-dd1e5fdc-044c-445b-ae5f-9c93df6e4bea tempest-VolumesNegativeTest-40300628 tempest-VolumesNegativeTest-40300628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d0d0233aaa4d59afd95d651c8d596f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb7ff276610646ec9b39f6a9c08024c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:35:37.718949 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-dd1e5fdc-044c-445b-ae5f-9c93df6e4bea tempest-VolumesNegativeTest-40300628 tempest-VolumesNegativeTest-40300628-project] 10.222.0.78 "GET /compute/v2.1/servers/8e8ff2f6-f13f-4d01-b305-21d7428638a3" status: 200 len: 1315 microversion: 2.1 time: 0.242890 Feb 17 04:35:37.719395 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-3586e569-dbc3-4327-873e-23c9a81e1aef tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:35:37.719846 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 551/1014] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:35:37 2021] GET /compute/v2.1/servers/8e8ff2f6-f13f-4d01-b305-21d7428638a3 => generated 1315 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:35:37.721025 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-3586e569-dbc3-4327-873e-23c9a81e1aef tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:35:37.729286 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-3586e569-dbc3-4327-873e-23c9a81e1aef tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:37.729925 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-3586e569-dbc3-4327-873e-23c9a81e1aef tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:37.731959 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-3586e569-dbc3-4327-873e-23c9a81e1aef tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:37.732500 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-3586e569-dbc3-4327-873e-23c9a81e1aef tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:37.875685 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-3586e569-dbc3-4327-873e-23c9a81e1aef tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "POST /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9/action" status: 200 len: 28168 microversion: 2.20 time: 0.161770 Feb 17 04:35:37.879970 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 464/1015] 10.222.0.78 () {62 vars in 1309 bytes} [Wed Feb 17 04:35:37 2021] POST /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9/action => generated 28168 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:35:38.739419 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-96ca8391-b85c-4a0b-87d9-0b97146d889b tempest-VolumesNegativeTest-40300628 tempest-VolumesNegativeTest-40300628-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:35:38.740350 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-96ca8391-b85c-4a0b-87d9-0b97146d889b tempest-VolumesNegativeTest-40300628 tempest-VolumesNegativeTest-40300628-project] [instance: 8e8ff2f6-f13f-4d01-b305-21d7428638a3] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:35:38.749473 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-96ca8391-b85c-4a0b-87d9-0b97146d889b tempest-VolumesNegativeTest-40300628 tempest-VolumesNegativeTest-40300628-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:38.749980 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-96ca8391-b85c-4a0b-87d9-0b97146d889b tempest-VolumesNegativeTest-40300628 tempest-VolumesNegativeTest-40300628-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:38.750828 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-96ca8391-b85c-4a0b-87d9-0b97146d889b tempest-VolumesNegativeTest-40300628 tempest-VolumesNegativeTest-40300628-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:38.751349 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-96ca8391-b85c-4a0b-87d9-0b97146d889b tempest-VolumesNegativeTest-40300628 tempest-VolumesNegativeTest-40300628-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:38.890205 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-a9c4b688-9d6f-4058-bc76-a20a4a44e01b tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:35:38.891411 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-a9c4b688-9d6f-4058-bc76-a20a4a44e01b tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:35:38.899948 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-a9c4b688-9d6f-4058-bc76-a20a4a44e01b tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:38.900459 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-a9c4b688-9d6f-4058-bc76-a20a4a44e01b tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:38.901345 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-a9c4b688-9d6f-4058-bc76-a20a4a44e01b tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:38.903185 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-a9c4b688-9d6f-4058-bc76-a20a4a44e01b tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:38.965735 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-96ca8391-b85c-4a0b-87d9-0b97146d889b tempest-VolumesNegativeTest-40300628 tempest-VolumesNegativeTest-40300628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d0d0233aaa4d59afd95d651c8d596f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb7ff276610646ec9b39f6a9c08024c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:35:38.974731 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-96ca8391-b85c-4a0b-87d9-0b97146d889b tempest-VolumesNegativeTest-40300628 tempest-VolumesNegativeTest-40300628-project] 10.222.0.78 "GET /compute/v2.1/servers/8e8ff2f6-f13f-4d01-b305-21d7428638a3" status: 200 len: 1315 microversion: 2.1 time: 0.240557 Feb 17 04:35:38.975369 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 552/1016] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:35:38 2021] GET /compute/v2.1/servers/8e8ff2f6-f13f-4d01-b305-21d7428638a3 => generated 1315 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:35:39.037409 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-a9c4b688-9d6f-4058-bc76-a20a4a44e01b tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "POST /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9/action" status: 200 len: 28168 microversion: 2.20 time: 0.152569 Feb 17 04:35:39.038020 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 465/1017] 10.222.0.78 () {62 vars in 1309 bytes} [Wed Feb 17 04:35:38 2021] POST /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9/action => generated 28168 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Feb 17 04:35:39.773745 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [req-2d393e50-987c-4120-be3a-123c6ed77ad7 req-b2db2374-b3f7-4822-a9f2-25e4dffda638 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e8ff2f6-f13f-4d01-b305-21d7428638a3", "name": "network-vif-plugged", "status": "completed", "tag": "e9621f3c-aa13-4fb3-93f1-d457d6828a83"}]} {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:35:39.775709 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:35:39.775709 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: warnings.warn(msg) Feb 17 04:35:39.785360 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [req-2d393e50-987c-4120-be3a-123c6ed77ad7 req-b2db2374-b3f7-4822-a9f2-25e4dffda638 service nova] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:39.785873 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [req-2d393e50-987c-4120-be3a-123c6ed77ad7 req-b2db2374-b3f7-4822-a9f2-25e4dffda638 service nova] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:39.804258 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.compute.server_external_events [req-2d393e50-987c-4120-be3a-123c6ed77ad7 req-b2db2374-b3f7-4822-a9f2-25e4dffda638 service nova] Creating event network-vif-plugged:e9621f3c-aa13-4fb3-93f1-d457d6828a83 for instance 8e8ff2f6-f13f-4d01-b305-21d7428638a3 on hv-cinder-75998 Feb 17 04:35:39.809439 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [req-2d393e50-987c-4120-be3a-123c6ed77ad7 req-b2db2374-b3f7-4822-a9f2-25e4dffda638 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039669 Feb 17 04:35:39.810274 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 553/1018] 10.222.0.78 () {64 vars in 1308 bytes} [Wed Feb 17 04:35:39 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:35:39.994012 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-95a01156-1071-4661-9c86-74831292a8a1 tempest-VolumesNegativeTest-40300628 tempest-VolumesNegativeTest-40300628-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:35:39.994796 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-95a01156-1071-4661-9c86-74831292a8a1 tempest-VolumesNegativeTest-40300628 tempest-VolumesNegativeTest-40300628-project] [instance: 8e8ff2f6-f13f-4d01-b305-21d7428638a3] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:35:40.003635 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-95a01156-1071-4661-9c86-74831292a8a1 tempest-VolumesNegativeTest-40300628 tempest-VolumesNegativeTest-40300628-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:40.004146 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-95a01156-1071-4661-9c86-74831292a8a1 tempest-VolumesNegativeTest-40300628 tempest-VolumesNegativeTest-40300628-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:40.005009 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-95a01156-1071-4661-9c86-74831292a8a1 tempest-VolumesNegativeTest-40300628 tempest-VolumesNegativeTest-40300628-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:40.005508 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-95a01156-1071-4661-9c86-74831292a8a1 tempest-VolumesNegativeTest-40300628 tempest-VolumesNegativeTest-40300628-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:40.051013 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-7154bc39-9b9d-4a80-a82e-ea172bf00281 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:35:40.052110 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-7154bc39-9b9d-4a80-a82e-ea172bf00281 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:35:40.060914 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-7154bc39-9b9d-4a80-a82e-ea172bf00281 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:40.061434 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-7154bc39-9b9d-4a80-a82e-ea172bf00281 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:40.062297 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-7154bc39-9b9d-4a80-a82e-ea172bf00281 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:40.062796 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-7154bc39-9b9d-4a80-a82e-ea172bf00281 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:40.186624 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-7154bc39-9b9d-4a80-a82e-ea172bf00281 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "POST /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9/action" status: 200 len: 28168 microversion: 2.20 time: 0.139495 Feb 17 04:35:40.186891 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 554/1019] 10.222.0.78 () {62 vars in 1309 bytes} [Wed Feb 17 04:35:40 2021] POST /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9/action => generated 28168 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Feb 17 04:35:40.288330 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-95a01156-1071-4661-9c86-74831292a8a1 tempest-VolumesNegativeTest-40300628 tempest-VolumesNegativeTest-40300628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d0d0233aaa4d59afd95d651c8d596f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb7ff276610646ec9b39f6a9c08024c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:35:40.298208 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-95a01156-1071-4661-9c86-74831292a8a1 tempest-VolumesNegativeTest-40300628 tempest-VolumesNegativeTest-40300628-project] 10.222.0.78 "GET /compute/v2.1/servers/8e8ff2f6-f13f-4d01-b305-21d7428638a3" status: 200 len: 1315 microversion: 2.1 time: 0.308713 Feb 17 04:35:40.298817 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 466/1020] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:35:39 2021] GET /compute/v2.1/servers/8e8ff2f6-f13f-4d01-b305-21d7428638a3 => generated 1315 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:35:41.200132 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-3e329034-88e1-4e47-a3f3-89e303910ba6 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:35:41.201278 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-3e329034-88e1-4e47-a3f3-89e303910ba6 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:35:41.209966 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-3e329034-88e1-4e47-a3f3-89e303910ba6 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:41.210478 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-3e329034-88e1-4e47-a3f3-89e303910ba6 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:41.211347 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-3e329034-88e1-4e47-a3f3-89e303910ba6 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:41.211874 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-3e329034-88e1-4e47-a3f3-89e303910ba6 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:41.317034 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-18f6a3af-8676-4072-8a7d-0a8e4c9aee05 tempest-VolumesNegativeTest-40300628 tempest-VolumesNegativeTest-40300628-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:35:41.317706 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-18f6a3af-8676-4072-8a7d-0a8e4c9aee05 tempest-VolumesNegativeTest-40300628 tempest-VolumesNegativeTest-40300628-project] [instance: 8e8ff2f6-f13f-4d01-b305-21d7428638a3] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:35:41.326957 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-18f6a3af-8676-4072-8a7d-0a8e4c9aee05 tempest-VolumesNegativeTest-40300628 tempest-VolumesNegativeTest-40300628-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:41.327492 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-18f6a3af-8676-4072-8a7d-0a8e4c9aee05 tempest-VolumesNegativeTest-40300628 tempest-VolumesNegativeTest-40300628-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:41.328331 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-18f6a3af-8676-4072-8a7d-0a8e4c9aee05 tempest-VolumesNegativeTest-40300628 tempest-VolumesNegativeTest-40300628-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:41.328828 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-18f6a3af-8676-4072-8a7d-0a8e4c9aee05 tempest-VolumesNegativeTest-40300628 tempest-VolumesNegativeTest-40300628-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:41.391098 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-3e329034-88e1-4e47-a3f3-89e303910ba6 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "POST /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9/action" status: 200 len: 28168 microversion: 2.20 time: 0.195772 Feb 17 04:35:41.392065 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 555/1021] 10.222.0.78 () {62 vars in 1309 bytes} [Wed Feb 17 04:35:41 2021] POST /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9/action => generated 28168 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:35:41.549431 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-18f6a3af-8676-4072-8a7d-0a8e4c9aee05 tempest-VolumesNegativeTest-40300628 tempest-VolumesNegativeTest-40300628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d0d0233aaa4d59afd95d651c8d596f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb7ff276610646ec9b39f6a9c08024c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:35:41.558993 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-18f6a3af-8676-4072-8a7d-0a8e4c9aee05 tempest-VolumesNegativeTest-40300628 tempest-VolumesNegativeTest-40300628-project] 10.222.0.78 "GET /compute/v2.1/servers/8e8ff2f6-f13f-4d01-b305-21d7428638a3" status: 200 len: 1315 microversion: 2.1 time: 0.245207 Feb 17 04:35:41.559627 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 467/1022] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:35:41 2021] GET /compute/v2.1/servers/8e8ff2f6-f13f-4d01-b305-21d7428638a3 => generated 1315 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:35:41.952650 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-4d8a76df-033c-49a5-b0bb-cfa5a40abfe1 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1245641522", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-585983373", "security_groups": [{"name": "tempest-TestShelveInstance-915650034"}], "networks": [{"uuid": "736cba91-156c-4244-b589-a5a8068074fb"}], "block_device_mapping_v2": [{"uuid": "9418b048-163c-4cb7-8984-4b1f20d9a0ca", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:35:42.149314 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.network.neutron [None req-4d8a76df-033c-49a5-b0bb-cfa5a40abfe1 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] validate_networks() for [('736cba91-156c-4244-b589-a5a8068074fb', None, None, None)] {{(pid=98179) validate_networks /opt/stack/nova/nova/network/neutron.py:2345}} Feb 17 04:35:42.404565 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-e4acdaf2-498a-4224-b328-e727ef3dc023 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:35:42.405565 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-e4acdaf2-498a-4224-b328-e727ef3dc023 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:35:42.413437 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-e4acdaf2-498a-4224-b328-e727ef3dc023 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:42.413945 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-e4acdaf2-498a-4224-b328-e727ef3dc023 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:42.414795 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-e4acdaf2-498a-4224-b328-e727ef3dc023 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:42.415350 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-e4acdaf2-498a-4224-b328-e727ef3dc023 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:42.554557 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-e4acdaf2-498a-4224-b328-e727ef3dc023 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "POST /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9/action" status: 200 len: 28168 microversion: 2.20 time: 0.154645 Feb 17 04:35:42.558788 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 468/1023] 10.222.0.78 () {62 vars in 1309 bytes} [Wed Feb 17 04:35:42 2021] POST /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9/action => generated 28168 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Feb 17 04:35:42.578749 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-2cac2dd6-b159-4cd0-9ccf-fd262accad83 tempest-VolumesNegativeTest-40300628 tempest-VolumesNegativeTest-40300628-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:35:42.579558 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-2cac2dd6-b159-4cd0-9ccf-fd262accad83 tempest-VolumesNegativeTest-40300628 tempest-VolumesNegativeTest-40300628-project] [instance: 8e8ff2f6-f13f-4d01-b305-21d7428638a3] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:35:42.588166 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-2cac2dd6-b159-4cd0-9ccf-fd262accad83 tempest-VolumesNegativeTest-40300628 tempest-VolumesNegativeTest-40300628-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:42.588671 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-2cac2dd6-b159-4cd0-9ccf-fd262accad83 tempest-VolumesNegativeTest-40300628 tempest-VolumesNegativeTest-40300628-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:42.590332 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-2cac2dd6-b159-4cd0-9ccf-fd262accad83 tempest-VolumesNegativeTest-40300628 tempest-VolumesNegativeTest-40300628-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:42.590844 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-2cac2dd6-b159-4cd0-9ccf-fd262accad83 tempest-VolumesNegativeTest-40300628 tempest-VolumesNegativeTest-40300628-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:42.750878 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.virt.hardware [None req-4d8a76df-033c-49a5-b0bb-cfa5a40abfe1 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Flavor limits 0:0:0 {{(pid=98179) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 17 04:35:42.751397 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.virt.hardware [None req-4d8a76df-033c-49a5-b0bb-cfa5a40abfe1 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Image limits 0:0:0 {{(pid=98179) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Feb 17 04:35:42.752022 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.virt.hardware [None req-4d8a76df-033c-49a5-b0bb-cfa5a40abfe1 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Flavor pref 0:0:0 {{(pid=98179) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 17 04:35:42.752383 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.virt.hardware [None req-4d8a76df-033c-49a5-b0bb-cfa5a40abfe1 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Image pref 0:0:0 {{(pid=98179) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Feb 17 04:35:42.752848 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.virt.hardware [None req-4d8a76df-033c-49a5-b0bb-cfa5a40abfe1 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98179) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Feb 17 04:35:42.762884 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-4d8a76df-033c-49a5-b0bb-cfa5a40abfe1 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:42.763480 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-4d8a76df-033c-49a5-b0bb-cfa5a40abfe1 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:42.764364 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-4d8a76df-033c-49a5-b0bb-cfa5a40abfe1 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:42.764860 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-4d8a76df-033c-49a5-b0bb-cfa5a40abfe1 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:42.783966 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.quota [None req-4d8a76df-033c-49a5-b0bb-cfa5a40abfe1 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Getting quotas for project 79050d22ac3d4c7eb85cd6a19be9ef10. Resources: {'ram', 'cores', 'instances'} {{(pid=98179) _get_quotas /opt/stack/nova/nova/quota.py:388}} Feb 17 04:35:42.788366 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.quota [None req-4d8a76df-033c-49a5-b0bb-cfa5a40abfe1 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Getting quotas for user fb8b6c44468c498f9dc0d3a8776433d5 and project 79050d22ac3d4c7eb85cd6a19be9ef10. Resources: {'ram', 'cores', 'instances'} {{(pid=98179) _get_quotas /opt/stack/nova/nova/quota.py:380}} Feb 17 04:35:42.806316 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-2cac2dd6-b159-4cd0-9ccf-fd262accad83 tempest-VolumesNegativeTest-40300628 tempest-VolumesNegativeTest-40300628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d0d0233aaa4d59afd95d651c8d596f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb7ff276610646ec9b39f6a9c08024c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:35:42.816356 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-2cac2dd6-b159-4cd0-9ccf-fd262accad83 tempest-VolumesNegativeTest-40300628 tempest-VolumesNegativeTest-40300628-project] 10.222.0.78 "GET /compute/v2.1/servers/8e8ff2f6-f13f-4d01-b305-21d7428638a3" status: 200 len: 1464 microversion: 2.1 time: 0.242808 Feb 17 04:35:42.816959 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 469/1024] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:35:42 2021] GET /compute/v2.1/servers/8e8ff2f6-f13f-4d01-b305-21d7428638a3 => generated 1464 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:35:42.891018 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-c9f3504b-a58c-4422-a71f-8eaab075f15e tempest-VolumesNegativeTest-40300628 tempest-VolumesNegativeTest-40300628-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:35:42.891699 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-c9f3504b-a58c-4422-a71f-8eaab075f15e tempest-VolumesNegativeTest-40300628 tempest-VolumesNegativeTest-40300628-project] [instance: 8e8ff2f6-f13f-4d01-b305-21d7428638a3] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:35:42.899232 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-4d8a76df-033c-49a5-b0bb-cfa5a40abfe1 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Going to run 1 instances... {{(pid=98179) _provision_instances /opt/stack/nova/nova/compute/api.py:1264}} Feb 17 04:35:42.899980 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-c9f3504b-a58c-4422-a71f-8eaab075f15e tempest-VolumesNegativeTest-40300628 tempest-VolumesNegativeTest-40300628-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:42.900527 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-c9f3504b-a58c-4422-a71f-8eaab075f15e tempest-VolumesNegativeTest-40300628 tempest-VolumesNegativeTest-40300628-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:42.901362 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-c9f3504b-a58c-4422-a71f-8eaab075f15e tempest-VolumesNegativeTest-40300628 tempest-VolumesNegativeTest-40300628-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:42.901882 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-4d8a76df-033c-49a5-b0bb-cfa5a40abfe1 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] [instance: 62a16d76-4309-472d-9c9e-6e86b36a653c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='9418b048-163c-4cb7-8984-4b1f20d9a0ca',volume_size=None,volume_type=None)] {{(pid=98179) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1666}} Feb 17 04:35:42.902020 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-c9f3504b-a58c-4422-a71f-8eaab075f15e tempest-VolumesNegativeTest-40300628 tempest-VolumesNegativeTest-40300628-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:42.970631 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-c9f3504b-a58c-4422-a71f-8eaab075f15e tempest-VolumesNegativeTest-40300628 tempest-VolumesNegativeTest-40300628-project] [instance: 8e8ff2f6-f13f-4d01-b305-21d7428638a3] Going to try to terminate instance {{(pid=98178) delete /opt/stack/nova/nova/compute/api.py:2540}} Feb 17 04:35:43.078874 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-4d8a76df-033c-49a5-b0bb-cfa5a40abfe1 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.130797 Feb 17 04:35:43.079635 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 556/1025] 10.222.0.78 () {60 vars in 1137 bytes} [Wed Feb 17 04:35:41 2021] POST /compute/v2.1/servers => generated 409 bytes in 1133 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 17 04:35:43.087968 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-c9f3504b-a58c-4422-a71f-8eaab075f15e tempest-VolumesNegativeTest-40300628 tempest-VolumesNegativeTest-40300628-project] 10.222.0.78 "DELETE /compute/v2.1/servers/8e8ff2f6-f13f-4d01-b305-21d7428638a3" status: 204 len: 0 microversion: 2.1 time: 0.201283 Feb 17 04:35:43.092067 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 470/1026] 10.222.0.78 () {58 vars in 1229 bytes} [Wed Feb 17 04:35:42 2021] DELETE /compute/v2.1/servers/8e8ff2f6-f13f-4d01-b305-21d7428638a3 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 17 04:35:43.092228 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-7d0604a2-c9c3-4b69-920b-599c1d87806c tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:35:43.092228 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-7d0604a2-c9c3-4b69-920b-599c1d87806c tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] [instance: 62a16d76-4309-472d-9c9e-6e86b36a653c] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:35:43.097833 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-7ab20717-7687-4f25-833b-0f0613304956 tempest-VolumesNegativeTest-40300628 tempest-VolumesNegativeTest-40300628-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:35:43.098652 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-7ab20717-7687-4f25-833b-0f0613304956 tempest-VolumesNegativeTest-40300628 tempest-VolumesNegativeTest-40300628-project] [instance: 8e8ff2f6-f13f-4d01-b305-21d7428638a3] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:35:43.107642 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-7ab20717-7687-4f25-833b-0f0613304956 tempest-VolumesNegativeTest-40300628 tempest-VolumesNegativeTest-40300628-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:43.108147 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-7ab20717-7687-4f25-833b-0f0613304956 tempest-VolumesNegativeTest-40300628 tempest-VolumesNegativeTest-40300628-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:43.109000 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-7ab20717-7687-4f25-833b-0f0613304956 tempest-VolumesNegativeTest-40300628 tempest-VolumesNegativeTest-40300628-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:43.109747 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-7ab20717-7687-4f25-833b-0f0613304956 tempest-VolumesNegativeTest-40300628 tempest-VolumesNegativeTest-40300628-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:43.176317 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-7d0604a2-c9c3-4b69-920b-599c1d87806c tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb8b6c44468c498f9dc0d3a8776433d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79050d22ac3d4c7eb85cd6a19be9ef10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:35:43.186053 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-7d0604a2-c9c3-4b69-920b-599c1d87806c tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] 10.222.0.78 "GET /compute/v2.1/servers/62a16d76-4309-472d-9c9e-6e86b36a653c" status: 200 len: 1088 microversion: 2.1 time: 0.099548 Feb 17 04:35:43.187163 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 557/1027] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:35:43 2021] GET /compute/v2.1/servers/62a16d76-4309-472d-9c9e-6e86b36a653c => generated 1088 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:35:43.351323 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-7ab20717-7687-4f25-833b-0f0613304956 tempest-VolumesNegativeTest-40300628 tempest-VolumesNegativeTest-40300628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d0d0233aaa4d59afd95d651c8d596f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb7ff276610646ec9b39f6a9c08024c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:35:43.362223 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-7ab20717-7687-4f25-833b-0f0613304956 tempest-VolumesNegativeTest-40300628 tempest-VolumesNegativeTest-40300628-project] 10.222.0.78 "GET /compute/v2.1/servers/8e8ff2f6-f13f-4d01-b305-21d7428638a3" status: 200 len: 1470 microversion: 2.1 time: 0.268847 Feb 17 04:35:43.363073 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 471/1028] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:35:43 2021] GET /compute/v2.1/servers/8e8ff2f6-f13f-4d01-b305-21d7428638a3 => generated 1470 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:35:43.566619 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-123c890b-27c0-4ace-a79d-8f5af5a97b1f tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:35:43.567910 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-123c890b-27c0-4ace-a79d-8f5af5a97b1f tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:35:43.580632 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-123c890b-27c0-4ace-a79d-8f5af5a97b1f tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:43.581141 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-123c890b-27c0-4ace-a79d-8f5af5a97b1f tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:43.581991 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-123c890b-27c0-4ace-a79d-8f5af5a97b1f tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:43.582484 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-123c890b-27c0-4ace-a79d-8f5af5a97b1f tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:43.749279 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-123c890b-27c0-4ace-a79d-8f5af5a97b1f tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "POST /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9/action" status: 200 len: 28168 microversion: 2.20 time: 0.186593 Feb 17 04:35:43.750827 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 558/1029] 10.222.0.78 () {62 vars in 1309 bytes} [Wed Feb 17 04:35:43 2021] POST /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9/action => generated 28168 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Feb 17 04:35:44.206247 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-c3a448fb-547d-4583-bd94-afee88aff350 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:35:44.206923 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-c3a448fb-547d-4583-bd94-afee88aff350 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] [instance: 62a16d76-4309-472d-9c9e-6e86b36a653c] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:35:44.216040 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-c3a448fb-547d-4583-bd94-afee88aff350 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:44.216548 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-c3a448fb-547d-4583-bd94-afee88aff350 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:44.217398 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-c3a448fb-547d-4583-bd94-afee88aff350 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:44.217893 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-c3a448fb-547d-4583-bd94-afee88aff350 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:44.346213 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-c3a448fb-547d-4583-bd94-afee88aff350 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb8b6c44468c498f9dc0d3a8776433d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79050d22ac3d4c7eb85cd6a19be9ef10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:35:44.355134 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-c3a448fb-547d-4583-bd94-afee88aff350 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] 10.222.0.78 "GET /compute/v2.1/servers/62a16d76-4309-472d-9c9e-6e86b36a653c" status: 200 len: 1186 microversion: 2.1 time: 0.152759 Feb 17 04:35:44.355741 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 472/1030] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:35:44 2021] GET /compute/v2.1/servers/62a16d76-4309-472d-9c9e-6e86b36a653c => generated 1186 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:35:44.382624 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-a99cb927-2024-4278-9f6f-f6a6bed4a7b8 tempest-VolumesNegativeTest-40300628 tempest-VolumesNegativeTest-40300628-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:35:44.383450 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-a99cb927-2024-4278-9f6f-f6a6bed4a7b8 tempest-VolumesNegativeTest-40300628 tempest-VolumesNegativeTest-40300628-project] [instance: 8e8ff2f6-f13f-4d01-b305-21d7428638a3] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:35:44.393628 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-a99cb927-2024-4278-9f6f-f6a6bed4a7b8 tempest-VolumesNegativeTest-40300628 tempest-VolumesNegativeTest-40300628-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:44.394134 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-a99cb927-2024-4278-9f6f-f6a6bed4a7b8 tempest-VolumesNegativeTest-40300628 tempest-VolumesNegativeTest-40300628-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:44.394998 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-a99cb927-2024-4278-9f6f-f6a6bed4a7b8 tempest-VolumesNegativeTest-40300628 tempest-VolumesNegativeTest-40300628-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:44.395513 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-a99cb927-2024-4278-9f6f-f6a6bed4a7b8 tempest-VolumesNegativeTest-40300628 tempest-VolumesNegativeTest-40300628-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:44.629328 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-a99cb927-2024-4278-9f6f-f6a6bed4a7b8 tempest-VolumesNegativeTest-40300628 tempest-VolumesNegativeTest-40300628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d0d0233aaa4d59afd95d651c8d596f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb7ff276610646ec9b39f6a9c08024c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:35:44.639417 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-a99cb927-2024-4278-9f6f-f6a6bed4a7b8 tempest-VolumesNegativeTest-40300628 tempest-VolumesNegativeTest-40300628-project] 10.222.0.78 "GET /compute/v2.1/servers/8e8ff2f6-f13f-4d01-b305-21d7428638a3" status: 200 len: 1470 microversion: 2.1 time: 0.261426 Feb 17 04:35:44.640041 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 559/1031] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:35:44 2021] GET /compute/v2.1/servers/8e8ff2f6-f13f-4d01-b305-21d7428638a3 => generated 1470 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:35:44.762416 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-946bbf50-4766-41e9-be6e-a6a8f262ed79 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:35:44.763527 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-946bbf50-4766-41e9-be6e-a6a8f262ed79 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:35:44.771631 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-946bbf50-4766-41e9-be6e-a6a8f262ed79 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:44.772146 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-946bbf50-4766-41e9-be6e-a6a8f262ed79 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:44.773039 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-946bbf50-4766-41e9-be6e-a6a8f262ed79 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:44.773538 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-946bbf50-4766-41e9-be6e-a6a8f262ed79 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:44.992333 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-946bbf50-4766-41e9-be6e-a6a8f262ed79 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "POST /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9/action" status: 200 len: 28168 microversion: 2.20 time: 0.234417 Feb 17 04:35:44.997212 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 473/1032] 10.222.0.78 () {62 vars in 1309 bytes} [Wed Feb 17 04:35:44 2021] POST /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9/action => generated 28168 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:35:45.375848 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-b468a498-3bba-4d87-9960-d6a87ae7dee5 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:35:45.376457 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-b468a498-3bba-4d87-9960-d6a87ae7dee5 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] [instance: 62a16d76-4309-472d-9c9e-6e86b36a653c] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:35:45.385015 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-b468a498-3bba-4d87-9960-d6a87ae7dee5 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:45.385535 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-b468a498-3bba-4d87-9960-d6a87ae7dee5 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:45.386570 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-b468a498-3bba-4d87-9960-d6a87ae7dee5 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:45.387740 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-b468a498-3bba-4d87-9960-d6a87ae7dee5 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:45.533273 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-b468a498-3bba-4d87-9960-d6a87ae7dee5 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb8b6c44468c498f9dc0d3a8776433d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79050d22ac3d4c7eb85cd6a19be9ef10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:35:45.544301 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-b468a498-3bba-4d87-9960-d6a87ae7dee5 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] 10.222.0.78 "GET /compute/v2.1/servers/62a16d76-4309-472d-9c9e-6e86b36a653c" status: 200 len: 1204 microversion: 2.1 time: 0.172745 Feb 17 04:35:45.545130 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 560/1033] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:35:45 2021] GET /compute/v2.1/servers/62a16d76-4309-472d-9c9e-6e86b36a653c => generated 1204 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:35:45.661698 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-b20a6de1-b2d8-49df-9bba-f00058fd33be tempest-VolumesNegativeTest-40300628 tempest-VolumesNegativeTest-40300628-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:35:45.663001 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-b20a6de1-b2d8-49df-9bba-f00058fd33be tempest-VolumesNegativeTest-40300628 tempest-VolumesNegativeTest-40300628-project] [instance: 8e8ff2f6-f13f-4d01-b305-21d7428638a3] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:35:45.672124 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-b20a6de1-b2d8-49df-9bba-f00058fd33be tempest-VolumesNegativeTest-40300628 tempest-VolumesNegativeTest-40300628-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:45.672647 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-b20a6de1-b2d8-49df-9bba-f00058fd33be tempest-VolumesNegativeTest-40300628 tempest-VolumesNegativeTest-40300628-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:45.673512 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-b20a6de1-b2d8-49df-9bba-f00058fd33be tempest-VolumesNegativeTest-40300628 tempest-VolumesNegativeTest-40300628-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:45.674124 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-b20a6de1-b2d8-49df-9bba-f00058fd33be tempest-VolumesNegativeTest-40300628 tempest-VolumesNegativeTest-40300628-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:46.005928 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-a300470c-f3ac-4d11-af2d-34c36d27e442 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:35:46.007483 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-a300470c-f3ac-4d11-af2d-34c36d27e442 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:35:46.016032 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-a300470c-f3ac-4d11-af2d-34c36d27e442 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:46.016533 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-a300470c-f3ac-4d11-af2d-34c36d27e442 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:46.017374 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-a300470c-f3ac-4d11-af2d-34c36d27e442 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:46.017861 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-a300470c-f3ac-4d11-af2d-34c36d27e442 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:46.192581 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-a300470c-f3ac-4d11-af2d-34c36d27e442 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "POST /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9/action" status: 200 len: 28183 microversion: 2.20 time: 0.191295 Feb 17 04:35:46.197308 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 561/1034] 10.222.0.78 () {62 vars in 1309 bytes} [Wed Feb 17 04:35:45 2021] POST /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9/action => generated 28183 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Feb 17 04:35:46.377719 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [req-17fcd922-a692-4b1b-a709-b5d889cd5a38 req-ff1bd2fa-bcf9-44c1-b847-b99e2fcde3eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e8ff2f6-f13f-4d01-b305-21d7428638a3", "name": "network-vif-unplugged", "status": "completed", "tag": "e9621f3c-aa13-4fb3-93f1-d457d6828a83"}]} {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:35:46.379430 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:35:46.379430 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: warnings.warn(msg) Feb 17 04:35:46.389465 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [req-17fcd922-a692-4b1b-a709-b5d889cd5a38 req-ff1bd2fa-bcf9-44c1-b847-b99e2fcde3eb service nova] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:46.390020 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [req-17fcd922-a692-4b1b-a709-b5d889cd5a38 req-ff1bd2fa-bcf9-44c1-b847-b99e2fcde3eb service nova] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:46.399188 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-b20a6de1-b2d8-49df-9bba-f00058fd33be tempest-VolumesNegativeTest-40300628 tempest-VolumesNegativeTest-40300628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d0d0233aaa4d59afd95d651c8d596f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb7ff276610646ec9b39f6a9c08024c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:35:46.409641 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.compute.server_external_events [req-17fcd922-a692-4b1b-a709-b5d889cd5a38 req-ff1bd2fa-bcf9-44c1-b847-b99e2fcde3eb service nova] Creating event network-vif-unplugged:e9621f3c-aa13-4fb3-93f1-d457d6828a83 for instance 8e8ff2f6-f13f-4d01-b305-21d7428638a3 on hv-cinder-75998 Feb 17 04:35:46.414001 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-b20a6de1-b2d8-49df-9bba-f00058fd33be tempest-VolumesNegativeTest-40300628 tempest-VolumesNegativeTest-40300628-project] 10.222.0.78 "GET /compute/v2.1/servers/8e8ff2f6-f13f-4d01-b305-21d7428638a3" status: 200 len: 1470 microversion: 2.1 time: 0.759717 Feb 17 04:35:46.415111 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [req-17fcd922-a692-4b1b-a709-b5d889cd5a38 req-ff1bd2fa-bcf9-44c1-b847-b99e2fcde3eb service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.041831 Feb 17 04:35:46.416637 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 474/1035] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:35:45 2021] GET /compute/v2.1/servers/8e8ff2f6-f13f-4d01-b305-21d7428638a3 => generated 1470 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:35:46.419273 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 562/1036] 10.222.0.78 () {64 vars in 1308 bytes} [Wed Feb 17 04:35:46 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:35:46.565990 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-c822760a-eb62-4bc8-9ed3-2a1def6b9e61 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:35:46.566701 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-c822760a-eb62-4bc8-9ed3-2a1def6b9e61 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] [instance: 62a16d76-4309-472d-9c9e-6e86b36a653c] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:35:46.574909 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-c822760a-eb62-4bc8-9ed3-2a1def6b9e61 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:46.575439 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-c822760a-eb62-4bc8-9ed3-2a1def6b9e61 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:46.576274 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-c822760a-eb62-4bc8-9ed3-2a1def6b9e61 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:46.576763 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-c822760a-eb62-4bc8-9ed3-2a1def6b9e61 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:47.206310 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-d9f42502-3987-451d-b6e4-3d2be52d9b2e tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:35:47.207615 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-d9f42502-3987-451d-b6e4-3d2be52d9b2e tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:35:47.216394 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-d9f42502-3987-451d-b6e4-3d2be52d9b2e tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:47.216914 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-d9f42502-3987-451d-b6e4-3d2be52d9b2e tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:47.217768 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-d9f42502-3987-451d-b6e4-3d2be52d9b2e tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:47.218265 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-d9f42502-3987-451d-b6e4-3d2be52d9b2e tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:47.352933 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-c822760a-eb62-4bc8-9ed3-2a1def6b9e61 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb8b6c44468c498f9dc0d3a8776433d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79050d22ac3d4c7eb85cd6a19be9ef10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:35:47.363881 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-c822760a-eb62-4bc8-9ed3-2a1def6b9e61 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] 10.222.0.78 "GET /compute/v2.1/servers/62a16d76-4309-472d-9c9e-6e86b36a653c" status: 200 len: 1263 microversion: 2.1 time: 0.801802 Feb 17 04:35:47.364738 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 475/1037] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:35:46 2021] GET /compute/v2.1/servers/62a16d76-4309-472d-9c9e-6e86b36a653c => generated 1263 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:35:47.365297 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-d9f42502-3987-451d-b6e4-3d2be52d9b2e tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "POST /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9/action" status: 200 len: 28459 microversion: 2.20 time: 0.163400 Feb 17 04:35:47.366828 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 563/1038] 10.222.0.78 () {62 vars in 1309 bytes} [Wed Feb 17 04:35:47 2021] POST /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9/action => generated 28459 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Feb 17 04:35:47.434851 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-3de93a9c-7ae3-45fb-973b-4dc1cda39c5a tempest-VolumesNegativeTest-40300628 tempest-VolumesNegativeTest-40300628-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:35:47.435562 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-3de93a9c-7ae3-45fb-973b-4dc1cda39c5a tempest-VolumesNegativeTest-40300628 tempest-VolumesNegativeTest-40300628-project] [instance: 8e8ff2f6-f13f-4d01-b305-21d7428638a3] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:35:47.444208 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-3de93a9c-7ae3-45fb-973b-4dc1cda39c5a tempest-VolumesNegativeTest-40300628 tempest-VolumesNegativeTest-40300628-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:47.444717 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-3de93a9c-7ae3-45fb-973b-4dc1cda39c5a tempest-VolumesNegativeTest-40300628 tempest-VolumesNegativeTest-40300628-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:47.445580 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-3de93a9c-7ae3-45fb-973b-4dc1cda39c5a tempest-VolumesNegativeTest-40300628 tempest-VolumesNegativeTest-40300628-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:47.446071 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-3de93a9c-7ae3-45fb-973b-4dc1cda39c5a tempest-VolumesNegativeTest-40300628 tempest-VolumesNegativeTest-40300628-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:48.154846 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [req-3b6532e8-5e5a-451c-ab23-47a17af53123 req-592ce621-ad37-4131-9685-a9b7e382d50b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e8ff2f6-f13f-4d01-b305-21d7428638a3", "name": "network-vif-deleted", "tag": "e9621f3c-aa13-4fb3-93f1-d457d6828a83"}]} {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:35:48.159533 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-3de93a9c-7ae3-45fb-973b-4dc1cda39c5a tempest-VolumesNegativeTest-40300628 tempest-VolumesNegativeTest-40300628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d0d0233aaa4d59afd95d651c8d596f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb7ff276610646ec9b39f6a9c08024c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:35:48.170748 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:35:48.170748 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: warnings.warn(msg) Feb 17 04:35:48.180518 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-3de93a9c-7ae3-45fb-973b-4dc1cda39c5a tempest-VolumesNegativeTest-40300628 tempest-VolumesNegativeTest-40300628-project] 10.222.0.78 "GET /compute/v2.1/servers/8e8ff2f6-f13f-4d01-b305-21d7428638a3" status: 200 len: 1470 microversion: 2.1 time: 0.750210 Feb 17 04:35:48.183333 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 476/1039] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:35:47 2021] GET /compute/v2.1/servers/8e8ff2f6-f13f-4d01-b305-21d7428638a3 => generated 1470 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:35:48.192137 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [req-3b6532e8-5e5a-451c-ab23-47a17af53123 req-592ce621-ad37-4131-9685-a9b7e382d50b service nova] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:48.195114 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [req-3b6532e8-5e5a-451c-ab23-47a17af53123 req-592ce621-ad37-4131-9685-a9b7e382d50b service nova] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:48.217242 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.compute.server_external_events [req-3b6532e8-5e5a-451c-ab23-47a17af53123 req-592ce621-ad37-4131-9685-a9b7e382d50b service nova] Creating event network-vif-deleted:e9621f3c-aa13-4fb3-93f1-d457d6828a83 for instance 8e8ff2f6-f13f-4d01-b305-21d7428638a3 on hv-cinder-75998 Feb 17 04:35:48.222464 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [req-3b6532e8-5e5a-451c-ab23-47a17af53123 req-592ce621-ad37-4131-9685-a9b7e382d50b service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074650 Feb 17 04:35:48.223500 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 564/1040] 10.222.0.78 () {64 vars in 1308 bytes} [Wed Feb 17 04:35:48 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:35:48.381270 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-5bdb05fb-e9ec-4c82-87ea-eafde9a16687 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:35:48.382752 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-5bdb05fb-e9ec-4c82-87ea-eafde9a16687 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:35:48.393366 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-9dc4e38c-6d92-4f40-a874-17a2df7fb90e tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:35:48.394167 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-9dc4e38c-6d92-4f40-a874-17a2df7fb90e tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] [instance: 62a16d76-4309-472d-9c9e-6e86b36a653c] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:35:48.399578 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-5bdb05fb-e9ec-4c82-87ea-eafde9a16687 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:48.400373 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-5bdb05fb-e9ec-4c82-87ea-eafde9a16687 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:48.401244 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-5bdb05fb-e9ec-4c82-87ea-eafde9a16687 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:48.401815 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-5bdb05fb-e9ec-4c82-87ea-eafde9a16687 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:48.428657 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-9dc4e38c-6d92-4f40-a874-17a2df7fb90e tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:48.429478 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-9dc4e38c-6d92-4f40-a874-17a2df7fb90e tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:48.432416 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-9dc4e38c-6d92-4f40-a874-17a2df7fb90e tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:48.433762 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-9dc4e38c-6d92-4f40-a874-17a2df7fb90e tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:48.578076 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-5bdb05fb-e9ec-4c82-87ea-eafde9a16687 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "POST /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9/action" status: 200 len: 28459 microversion: 2.20 time: 0.204000 Feb 17 04:35:48.578962 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 477/1041] 10.222.0.78 () {62 vars in 1309 bytes} [Wed Feb 17 04:35:48 2021] POST /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9/action => generated 28459 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:35:48.677913 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-9dc4e38c-6d92-4f40-a874-17a2df7fb90e tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb8b6c44468c498f9dc0d3a8776433d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79050d22ac3d4c7eb85cd6a19be9ef10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:35:48.687826 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-9dc4e38c-6d92-4f40-a874-17a2df7fb90e tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] 10.222.0.78 "GET /compute/v2.1/servers/62a16d76-4309-472d-9c9e-6e86b36a653c" status: 200 len: 1263 microversion: 2.1 time: 0.299003 Feb 17 04:35:48.688452 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 565/1042] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:35:48 2021] GET /compute/v2.1/servers/62a16d76-4309-472d-9c9e-6e86b36a653c => generated 1263 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:35:49.204592 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-0d9da214-f30c-46f4-ab96-dda861ee93af tempest-VolumesNegativeTest-40300628 tempest-VolumesNegativeTest-40300628-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:35:49.205482 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-0d9da214-f30c-46f4-ab96-dda861ee93af tempest-VolumesNegativeTest-40300628 tempest-VolumesNegativeTest-40300628-project] [instance: 8e8ff2f6-f13f-4d01-b305-21d7428638a3] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:35:49.215316 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-0d9da214-f30c-46f4-ab96-dda861ee93af tempest-VolumesNegativeTest-40300628 tempest-VolumesNegativeTest-40300628-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:49.215961 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-0d9da214-f30c-46f4-ab96-dda861ee93af tempest-VolumesNegativeTest-40300628 tempest-VolumesNegativeTest-40300628-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:49.216903 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-0d9da214-f30c-46f4-ab96-dda861ee93af tempest-VolumesNegativeTest-40300628 tempest-VolumesNegativeTest-40300628-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:49.217472 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-0d9da214-f30c-46f4-ab96-dda861ee93af tempest-VolumesNegativeTest-40300628 tempest-VolumesNegativeTest-40300628-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:49.294438 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-0d9da214-f30c-46f4-ab96-dda861ee93af tempest-VolumesNegativeTest-40300628 tempest-VolumesNegativeTest-40300628-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:49.294956 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-0d9da214-f30c-46f4-ab96-dda861ee93af tempest-VolumesNegativeTest-40300628 tempest-VolumesNegativeTest-40300628-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:49.295498 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.objects.instance [None req-0d9da214-f30c-46f4-ab96-dda861ee93af tempest-VolumesNegativeTest-40300628 tempest-VolumesNegativeTest-40300628-project] Lazy-loading 'fault' on Instance uuid 8e8ff2f6-f13f-4d01-b305-21d7428638a3 {{(pid=98178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Feb 17 04:35:49.412004 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-0d9da214-f30c-46f4-ab96-dda861ee93af tempest-VolumesNegativeTest-40300628 tempest-VolumesNegativeTest-40300628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d0d0233aaa4d59afd95d651c8d596f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb7ff276610646ec9b39f6a9c08024c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:35:49.420119 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-0d9da214-f30c-46f4-ab96-dda861ee93af tempest-VolumesNegativeTest-40300628 tempest-VolumesNegativeTest-40300628-project] 10.222.0.78 "GET /compute/v2.1/servers/8e8ff2f6-f13f-4d01-b305-21d7428638a3" status: 200 len: 1305 microversion: 2.1 time: 0.222044 Feb 17 04:35:49.420732 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 478/1043] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:35:49 2021] GET /compute/v2.1/servers/8e8ff2f6-f13f-4d01-b305-21d7428638a3 => generated 1305 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:35:49.591214 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-801f49bd-4d9d-466f-b864-52b4c9a69225 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:35:49.592271 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-801f49bd-4d9d-466f-b864-52b4c9a69225 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:35:49.601194 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-801f49bd-4d9d-466f-b864-52b4c9a69225 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:49.601702 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-801f49bd-4d9d-466f-b864-52b4c9a69225 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:49.602555 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-801f49bd-4d9d-466f-b864-52b4c9a69225 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:49.603074 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-801f49bd-4d9d-466f-b864-52b4c9a69225 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:49.705984 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-ed2751e8-4ecb-427d-89ca-60916ee0bb7b tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:35:49.706581 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-ed2751e8-4ecb-427d-89ca-60916ee0bb7b tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] [instance: 62a16d76-4309-472d-9c9e-6e86b36a653c] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:35:49.714697 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-ed2751e8-4ecb-427d-89ca-60916ee0bb7b tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:49.715356 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-ed2751e8-4ecb-427d-89ca-60916ee0bb7b tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:49.716215 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-ed2751e8-4ecb-427d-89ca-60916ee0bb7b tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:49.716872 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-ed2751e8-4ecb-427d-89ca-60916ee0bb7b tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:49.756594 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-801f49bd-4d9d-466f-b864-52b4c9a69225 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "POST /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9/action" status: 200 len: 28627 microversion: 2.20 time: 0.169892 Feb 17 04:35:49.761515 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 566/1044] 10.222.0.78 () {62 vars in 1309 bytes} [Wed Feb 17 04:35:49 2021] POST /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9/action => generated 28627 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:35:49.937282 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-ed2751e8-4ecb-427d-89ca-60916ee0bb7b tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb8b6c44468c498f9dc0d3a8776433d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79050d22ac3d4c7eb85cd6a19be9ef10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:35:49.946156 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-ed2751e8-4ecb-427d-89ca-60916ee0bb7b tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] 10.222.0.78 "GET /compute/v2.1/servers/62a16d76-4309-472d-9c9e-6e86b36a653c" status: 200 len: 1263 microversion: 2.1 time: 0.244325 Feb 17 04:35:49.946757 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 479/1045] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:35:49 2021] GET /compute/v2.1/servers/62a16d76-4309-472d-9c9e-6e86b36a653c => generated 1263 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:35:50.264530 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [req-32cb7b24-4176-4a7b-8bca-523de425d064 req-f9040263-4af5-465b-8ab0-74ca07b5a173 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "62a16d76-4309-472d-9c9e-6e86b36a653c", "tag": "5ba59ff1-b19b-4ba6-9ef2-07dccd6b3a55"}]} {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:35:50.266141 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:35:50.266141 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: warnings.warn(msg) Feb 17 04:35:50.275719 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [req-32cb7b24-4176-4a7b-8bca-523de425d064 req-f9040263-4af5-465b-8ab0-74ca07b5a173 service nova] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:50.276220 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [req-32cb7b24-4176-4a7b-8bca-523de425d064 req-f9040263-4af5-465b-8ab0-74ca07b5a173 service nova] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:50.294375 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.compute.server_external_events [req-32cb7b24-4176-4a7b-8bca-523de425d064 req-f9040263-4af5-465b-8ab0-74ca07b5a173 service nova] Creating event network-changed:5ba59ff1-b19b-4ba6-9ef2-07dccd6b3a55 for instance 62a16d76-4309-472d-9c9e-6e86b36a653c on hv-cinder-75998 Feb 17 04:35:50.299510 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [req-32cb7b24-4176-4a7b-8bca-523de425d064 req-f9040263-4af5-465b-8ab0-74ca07b5a173 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039289 Feb 17 04:35:50.300303 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 567/1046] 10.222.0.78 () {64 vars in 1308 bytes} [Wed Feb 17 04:35:50 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:35:50.438336 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-c4e92233-e62e-4c30-9f6a-0edd8f0ac1d1 tempest-VolumesNegativeTest-40300628 tempest-VolumesNegativeTest-40300628-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:35:50.438962 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-c4e92233-e62e-4c30-9f6a-0edd8f0ac1d1 tempest-VolumesNegativeTest-40300628 tempest-VolumesNegativeTest-40300628-project] [instance: 8e8ff2f6-f13f-4d01-b305-21d7428638a3] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:35:50.447223 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-c4e92233-e62e-4c30-9f6a-0edd8f0ac1d1 tempest-VolumesNegativeTest-40300628 tempest-VolumesNegativeTest-40300628-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:50.447734 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-c4e92233-e62e-4c30-9f6a-0edd8f0ac1d1 tempest-VolumesNegativeTest-40300628 tempest-VolumesNegativeTest-40300628-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:50.448677 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-c4e92233-e62e-4c30-9f6a-0edd8f0ac1d1 tempest-VolumesNegativeTest-40300628 tempest-VolumesNegativeTest-40300628-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:50.449177 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-c4e92233-e62e-4c30-9f6a-0edd8f0ac1d1 tempest-VolumesNegativeTest-40300628 tempest-VolumesNegativeTest-40300628-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:50.502482 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.wsgi [None req-c4e92233-e62e-4c30-9f6a-0edd8f0ac1d1 tempest-VolumesNegativeTest-40300628 tempest-VolumesNegativeTest-40300628-project] HTTP exception thrown: Instance 8e8ff2f6-f13f-4d01-b305-21d7428638a3 could not be found. Feb 17 04:35:50.503188 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-c4e92233-e62e-4c30-9f6a-0edd8f0ac1d1 tempest-VolumesNegativeTest-40300628 tempest-VolumesNegativeTest-40300628-project] Returning 404 to user: Instance 8e8ff2f6-f13f-4d01-b305-21d7428638a3 could not be found. {{(pid=98178) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 17 04:35:50.504088 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-c4e92233-e62e-4c30-9f6a-0edd8f0ac1d1 tempest-VolumesNegativeTest-40300628 tempest-VolumesNegativeTest-40300628-project] 10.222.0.78 "GET /compute/v2.1/servers/8e8ff2f6-f13f-4d01-b305-21d7428638a3" status: 404 len: 111 microversion: 2.1 time: 0.069986 Feb 17 04:35:50.504708 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 480/1047] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:35:50 2021] GET /compute/v2.1/servers/8e8ff2f6-f13f-4d01-b305-21d7428638a3 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 17 04:35:50.770110 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-9a965aad-0614-4166-9618-14bd34e05699 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:35:50.771303 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-9a965aad-0614-4166-9618-14bd34e05699 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:35:50.780372 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-9a965aad-0614-4166-9618-14bd34e05699 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:50.780881 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-9a965aad-0614-4166-9618-14bd34e05699 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:50.781725 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-9a965aad-0614-4166-9618-14bd34e05699 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:50.782214 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-9a965aad-0614-4166-9618-14bd34e05699 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:50.964855 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-f1104a8b-4189-466b-80b8-6a4d43425d25 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:35:50.965823 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-f1104a8b-4189-466b-80b8-6a4d43425d25 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] [instance: 62a16d76-4309-472d-9c9e-6e86b36a653c] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:35:50.974097 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-f1104a8b-4189-466b-80b8-6a4d43425d25 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:50.974549 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-f1104a8b-4189-466b-80b8-6a4d43425d25 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:50.975420 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-f1104a8b-4189-466b-80b8-6a4d43425d25 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:50.975968 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-f1104a8b-4189-466b-80b8-6a4d43425d25 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:51.012667 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-9a965aad-0614-4166-9618-14bd34e05699 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "POST /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9/action" status: 200 len: 28627 microversion: 2.20 time: 0.246724 Feb 17 04:35:51.017419 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 568/1048] 10.222.0.78 () {62 vars in 1309 bytes} [Wed Feb 17 04:35:50 2021] POST /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9/action => generated 28627 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:35:51.319445 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-f1104a8b-4189-466b-80b8-6a4d43425d25 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb8b6c44468c498f9dc0d3a8776433d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79050d22ac3d4c7eb85cd6a19be9ef10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:35:51.328559 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-f1104a8b-4189-466b-80b8-6a4d43425d25 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] 10.222.0.78 "GET /compute/v2.1/servers/62a16d76-4309-472d-9c9e-6e86b36a653c" status: 200 len: 1263 microversion: 2.1 time: 0.368501 Feb 17 04:35:51.329171 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 481/1049] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:35:50 2021] GET /compute/v2.1/servers/62a16d76-4309-472d-9c9e-6e86b36a653c => generated 1263 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:35:52.025983 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-bf0cc3bf-0f55-44e0-b85a-6f3e170499d5 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:35:52.027257 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-bf0cc3bf-0f55-44e0-b85a-6f3e170499d5 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:35:52.035798 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-bf0cc3bf-0f55-44e0-b85a-6f3e170499d5 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:52.036315 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-bf0cc3bf-0f55-44e0-b85a-6f3e170499d5 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:52.037193 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-bf0cc3bf-0f55-44e0-b85a-6f3e170499d5 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:52.037824 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-bf0cc3bf-0f55-44e0-b85a-6f3e170499d5 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:52.203843 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-bf0cc3bf-0f55-44e0-b85a-6f3e170499d5 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "POST /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9/action" status: 200 len: 28627 microversion: 2.20 time: 0.182052 Feb 17 04:35:52.204677 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 569/1050] 10.222.0.78 () {62 vars in 1309 bytes} [Wed Feb 17 04:35:52 2021] POST /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9/action => generated 28627 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:35:52.345880 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-37b09181-4e04-4fb0-b3a5-bd601fd051fa tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:35:52.346563 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-37b09181-4e04-4fb0-b3a5-bd601fd051fa tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] [instance: 62a16d76-4309-472d-9c9e-6e86b36a653c] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:35:52.355047 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-37b09181-4e04-4fb0-b3a5-bd601fd051fa tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:52.355589 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-37b09181-4e04-4fb0-b3a5-bd601fd051fa tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:52.356436 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-37b09181-4e04-4fb0-b3a5-bd601fd051fa tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:52.356931 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-37b09181-4e04-4fb0-b3a5-bd601fd051fa tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:52.799269 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-37b09181-4e04-4fb0-b3a5-bd601fd051fa tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb8b6c44468c498f9dc0d3a8776433d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79050d22ac3d4c7eb85cd6a19be9ef10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:35:52.808777 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-37b09181-4e04-4fb0-b3a5-bd601fd051fa tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] 10.222.0.78 "GET /compute/v2.1/servers/62a16d76-4309-472d-9c9e-6e86b36a653c" status: 200 len: 1263 microversion: 2.1 time: 0.466892 Feb 17 04:35:52.809384 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 482/1051] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:35:52 2021] GET /compute/v2.1/servers/62a16d76-4309-472d-9c9e-6e86b36a653c => generated 1263 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:35:53.217405 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-c51cbf9c-a354-4a39-a9af-6625f96deb58 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:35:53.218535 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-c51cbf9c-a354-4a39-a9af-6625f96deb58 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:35:53.227168 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-c51cbf9c-a354-4a39-a9af-6625f96deb58 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:53.227678 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-c51cbf9c-a354-4a39-a9af-6625f96deb58 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:53.228556 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-c51cbf9c-a354-4a39-a9af-6625f96deb58 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:53.229047 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-c51cbf9c-a354-4a39-a9af-6625f96deb58 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:53.385911 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-c51cbf9c-a354-4a39-a9af-6625f96deb58 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "POST /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9/action" status: 200 len: 28627 microversion: 2.20 time: 0.173279 Feb 17 04:35:53.390130 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 570/1052] 10.222.0.78 () {62 vars in 1309 bytes} [Wed Feb 17 04:35:53 2021] POST /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9/action => generated 28627 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:35:53.827084 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-c88d0993-22e9-473f-9467-87bb982a52e2 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:35:53.827772 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-c88d0993-22e9-473f-9467-87bb982a52e2 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] [instance: 62a16d76-4309-472d-9c9e-6e86b36a653c] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:35:53.836033 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-c88d0993-22e9-473f-9467-87bb982a52e2 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:53.836550 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-c88d0993-22e9-473f-9467-87bb982a52e2 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:53.837409 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-c88d0993-22e9-473f-9467-87bb982a52e2 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:53.837907 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-c88d0993-22e9-473f-9467-87bb982a52e2 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:54.051572 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-c88d0993-22e9-473f-9467-87bb982a52e2 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb8b6c44468c498f9dc0d3a8776433d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79050d22ac3d4c7eb85cd6a19be9ef10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:35:54.060929 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-c88d0993-22e9-473f-9467-87bb982a52e2 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] 10.222.0.78 "GET /compute/v2.1/servers/62a16d76-4309-472d-9c9e-6e86b36a653c" status: 200 len: 1263 microversion: 2.1 time: 0.237987 Feb 17 04:35:54.061525 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 483/1053] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:35:53 2021] GET /compute/v2.1/servers/62a16d76-4309-472d-9c9e-6e86b36a653c => generated 1263 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:35:54.399168 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-9842712d-64b7-414e-b7cd-a2a892747c04 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:35:54.400313 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-9842712d-64b7-414e-b7cd-a2a892747c04 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:35:54.408983 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-9842712d-64b7-414e-b7cd-a2a892747c04 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:54.409496 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-9842712d-64b7-414e-b7cd-a2a892747c04 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:54.410360 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-9842712d-64b7-414e-b7cd-a2a892747c04 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:54.410916 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-9842712d-64b7-414e-b7cd-a2a892747c04 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:54.567899 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-9842712d-64b7-414e-b7cd-a2a892747c04 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "POST /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9/action" status: 200 len: 28627 microversion: 2.20 time: 0.173047 Feb 17 04:35:54.568597 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 571/1054] 10.222.0.78 () {62 vars in 1309 bytes} [Wed Feb 17 04:35:54 2021] POST /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9/action => generated 28627 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:35:55.078862 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-29050e06-fd54-465f-93f6-bdb34ac779f8 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:35:55.079601 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-29050e06-fd54-465f-93f6-bdb34ac779f8 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] [instance: 62a16d76-4309-472d-9c9e-6e86b36a653c] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:35:55.087622 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-29050e06-fd54-465f-93f6-bdb34ac779f8 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:55.088135 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-29050e06-fd54-465f-93f6-bdb34ac779f8 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:55.088978 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-29050e06-fd54-465f-93f6-bdb34ac779f8 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:55.089479 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-29050e06-fd54-465f-93f6-bdb34ac779f8 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:55.310792 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-29050e06-fd54-465f-93f6-bdb34ac779f8 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb8b6c44468c498f9dc0d3a8776433d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79050d22ac3d4c7eb85cd6a19be9ef10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:35:55.319896 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-29050e06-fd54-465f-93f6-bdb34ac779f8 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] 10.222.0.78 "GET /compute/v2.1/servers/62a16d76-4309-472d-9c9e-6e86b36a653c" status: 200 len: 1263 microversion: 2.1 time: 0.245202 Feb 17 04:35:55.320520 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 484/1055] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:35:55 2021] GET /compute/v2.1/servers/62a16d76-4309-472d-9c9e-6e86b36a653c => generated 1263 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:35:55.582022 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-0dd92cc2-9f25-4c58-9521-099e007daf4b tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:35:55.583229 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-0dd92cc2-9f25-4c58-9521-099e007daf4b tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:35:55.593976 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-0dd92cc2-9f25-4c58-9521-099e007daf4b tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:55.594847 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-0dd92cc2-9f25-4c58-9521-099e007daf4b tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:55.596198 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-0dd92cc2-9f25-4c58-9521-099e007daf4b tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:55.596721 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-0dd92cc2-9f25-4c58-9521-099e007daf4b tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:55.752967 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-0dd92cc2-9f25-4c58-9521-099e007daf4b tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "POST /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9/action" status: 200 len: 28627 microversion: 2.20 time: 0.175183 Feb 17 04:35:55.757227 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 572/1056] 10.222.0.78 () {62 vars in 1309 bytes} [Wed Feb 17 04:35:55 2021] POST /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9/action => generated 28627 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:35:56.338184 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-59a2148e-1eb0-4879-862c-4439b3d76c43 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:35:56.338855 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-59a2148e-1eb0-4879-862c-4439b3d76c43 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] [instance: 62a16d76-4309-472d-9c9e-6e86b36a653c] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:35:56.347917 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-59a2148e-1eb0-4879-862c-4439b3d76c43 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:56.348423 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-59a2148e-1eb0-4879-862c-4439b3d76c43 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:56.349262 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-59a2148e-1eb0-4879-862c-4439b3d76c43 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:56.349759 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-59a2148e-1eb0-4879-862c-4439b3d76c43 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:56.564439 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-59a2148e-1eb0-4879-862c-4439b3d76c43 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb8b6c44468c498f9dc0d3a8776433d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79050d22ac3d4c7eb85cd6a19be9ef10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:35:56.573160 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-59a2148e-1eb0-4879-862c-4439b3d76c43 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] 10.222.0.78 "GET /compute/v2.1/servers/62a16d76-4309-472d-9c9e-6e86b36a653c" status: 200 len: 1263 microversion: 2.1 time: 0.239052 Feb 17 04:35:56.573751 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 485/1057] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:35:56 2021] GET /compute/v2.1/servers/62a16d76-4309-472d-9c9e-6e86b36a653c => generated 1263 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:35:56.766549 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-039ba165-a76b-4331-b783-d90411f30c60 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:35:56.767628 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-039ba165-a76b-4331-b783-d90411f30c60 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:35:56.776198 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-039ba165-a76b-4331-b783-d90411f30c60 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:56.776704 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-039ba165-a76b-4331-b783-d90411f30c60 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:56.777537 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-039ba165-a76b-4331-b783-d90411f30c60 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:56.778667 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-039ba165-a76b-4331-b783-d90411f30c60 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:56.940039 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-039ba165-a76b-4331-b783-d90411f30c60 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "POST /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9/action" status: 200 len: 28627 microversion: 2.20 time: 0.178282 Feb 17 04:35:56.940729 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 573/1058] 10.222.0.78 () {62 vars in 1309 bytes} [Wed Feb 17 04:35:56 2021] POST /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9/action => generated 28627 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:35:57.591867 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-a1ddbaf0-c935-4f70-8054-04ff325ae059 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:35:57.592542 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-a1ddbaf0-c935-4f70-8054-04ff325ae059 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] [instance: 62a16d76-4309-472d-9c9e-6e86b36a653c] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:35:57.600474 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-a1ddbaf0-c935-4f70-8054-04ff325ae059 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:57.600997 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-a1ddbaf0-c935-4f70-8054-04ff325ae059 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:57.601841 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-a1ddbaf0-c935-4f70-8054-04ff325ae059 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:57.602342 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-a1ddbaf0-c935-4f70-8054-04ff325ae059 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:57.814699 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-a1ddbaf0-c935-4f70-8054-04ff325ae059 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb8b6c44468c498f9dc0d3a8776433d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79050d22ac3d4c7eb85cd6a19be9ef10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:35:57.823481 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-a1ddbaf0-c935-4f70-8054-04ff325ae059 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] 10.222.0.78 "GET /compute/v2.1/servers/62a16d76-4309-472d-9c9e-6e86b36a653c" status: 200 len: 1263 microversion: 2.1 time: 0.235741 Feb 17 04:35:57.824072 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 486/1059] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:35:57 2021] GET /compute/v2.1/servers/62a16d76-4309-472d-9c9e-6e86b36a653c => generated 1263 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:35:57.953791 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-27fa4a83-b74b-47c3-85f4-0e0c923e908c tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:35:57.954974 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-27fa4a83-b74b-47c3-85f4-0e0c923e908c tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:35:57.963654 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-27fa4a83-b74b-47c3-85f4-0e0c923e908c tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:57.964163 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-27fa4a83-b74b-47c3-85f4-0e0c923e908c tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:57.965014 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-27fa4a83-b74b-47c3-85f4-0e0c923e908c tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:57.965515 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-27fa4a83-b74b-47c3-85f4-0e0c923e908c tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:58.185347 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-27fa4a83-b74b-47c3-85f4-0e0c923e908c tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "POST /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9/action" status: 200 len: 28627 microversion: 2.20 time: 0.236013 Feb 17 04:35:58.186342 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 574/1060] 10.222.0.78 () {62 vars in 1309 bytes} [Wed Feb 17 04:35:57 2021] POST /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9/action => generated 28627 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:35:58.842563 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-e791816b-b70d-435a-804a-5f3f91bb6fb7 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:35:58.843272 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-e791816b-b70d-435a-804a-5f3f91bb6fb7 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] [instance: 62a16d76-4309-472d-9c9e-6e86b36a653c] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:35:58.851185 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-e791816b-b70d-435a-804a-5f3f91bb6fb7 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:58.851701 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-e791816b-b70d-435a-804a-5f3f91bb6fb7 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:58.852535 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-e791816b-b70d-435a-804a-5f3f91bb6fb7 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:58.853027 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-e791816b-b70d-435a-804a-5f3f91bb6fb7 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:59.068780 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-e791816b-b70d-435a-804a-5f3f91bb6fb7 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb8b6c44468c498f9dc0d3a8776433d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79050d22ac3d4c7eb85cd6a19be9ef10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:35:59.078198 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-e791816b-b70d-435a-804a-5f3f91bb6fb7 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] 10.222.0.78 "GET /compute/v2.1/servers/62a16d76-4309-472d-9c9e-6e86b36a653c" status: 200 len: 1263 microversion: 2.1 time: 0.240033 Feb 17 04:35:59.078813 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 487/1061] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:35:58 2021] GET /compute/v2.1/servers/62a16d76-4309-472d-9c9e-6e86b36a653c => generated 1263 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:35:59.198503 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-f4f81116-8869-434f-83bb-79cac3cd5b93 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:35:59.199798 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-f4f81116-8869-434f-83bb-79cac3cd5b93 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:35:59.208319 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-f4f81116-8869-434f-83bb-79cac3cd5b93 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:59.208756 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-f4f81116-8869-434f-83bb-79cac3cd5b93 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:59.209594 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-f4f81116-8869-434f-83bb-79cac3cd5b93 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:59.210086 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-f4f81116-8869-434f-83bb-79cac3cd5b93 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:59.357417 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-f4f81116-8869-434f-83bb-79cac3cd5b93 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "POST /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9/action" status: 200 len: 28627 microversion: 2.20 time: 0.162533 Feb 17 04:35:59.358401 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 575/1062] 10.222.0.78 () {62 vars in 1309 bytes} [Wed Feb 17 04:35:59 2021] POST /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9/action => generated 28627 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:35:59.443925 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-aba70846-a0bd-468e-ab3f-f83aea4ca3fe tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:35:59.444414 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-aba70846-a0bd-468e-ab3f-f83aea4ca3fe tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: 29d1ce27-f63b-4523-88be-55f65a6a2529] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:35:59.452495 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-aba70846-a0bd-468e-ab3f-f83aea4ca3fe tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:59.453015 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-aba70846-a0bd-468e-ab3f-f83aea4ca3fe tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:59.453947 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-aba70846-a0bd-468e-ab3f-f83aea4ca3fe tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:59.454449 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-aba70846-a0bd-468e-ab3f-f83aea4ca3fe tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:59.639242 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.objects.instance [None req-aba70846-a0bd-468e-ab3f-f83aea4ca3fe tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lazy-loading 'services' on Instance uuid 29d1ce27-f63b-4523-88be-55f65a6a2529 {{(pid=98178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Feb 17 04:35:59.779245 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-aba70846-a0bd-468e-ab3f-f83aea4ca3fe tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "DELETE /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529/os-volume_attachments/c774c2e2-d944-4d2e-8cc9-09f5d7ac1bf8" status: 202 len: 0 microversion: 2.1 time: 0.339397 Feb 17 04:35:59.779905 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 488/1063] 10.222.0.78 () {58 vars in 1406 bytes} [Wed Feb 17 04:35:59 2021] DELETE /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529/os-volume_attachments/c774c2e2-d944-4d2e-8cc9-09f5d7ac1bf8 => generated 0 bytes in 341 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:36:00.097401 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-206ea474-c45f-491d-8c1c-9c7c303677d2 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:36:00.098174 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-206ea474-c45f-491d-8c1c-9c7c303677d2 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] [instance: 62a16d76-4309-472d-9c9e-6e86b36a653c] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:36:00.107384 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-206ea474-c45f-491d-8c1c-9c7c303677d2 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:00.107889 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-206ea474-c45f-491d-8c1c-9c7c303677d2 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:00.108727 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-206ea474-c45f-491d-8c1c-9c7c303677d2 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:00.109483 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-206ea474-c45f-491d-8c1c-9c7c303677d2 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:00.319068 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-206ea474-c45f-491d-8c1c-9c7c303677d2 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb8b6c44468c498f9dc0d3a8776433d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79050d22ac3d4c7eb85cd6a19be9ef10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:00.329289 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-206ea474-c45f-491d-8c1c-9c7c303677d2 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] 10.222.0.78 "GET /compute/v2.1/servers/62a16d76-4309-472d-9c9e-6e86b36a653c" status: 200 len: 1263 microversion: 2.1 time: 0.236343 Feb 17 04:36:00.329896 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 576/1064] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:36:00 2021] GET /compute/v2.1/servers/62a16d76-4309-472d-9c9e-6e86b36a653c => generated 1263 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:36:00.370639 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-f91eeb56-b970-4337-8cf6-befeb4b769e6 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:36:00.372033 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-f91eeb56-b970-4337-8cf6-befeb4b769e6 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:36:00.380408 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-f91eeb56-b970-4337-8cf6-befeb4b769e6 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:00.380913 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-f91eeb56-b970-4337-8cf6-befeb4b769e6 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:00.381744 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-f91eeb56-b970-4337-8cf6-befeb4b769e6 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:00.382237 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-f91eeb56-b970-4337-8cf6-befeb4b769e6 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:00.491912 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-0fe7b55d-7386-4c9e-93ed-a0cd7c62178b tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:36:00.492980 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-0fe7b55d-7386-4c9e-93ed-a0cd7c62178b tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] [instance: b195626c-7ee1-4679-b956-f7ef7d6328f6] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:36:00.501411 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-0fe7b55d-7386-4c9e-93ed-a0cd7c62178b tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:00.501916 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-0fe7b55d-7386-4c9e-93ed-a0cd7c62178b tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:00.502780 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-0fe7b55d-7386-4c9e-93ed-a0cd7c62178b tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:00.503327 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-0fe7b55d-7386-4c9e-93ed-a0cd7c62178b tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:00.548347 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-f91eeb56-b970-4337-8cf6-befeb4b769e6 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "POST /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9/action" status: 200 len: 28627 microversion: 2.20 time: 0.182018 Feb 17 04:36:00.549101 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 489/1065] 10.222.0.78 () {62 vars in 1309 bytes} [Wed Feb 17 04:36:00 2021] POST /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9/action => generated 28627 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:36:00.653097 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-0fe7b55d-7386-4c9e-93ed-a0cd7c62178b tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] 10.222.0.78 "POST /compute/v2.1/servers/b195626c-7ee1-4679-b956-f7ef7d6328f6/action" status: 202 len: 0 microversion: 2.1 time: 0.164826 Feb 17 04:36:00.653973 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 577/1066] 10.222.0.78 () {60 vars in 1268 bytes} [Wed Feb 17 04:36:00 2021] POST /compute/v2.1/servers/b195626c-7ee1-4679-b956-f7ef7d6328f6/action => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Feb 17 04:36:00.663519 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-e42e3e45-4ae5-47b1-9ae0-0f950a43c8b8 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:36:00.663878 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-e42e3e45-4ae5-47b1-9ae0-0f950a43c8b8 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] [instance: b195626c-7ee1-4679-b956-f7ef7d6328f6] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:36:00.672854 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-e42e3e45-4ae5-47b1-9ae0-0f950a43c8b8 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:00.673363 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-e42e3e45-4ae5-47b1-9ae0-0f950a43c8b8 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:00.674185 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-e42e3e45-4ae5-47b1-9ae0-0f950a43c8b8 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:00.674681 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-e42e3e45-4ae5-47b1-9ae0-0f950a43c8b8 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:01.053753 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-e42e3e45-4ae5-47b1-9ae0-0f950a43c8b8 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f3e4c3c174942c492405c9b112667de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5b2911946848de81be8f9741faa90f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:01.063980 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-e42e3e45-4ae5-47b1-9ae0-0f950a43c8b8 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] 10.222.0.78 "GET /compute/v2.1/servers/b195626c-7ee1-4679-b956-f7ef7d6328f6" status: 200 len: 1760 microversion: 2.1 time: 0.405311 Feb 17 04:36:01.064595 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 490/1067] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:36:00 2021] GET /compute/v2.1/servers/b195626c-7ee1-4679-b956-f7ef7d6328f6 => generated 1760 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:36:01.348716 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-54612030-4da4-4255-930c-e8b97bf4a8a4 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:36:01.349703 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-54612030-4da4-4255-930c-e8b97bf4a8a4 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] [instance: 62a16d76-4309-472d-9c9e-6e86b36a653c] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:36:01.359861 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-54612030-4da4-4255-930c-e8b97bf4a8a4 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:01.360354 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-54612030-4da4-4255-930c-e8b97bf4a8a4 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:01.361207 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-54612030-4da4-4255-930c-e8b97bf4a8a4 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:01.361703 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-54612030-4da4-4255-930c-e8b97bf4a8a4 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:01.562316 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-52c5e1b7-b423-4184-9e96-47303d15568f tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:36:01.563794 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-52c5e1b7-b423-4184-9e96-47303d15568f tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:36:01.573134 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-52c5e1b7-b423-4184-9e96-47303d15568f tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:01.574773 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-52c5e1b7-b423-4184-9e96-47303d15568f tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:01.575899 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-52c5e1b7-b423-4184-9e96-47303d15568f tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:01.577172 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-52c5e1b7-b423-4184-9e96-47303d15568f tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:01.584783 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-54612030-4da4-4255-930c-e8b97bf4a8a4 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb8b6c44468c498f9dc0d3a8776433d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79050d22ac3d4c7eb85cd6a19be9ef10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:01.596988 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-54612030-4da4-4255-930c-e8b97bf4a8a4 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] 10.222.0.78 "GET /compute/v2.1/servers/62a16d76-4309-472d-9c9e-6e86b36a653c" status: 200 len: 1263 microversion: 2.1 time: 0.253101 Feb 17 04:36:01.608161 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 578/1068] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:36:01 2021] GET /compute/v2.1/servers/62a16d76-4309-472d-9c9e-6e86b36a653c => generated 1263 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:36:01.748127 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-52c5e1b7-b423-4184-9e96-47303d15568f tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "POST /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9/action" status: 200 len: 28627 microversion: 2.20 time: 0.190609 Feb 17 04:36:01.748846 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 491/1069] 10.222.0.78 () {62 vars in 1309 bytes} [Wed Feb 17 04:36:01 2021] POST /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9/action => generated 28627 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Feb 17 04:36:01.756291 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [req-81049504-982f-4a79-86d8-f7e6b19eff0e req-45007d98-915c-4a01-b016-9da7e264faa6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62a16d76-4309-472d-9c9e-6e86b36a653c", "name": "network-vif-plugged", "status": "completed", "tag": "5ba59ff1-b19b-4ba6-9ef2-07dccd6b3a55"}]} {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:36:01.758626 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:36:01.758626 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: warnings.warn(msg) Feb 17 04:36:01.770118 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [req-81049504-982f-4a79-86d8-f7e6b19eff0e req-45007d98-915c-4a01-b016-9da7e264faa6 service nova] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:01.770809 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [req-81049504-982f-4a79-86d8-f7e6b19eff0e req-45007d98-915c-4a01-b016-9da7e264faa6 service nova] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:01.788963 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.compute.server_external_events [req-81049504-982f-4a79-86d8-f7e6b19eff0e req-45007d98-915c-4a01-b016-9da7e264faa6 service nova] Creating event network-vif-plugged:5ba59ff1-b19b-4ba6-9ef2-07dccd6b3a55 for instance 62a16d76-4309-472d-9c9e-6e86b36a653c on hv-cinder-75998 Feb 17 04:36:01.794633 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [req-81049504-982f-4a79-86d8-f7e6b19eff0e req-45007d98-915c-4a01-b016-9da7e264faa6 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043230 Feb 17 04:36:01.795417 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 579/1070] 10.222.0.78 () {64 vars in 1308 bytes} [Wed Feb 17 04:36:01 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:36:02.083934 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-d99127eb-70ce-40cb-b986-e89f91376920 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:36:02.084679 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-d99127eb-70ce-40cb-b986-e89f91376920 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] [instance: b195626c-7ee1-4679-b956-f7ef7d6328f6] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:36:02.095344 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-d99127eb-70ce-40cb-b986-e89f91376920 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:02.095866 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-d99127eb-70ce-40cb-b986-e89f91376920 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:02.096782 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-d99127eb-70ce-40cb-b986-e89f91376920 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:02.097286 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-d99127eb-70ce-40cb-b986-e89f91376920 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:02.108498 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-8aff3892-127c-42ac-9785-23fcd248c975 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:36:02.118045 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-8aff3892-127c-42ac-9785-23fcd248c975 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:02.118646 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-8aff3892-127c-42ac-9785-23fcd248c975 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:02.193429 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-8aff3892-127c-42ac-9785-23fcd248c975 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: 29d1ce27-f63b-4523-88be-55f65a6a2529] Going to try to stop instance {{(pid=98179) force_stop /opt/stack/nova/nova/compute/api.py:2580}} Feb 17 04:36:02.272951 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-8aff3892-127c-42ac-9785-23fcd248c975 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "POST /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529/action" status: 202 len: 0 microversion: 2.1 time: 0.170486 Feb 17 04:36:02.273726 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 580/1071] 10.222.0.78 () {60 vars in 1268 bytes} [Wed Feb 17 04:36:02 2021] POST /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529/action => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Feb 17 04:36:02.283492 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-a3d0aa30-5125-414f-b059-d6a05734c825 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:36:02.284271 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-a3d0aa30-5125-414f-b059-d6a05734c825 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: 29d1ce27-f63b-4523-88be-55f65a6a2529] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:36:02.292581 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-a3d0aa30-5125-414f-b059-d6a05734c825 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:02.293152 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-a3d0aa30-5125-414f-b059-d6a05734c825 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:02.294567 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-a3d0aa30-5125-414f-b059-d6a05734c825 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:02.294952 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-a3d0aa30-5125-414f-b059-d6a05734c825 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:02.417658 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-d99127eb-70ce-40cb-b986-e89f91376920 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f3e4c3c174942c492405c9b112667de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5b2911946848de81be8f9741faa90f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:02.427841 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-d99127eb-70ce-40cb-b986-e89f91376920 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] 10.222.0.78 "GET /compute/v2.1/servers/b195626c-7ee1-4679-b956-f7ef7d6328f6" status: 200 len: 1765 microversion: 2.1 time: 0.348251 Feb 17 04:36:02.439644 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 492/1072] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:36:02 2021] GET /compute/v2.1/servers/b195626c-7ee1-4679-b956-f7ef7d6328f6 => generated 1765 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:36:02.616974 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-9ae7bbc1-f246-46a8-9d80-51e759c74d53 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:36:02.617692 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-9ae7bbc1-f246-46a8-9d80-51e759c74d53 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] [instance: 62a16d76-4309-472d-9c9e-6e86b36a653c] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:36:02.626608 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-9ae7bbc1-f246-46a8-9d80-51e759c74d53 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:02.627191 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-9ae7bbc1-f246-46a8-9d80-51e759c74d53 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:02.628040 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-9ae7bbc1-f246-46a8-9d80-51e759c74d53 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:02.628532 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-9ae7bbc1-f246-46a8-9d80-51e759c74d53 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:02.648393 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-a3d0aa30-5125-414f-b059-d6a05734c825 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2deb449189ba427a9b8fcb0e21f22566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2c8716a46f54187902492f8ce162f58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:02.657463 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-a3d0aa30-5125-414f-b059-d6a05734c825 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "GET /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529" status: 200 len: 1676 microversion: 2.1 time: 0.378378 Feb 17 04:36:02.658079 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 581/1073] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:36:02 2021] GET /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529 => generated 1676 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:36:02.761600 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-68233394-a49e-4279-9c6b-217e05fe2d42 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:36:02.763144 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-68233394-a49e-4279-9c6b-217e05fe2d42 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:36:02.771541 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-68233394-a49e-4279-9c6b-217e05fe2d42 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:02.772197 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-68233394-a49e-4279-9c6b-217e05fe2d42 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:02.773163 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-68233394-a49e-4279-9c6b-217e05fe2d42 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:02.773891 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-68233394-a49e-4279-9c6b-217e05fe2d42 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:02.849291 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-9ae7bbc1-f246-46a8-9d80-51e759c74d53 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb8b6c44468c498f9dc0d3a8776433d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79050d22ac3d4c7eb85cd6a19be9ef10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:02.859400 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-9ae7bbc1-f246-46a8-9d80-51e759c74d53 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] 10.222.0.78 "GET /compute/v2.1/servers/62a16d76-4309-472d-9c9e-6e86b36a653c" status: 200 len: 1263 microversion: 2.1 time: 0.246135 Feb 17 04:36:02.860137 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 493/1074] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:36:02 2021] GET /compute/v2.1/servers/62a16d76-4309-472d-9c9e-6e86b36a653c => generated 1263 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:36:03.427686 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-68233394-a49e-4279-9c6b-217e05fe2d42 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "POST /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9/action" status: 200 len: 28627 microversion: 2.20 time: 0.670208 Feb 17 04:36:03.428423 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 582/1075] 10.222.0.78 () {62 vars in 1309 bytes} [Wed Feb 17 04:36:02 2021] POST /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9/action => generated 28627 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:36:03.458347 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-627b931e-9aa2-4004-8850-7328ae1f9d9a tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:36:03.458999 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-627b931e-9aa2-4004-8850-7328ae1f9d9a tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] [instance: b195626c-7ee1-4679-b956-f7ef7d6328f6] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:36:03.467968 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-627b931e-9aa2-4004-8850-7328ae1f9d9a tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:03.468475 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-627b931e-9aa2-4004-8850-7328ae1f9d9a tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:03.469302 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-627b931e-9aa2-4004-8850-7328ae1f9d9a tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:03.469791 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-627b931e-9aa2-4004-8850-7328ae1f9d9a tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:03.677706 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-6389dd0e-5ff8-4c36-9436-be155de5903f tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:36:03.678477 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-6389dd0e-5ff8-4c36-9436-be155de5903f tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: 29d1ce27-f63b-4523-88be-55f65a6a2529] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:36:03.685860 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-627b931e-9aa2-4004-8850-7328ae1f9d9a tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f3e4c3c174942c492405c9b112667de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5b2911946848de81be8f9741faa90f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:03.687425 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-6389dd0e-5ff8-4c36-9436-be155de5903f tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:03.687940 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-6389dd0e-5ff8-4c36-9436-be155de5903f tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:03.688791 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-6389dd0e-5ff8-4c36-9436-be155de5903f tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:03.689284 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-6389dd0e-5ff8-4c36-9436-be155de5903f tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:03.695686 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-627b931e-9aa2-4004-8850-7328ae1f9d9a tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] 10.222.0.78 "GET /compute/v2.1/servers/b195626c-7ee1-4679-b956-f7ef7d6328f6" status: 200 len: 1765 microversion: 2.1 time: 0.241406 Feb 17 04:36:03.696296 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 494/1076] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:36:03 2021] GET /compute/v2.1/servers/b195626c-7ee1-4679-b956-f7ef7d6328f6 => generated 1765 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:36:03.878176 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-80a26c31-3d41-442d-862a-8e52cb2508d8 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:36:03.878969 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-80a26c31-3d41-442d-862a-8e52cb2508d8 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] [instance: 62a16d76-4309-472d-9c9e-6e86b36a653c] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:36:03.886821 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-80a26c31-3d41-442d-862a-8e52cb2508d8 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:03.888051 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-80a26c31-3d41-442d-862a-8e52cb2508d8 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:03.888873 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-80a26c31-3d41-442d-862a-8e52cb2508d8 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:03.889362 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-80a26c31-3d41-442d-862a-8e52cb2508d8 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:03.901823 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-6389dd0e-5ff8-4c36-9436-be155de5903f tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2deb449189ba427a9b8fcb0e21f22566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2c8716a46f54187902492f8ce162f58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:03.910815 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-6389dd0e-5ff8-4c36-9436-be155de5903f tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "GET /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529" status: 200 len: 1676 microversion: 2.1 time: 0.237593 Feb 17 04:36:03.911448 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 583/1077] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:36:03 2021] GET /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529 => generated 1676 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:36:04.097344 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-80a26c31-3d41-442d-862a-8e52cb2508d8 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb8b6c44468c498f9dc0d3a8776433d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79050d22ac3d4c7eb85cd6a19be9ef10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:04.106846 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-80a26c31-3d41-442d-862a-8e52cb2508d8 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] 10.222.0.78 "GET /compute/v2.1/servers/62a16d76-4309-472d-9c9e-6e86b36a653c" status: 200 len: 1263 microversion: 2.1 time: 0.231970 Feb 17 04:36:04.107422 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 495/1078] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:36:03 2021] GET /compute/v2.1/servers/62a16d76-4309-472d-9c9e-6e86b36a653c => generated 1263 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:36:04.440374 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-fb4e2f14-5899-468c-ba7e-54baf2e81f27 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:36:04.441333 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-fb4e2f14-5899-468c-ba7e-54baf2e81f27 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:36:04.449128 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-fb4e2f14-5899-468c-ba7e-54baf2e81f27 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:04.449679 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-fb4e2f14-5899-468c-ba7e-54baf2e81f27 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:04.450657 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-fb4e2f14-5899-468c-ba7e-54baf2e81f27 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:04.451173 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-fb4e2f14-5899-468c-ba7e-54baf2e81f27 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:04.714690 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-78223627-e18d-4fc7-bb23-e5247fe59827 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:36:04.715890 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-78223627-e18d-4fc7-bb23-e5247fe59827 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] [instance: b195626c-7ee1-4679-b956-f7ef7d6328f6] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:36:04.723816 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-78223627-e18d-4fc7-bb23-e5247fe59827 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:04.724329 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-78223627-e18d-4fc7-bb23-e5247fe59827 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:04.725168 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-78223627-e18d-4fc7-bb23-e5247fe59827 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:04.725667 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-78223627-e18d-4fc7-bb23-e5247fe59827 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:04.783152 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-fb4e2f14-5899-468c-ba7e-54baf2e81f27 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "POST /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9/action" status: 200 len: 28627 microversion: 2.20 time: 0.346581 Feb 17 04:36:04.783865 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 584/1079] 10.222.0.78 () {62 vars in 1309 bytes} [Wed Feb 17 04:36:04 2021] POST /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9/action => generated 28627 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Feb 17 04:36:04.932208 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-2671459b-ced3-4191-a8c6-9913976f5761 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:36:04.932996 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-2671459b-ced3-4191-a8c6-9913976f5761 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: 29d1ce27-f63b-4523-88be-55f65a6a2529] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:36:04.944940 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-2671459b-ced3-4191-a8c6-9913976f5761 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:04.945451 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-2671459b-ced3-4191-a8c6-9913976f5761 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:04.946304 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-2671459b-ced3-4191-a8c6-9913976f5761 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:04.947725 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-2671459b-ced3-4191-a8c6-9913976f5761 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:04.950176 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-78223627-e18d-4fc7-bb23-e5247fe59827 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f3e4c3c174942c492405c9b112667de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5b2911946848de81be8f9741faa90f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:04.960887 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-78223627-e18d-4fc7-bb23-e5247fe59827 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] 10.222.0.78 "GET /compute/v2.1/servers/b195626c-7ee1-4679-b956-f7ef7d6328f6" status: 200 len: 1765 microversion: 2.1 time: 0.250150 Feb 17 04:36:04.961513 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 496/1080] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:36:04 2021] GET /compute/v2.1/servers/b195626c-7ee1-4679-b956-f7ef7d6328f6 => generated 1765 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:36:05.125735 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-8b47b216-74a6-4c2f-acee-892e79124be8 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:36:05.126417 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-8b47b216-74a6-4c2f-acee-892e79124be8 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] [instance: 62a16d76-4309-472d-9c9e-6e86b36a653c] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:36:05.134757 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-8b47b216-74a6-4c2f-acee-892e79124be8 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:05.134953 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-8b47b216-74a6-4c2f-acee-892e79124be8 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:05.136202 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-8b47b216-74a6-4c2f-acee-892e79124be8 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:05.136202 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-8b47b216-74a6-4c2f-acee-892e79124be8 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:05.176242 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-2671459b-ced3-4191-a8c6-9913976f5761 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2deb449189ba427a9b8fcb0e21f22566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2c8716a46f54187902492f8ce162f58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:05.185276 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-2671459b-ced3-4191-a8c6-9913976f5761 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "GET /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529" status: 200 len: 1676 microversion: 2.1 time: 0.257716 Feb 17 04:36:05.186101 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 585/1081] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:36:04 2021] GET /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529 => generated 1676 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:36:05.348069 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-8b47b216-74a6-4c2f-acee-892e79124be8 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb8b6c44468c498f9dc0d3a8776433d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79050d22ac3d4c7eb85cd6a19be9ef10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:05.357808 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-8b47b216-74a6-4c2f-acee-892e79124be8 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] 10.222.0.78 "GET /compute/v2.1/servers/62a16d76-4309-472d-9c9e-6e86b36a653c" status: 200 len: 1447 microversion: 2.1 time: 0.236693 Feb 17 04:36:05.358415 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 497/1082] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:36:05 2021] GET /compute/v2.1/servers/62a16d76-4309-472d-9c9e-6e86b36a653c => generated 1447 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:36:05.375327 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-4e152a89-3d43-4d1c-a5f4-ae281959c581 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:36:05.376001 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-4e152a89-3d43-4d1c-a5f4-ae281959c581 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] [instance: 62a16d76-4309-472d-9c9e-6e86b36a653c] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:36:05.383781 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-4e152a89-3d43-4d1c-a5f4-ae281959c581 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:05.384284 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-4e152a89-3d43-4d1c-a5f4-ae281959c581 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:05.385116 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-4e152a89-3d43-4d1c-a5f4-ae281959c581 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:05.385607 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-4e152a89-3d43-4d1c-a5f4-ae281959c581 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:05.593945 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-4e152a89-3d43-4d1c-a5f4-ae281959c581 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb8b6c44468c498f9dc0d3a8776433d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79050d22ac3d4c7eb85cd6a19be9ef10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:05.602846 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-4e152a89-3d43-4d1c-a5f4-ae281959c581 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] 10.222.0.78 "GET /compute/v2.1/servers/62a16d76-4309-472d-9c9e-6e86b36a653c" status: 200 len: 1447 microversion: 2.1 time: 0.231554 Feb 17 04:36:05.603475 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 586/1083] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:36:05 2021] GET /compute/v2.1/servers/62a16d76-4309-472d-9c9e-6e86b36a653c => generated 1447 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:36:05.621082 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-4879036c-cf9b-4b95-895d-07af8b282b96 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Action: 'create', calling method: .version_select at 0x7f57c8653bf8>, body: {"pool": null} {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:36:05.797118 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-b681e75f-d1b7-4f71-b97f-c6189e089f3e tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:36:05.798213 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-b681e75f-d1b7-4f71-b97f-c6189e089f3e tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:36:05.806416 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-b681e75f-d1b7-4f71-b97f-c6189e089f3e tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:05.806923 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-b681e75f-d1b7-4f71-b97f-c6189e089f3e tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:05.807893 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-b681e75f-d1b7-4f71-b97f-c6189e089f3e tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:05.808314 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-b681e75f-d1b7-4f71-b97f-c6189e089f3e tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:05.982498 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-b681e75f-d1b7-4f71-b97f-c6189e089f3e tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "POST /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9/action" status: 200 len: 28627 microversion: 2.20 time: 0.189989 Feb 17 04:36:05.986588 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 587/1084] 10.222.0.78 () {62 vars in 1309 bytes} [Wed Feb 17 04:36:05 2021] POST /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9/action => generated 28627 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Feb 17 04:36:05.988719 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-1422b365-1c24-44d6-a97f-199d65dbd399 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:36:05.989481 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-1422b365-1c24-44d6-a97f-199d65dbd399 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] [instance: b195626c-7ee1-4679-b956-f7ef7d6328f6] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:36:05.998860 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-1422b365-1c24-44d6-a97f-199d65dbd399 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:05.999422 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-1422b365-1c24-44d6-a97f-199d65dbd399 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:06.000268 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-1422b365-1c24-44d6-a97f-199d65dbd399 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:06.000755 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-1422b365-1c24-44d6-a97f-199d65dbd399 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:06.221894 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-1422b365-1c24-44d6-a97f-199d65dbd399 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f3e4c3c174942c492405c9b112667de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5b2911946848de81be8f9741faa90f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:06.231494 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-1422b365-1c24-44d6-a97f-199d65dbd399 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] 10.222.0.78 "GET /compute/v2.1/servers/b195626c-7ee1-4679-b956-f7ef7d6328f6" status: 200 len: 1765 microversion: 2.1 time: 0.247268 Feb 17 04:36:06.232157 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 588/1085] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:36:05 2021] GET /compute/v2.1/servers/b195626c-7ee1-4679-b956-f7ef7d6328f6 => generated 1765 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:36:06.237101 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-f8f55cf9-8f0a-4c8a-9d2e-0d177d2b8136 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:36:06.237760 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-f8f55cf9-8f0a-4c8a-9d2e-0d177d2b8136 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: 29d1ce27-f63b-4523-88be-55f65a6a2529] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:36:06.245365 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-f8f55cf9-8f0a-4c8a-9d2e-0d177d2b8136 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:06.245874 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-f8f55cf9-8f0a-4c8a-9d2e-0d177d2b8136 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:06.246781 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-f8f55cf9-8f0a-4c8a-9d2e-0d177d2b8136 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:06.247302 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-f8f55cf9-8f0a-4c8a-9d2e-0d177d2b8136 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:06.466189 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-f8f55cf9-8f0a-4c8a-9d2e-0d177d2b8136 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2deb449189ba427a9b8fcb0e21f22566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2c8716a46f54187902492f8ce162f58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:06.475481 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-f8f55cf9-8f0a-4c8a-9d2e-0d177d2b8136 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "GET /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529" status: 200 len: 1676 microversion: 2.1 time: 0.242278 Feb 17 04:36:06.476052 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 589/1086] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:36:06 2021] GET /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529 => generated 1676 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:36:06.994517 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-94a34e78-47df-468b-9816-911922d9f044 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:36:06.995745 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-94a34e78-47df-468b-9816-911922d9f044 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:36:07.005508 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-94a34e78-47df-468b-9816-911922d9f044 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:07.006022 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-94a34e78-47df-468b-9816-911922d9f044 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:07.006866 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-94a34e78-47df-468b-9816-911922d9f044 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:07.007386 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-94a34e78-47df-468b-9816-911922d9f044 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:07.163296 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-94a34e78-47df-468b-9816-911922d9f044 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "POST /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9/action" status: 200 len: 28627 microversion: 2.20 time: 0.172621 Feb 17 04:36:07.164922 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 590/1087] 10.222.0.78 () {62 vars in 1309 bytes} [Wed Feb 17 04:36:06 2021] POST /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9/action => generated 28627 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Feb 17 04:36:07.251725 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-3b5d8681-d045-47a1-8e43-d8e2b8fdb18b tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:36:07.252661 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-3b5d8681-d045-47a1-8e43-d8e2b8fdb18b tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] [instance: b195626c-7ee1-4679-b956-f7ef7d6328f6] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:36:07.261559 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-3b5d8681-d045-47a1-8e43-d8e2b8fdb18b tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:07.262426 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-3b5d8681-d045-47a1-8e43-d8e2b8fdb18b tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:07.263418 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-3b5d8681-d045-47a1-8e43-d8e2b8fdb18b tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:07.263922 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-3b5d8681-d045-47a1-8e43-d8e2b8fdb18b tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:07.479069 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-3b5d8681-d045-47a1-8e43-d8e2b8fdb18b tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f3e4c3c174942c492405c9b112667de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5b2911946848de81be8f9741faa90f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:07.489706 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-3b5d8681-d045-47a1-8e43-d8e2b8fdb18b tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] 10.222.0.78 "GET /compute/v2.1/servers/b195626c-7ee1-4679-b956-f7ef7d6328f6" status: 200 len: 1765 microversion: 2.1 time: 0.243212 Feb 17 04:36:07.490417 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 591/1088] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:36:07 2021] GET /compute/v2.1/servers/b195626c-7ee1-4679-b956-f7ef7d6328f6 => generated 1765 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:36:07.495579 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-285e2c05-6a86-4250-ad4c-b346882268c0 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:36:07.496102 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-285e2c05-6a86-4250-ad4c-b346882268c0 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: 29d1ce27-f63b-4523-88be-55f65a6a2529] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:36:07.504189 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-285e2c05-6a86-4250-ad4c-b346882268c0 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:07.504708 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-285e2c05-6a86-4250-ad4c-b346882268c0 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:07.505553 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-285e2c05-6a86-4250-ad4c-b346882268c0 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:07.506043 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-285e2c05-6a86-4250-ad4c-b346882268c0 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:07.736897 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-285e2c05-6a86-4250-ad4c-b346882268c0 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2deb449189ba427a9b8fcb0e21f22566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2c8716a46f54187902492f8ce162f58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:07.745788 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-285e2c05-6a86-4250-ad4c-b346882268c0 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "GET /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529" status: 200 len: 1676 microversion: 2.1 time: 0.254316 Feb 17 04:36:07.746408 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 592/1089] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:36:07 2021] GET /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529 => generated 1676 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:36:07.959610 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-4879036c-cf9b-4b95-895d-07af8b282b96 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] 10.222.0.78 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.342442 Feb 17 04:36:07.960261 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 498/1090] 10.222.0.78 () {60 vars in 1160 bytes} [Wed Feb 17 04:36:05 2021] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2344 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:36:07.972121 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-139829ab-7d6f-45ca-bc8d-28907aef21ba tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Action: 'action', calling method: .version_select at 0x7f57ca00eae8>, body: {"addFloatingIp": {"address": "172.27.1.153"}} {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:36:07.973430 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-139829ab-7d6f-45ca-bc8d-28907aef21ba tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] [instance: 62a16d76-4309-472d-9c9e-6e86b36a653c] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:36:07.981972 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-139829ab-7d6f-45ca-bc8d-28907aef21ba tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:07.982526 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-139829ab-7d6f-45ca-bc8d-28907aef21ba tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:07.983383 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-139829ab-7d6f-45ca-bc8d-28907aef21ba tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:07.983870 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-139829ab-7d6f-45ca-bc8d-28907aef21ba tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:08.050627 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-139829ab-7d6f-45ca-bc8d-28907aef21ba tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Acquired lock "refresh_cache-62a16d76-4309-472d-9c9e-6e86b36a653c" {{(pid=98179) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:266}} Feb 17 04:36:08.176671 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-f9aa0c8d-56ff-4ba6-b44d-7ac0ee6fbbcd tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:36:08.178093 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-f9aa0c8d-56ff-4ba6-b44d-7ac0ee6fbbcd tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:36:08.187592 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-f9aa0c8d-56ff-4ba6-b44d-7ac0ee6fbbcd tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:08.188106 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-f9aa0c8d-56ff-4ba6-b44d-7ac0ee6fbbcd tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:08.188965 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-f9aa0c8d-56ff-4ba6-b44d-7ac0ee6fbbcd tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:08.189466 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-f9aa0c8d-56ff-4ba6-b44d-7ac0ee6fbbcd tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:08.358148 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-f9aa0c8d-56ff-4ba6-b44d-7ac0ee6fbbcd tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "POST /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9/action" status: 200 len: 28627 microversion: 2.20 time: 0.185375 Feb 17 04:36:08.360094 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 499/1091] 10.222.0.78 () {62 vars in 1309 bytes} [Wed Feb 17 04:36:08 2021] POST /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9/action => generated 28627 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Feb 17 04:36:08.508887 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-82834040-bf13-4d7c-b302-ae9cdae2f024 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:36:08.509552 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-82834040-bf13-4d7c-b302-ae9cdae2f024 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] [instance: b195626c-7ee1-4679-b956-f7ef7d6328f6] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:36:08.518615 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-82834040-bf13-4d7c-b302-ae9cdae2f024 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:08.519165 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-82834040-bf13-4d7c-b302-ae9cdae2f024 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:08.520007 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-82834040-bf13-4d7c-b302-ae9cdae2f024 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:08.520498 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-82834040-bf13-4d7c-b302-ae9cdae2f024 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:08.740462 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-82834040-bf13-4d7c-b302-ae9cdae2f024 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f3e4c3c174942c492405c9b112667de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5b2911946848de81be8f9741faa90f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:08.749933 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-82834040-bf13-4d7c-b302-ae9cdae2f024 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] 10.222.0.78 "GET /compute/v2.1/servers/b195626c-7ee1-4679-b956-f7ef7d6328f6" status: 200 len: 1765 microversion: 2.1 time: 0.245558 Feb 17 04:36:08.750537 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 500/1092] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:36:08 2021] GET /compute/v2.1/servers/b195626c-7ee1-4679-b956-f7ef7d6328f6 => generated 1765 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:36:08.765096 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-86e89162-df41-45cd-ac65-ad661f583bb5 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:36:08.765735 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-86e89162-df41-45cd-ac65-ad661f583bb5 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: 29d1ce27-f63b-4523-88be-55f65a6a2529] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:36:08.773360 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-86e89162-df41-45cd-ac65-ad661f583bb5 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:08.773867 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-86e89162-df41-45cd-ac65-ad661f583bb5 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:08.774694 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-86e89162-df41-45cd-ac65-ad661f583bb5 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:08.775217 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-86e89162-df41-45cd-ac65-ad661f583bb5 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:08.995779 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-86e89162-df41-45cd-ac65-ad661f583bb5 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2deb449189ba427a9b8fcb0e21f22566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2c8716a46f54187902492f8ce162f58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:09.006190 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-86e89162-df41-45cd-ac65-ad661f583bb5 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "GET /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529" status: 200 len: 1676 microversion: 2.1 time: 0.245415 Feb 17 04:36:09.006928 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 501/1093] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:36:08 2021] GET /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529 => generated 1676 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:36:09.370972 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-6982f79f-775e-4684-b398-4e02eb4986d1 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:36:09.372432 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-6982f79f-775e-4684-b398-4e02eb4986d1 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:36:09.380393 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-6982f79f-775e-4684-b398-4e02eb4986d1 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:09.380909 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-6982f79f-775e-4684-b398-4e02eb4986d1 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:09.381824 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-6982f79f-775e-4684-b398-4e02eb4986d1 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:09.382299 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-6982f79f-775e-4684-b398-4e02eb4986d1 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:09.542083 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-6982f79f-775e-4684-b398-4e02eb4986d1 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "POST /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9/action" status: 200 len: 28627 microversion: 2.20 time: 0.174904 Feb 17 04:36:09.542791 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 502/1094] 10.222.0.78 () {62 vars in 1309 bytes} [Wed Feb 17 04:36:09 2021] POST /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9/action => generated 28627 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Feb 17 04:36:09.769532 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-ac8d4abe-251f-4f9c-81f1-a73987470487 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:36:09.770305 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-ac8d4abe-251f-4f9c-81f1-a73987470487 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] [instance: b195626c-7ee1-4679-b956-f7ef7d6328f6] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:36:09.779154 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-ac8d4abe-251f-4f9c-81f1-a73987470487 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:09.779661 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-ac8d4abe-251f-4f9c-81f1-a73987470487 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:09.780499 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-ac8d4abe-251f-4f9c-81f1-a73987470487 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:09.780990 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-ac8d4abe-251f-4f9c-81f1-a73987470487 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:09.999890 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-ac8d4abe-251f-4f9c-81f1-a73987470487 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f3e4c3c174942c492405c9b112667de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5b2911946848de81be8f9741faa90f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:10.009463 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-ac8d4abe-251f-4f9c-81f1-a73987470487 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] 10.222.0.78 "GET /compute/v2.1/servers/b195626c-7ee1-4679-b956-f7ef7d6328f6" status: 200 len: 1765 microversion: 2.1 time: 0.244666 Feb 17 04:36:10.010059 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 503/1095] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:36:09 2021] GET /compute/v2.1/servers/b195626c-7ee1-4679-b956-f7ef7d6328f6 => generated 1765 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:36:10.024219 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-d5e5c718-85b4-4cb1-8253-90904eca4f09 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:36:10.024900 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-d5e5c718-85b4-4cb1-8253-90904eca4f09 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: 29d1ce27-f63b-4523-88be-55f65a6a2529] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:36:10.032786 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-d5e5c718-85b4-4cb1-8253-90904eca4f09 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:10.033305 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-d5e5c718-85b4-4cb1-8253-90904eca4f09 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:10.034155 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-d5e5c718-85b4-4cb1-8253-90904eca4f09 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:10.034662 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-d5e5c718-85b4-4cb1-8253-90904eca4f09 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:10.235909 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.network.neutron [None req-139829ab-7d6f-45ca-bc8d-28907aef21ba tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] [instance: 62a16d76-4309-472d-9c9e-6e86b36a653c] Building network info cache for instance {{(pid=98179) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1836}} Feb 17 04:36:10.271705 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-d5e5c718-85b4-4cb1-8253-90904eca4f09 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2deb449189ba427a9b8fcb0e21f22566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2c8716a46f54187902492f8ce162f58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:10.281214 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-d5e5c718-85b4-4cb1-8253-90904eca4f09 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "GET /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529" status: 200 len: 1676 microversion: 2.1 time: 0.260724 Feb 17 04:36:10.282016 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 504/1096] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:36:10 2021] GET /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529 => generated 1676 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:36:10.286930 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [req-d687d797-a5f1-4679-b002-f051fea35af2 req-464dc3e0-7430-4288-ae55-f590270343bd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "62a16d76-4309-472d-9c9e-6e86b36a653c", "tag": "5ba59ff1-b19b-4ba6-9ef2-07dccd6b3a55"}]} {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:36:10.288614 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:36:10.288614 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: warnings.warn(msg) Feb 17 04:36:10.298688 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [req-d687d797-a5f1-4679-b002-f051fea35af2 req-464dc3e0-7430-4288-ae55-f590270343bd service nova] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:10.299259 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [req-d687d797-a5f1-4679-b002-f051fea35af2 req-464dc3e0-7430-4288-ae55-f590270343bd service nova] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:10.317144 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.compute.server_external_events [req-d687d797-a5f1-4679-b002-f051fea35af2 req-464dc3e0-7430-4288-ae55-f590270343bd service nova] Creating event network-changed:5ba59ff1-b19b-4ba6-9ef2-07dccd6b3a55 for instance 62a16d76-4309-472d-9c9e-6e86b36a653c on hv-cinder-75998 Feb 17 04:36:10.322321 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [req-d687d797-a5f1-4679-b002-f051fea35af2 req-464dc3e0-7430-4288-ae55-f590270343bd service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039121 Feb 17 04:36:10.323215 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 505/1097] 10.222.0.78 () {64 vars in 1308 bytes} [Wed Feb 17 04:36:10 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:36:10.555618 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-8971d7bc-357f-47d4-bac5-f68afc2d5e1d tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:36:10.556768 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-8971d7bc-357f-47d4-bac5-f68afc2d5e1d tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:36:10.565220 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-8971d7bc-357f-47d4-bac5-f68afc2d5e1d tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:10.565733 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-8971d7bc-357f-47d4-bac5-f68afc2d5e1d tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:10.566602 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-8971d7bc-357f-47d4-bac5-f68afc2d5e1d tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:10.567130 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-8971d7bc-357f-47d4-bac5-f68afc2d5e1d tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:10.723709 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-8971d7bc-357f-47d4-bac5-f68afc2d5e1d tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "POST /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9/action" status: 200 len: 28627 microversion: 2.20 time: 0.172353 Feb 17 04:36:10.724547 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 506/1098] 10.222.0.78 () {62 vars in 1309 bytes} [Wed Feb 17 04:36:10 2021] POST /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9/action => generated 28627 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Feb 17 04:36:11.028183 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-f02ee52f-16b7-4046-861c-9e94f0951e54 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:36:11.028852 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-f02ee52f-16b7-4046-861c-9e94f0951e54 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] [instance: b195626c-7ee1-4679-b956-f7ef7d6328f6] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:36:11.037972 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-f02ee52f-16b7-4046-861c-9e94f0951e54 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:11.038500 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-f02ee52f-16b7-4046-861c-9e94f0951e54 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:11.039407 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-f02ee52f-16b7-4046-861c-9e94f0951e54 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:11.039911 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-f02ee52f-16b7-4046-861c-9e94f0951e54 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:11.104598 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.network.neutron [None req-139829ab-7d6f-45ca-bc8d-28907aef21ba tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] [instance: 62a16d76-4309-472d-9c9e-6e86b36a653c] Updating instance_info_cache with network_info: [{"id": "5ba59ff1-b19b-4ba6-9ef2-07dccd6b3a55", "address": "fa:16:3e:08:4c:70", "network": {"id": "736cba91-156c-4244-b589-a5a8068074fb", "bridge": "br-int", "label": "tempest-TestShelveInstance-1453013093-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.27.1.153", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "79050d22ac3d4c7eb85cd6a19be9ef10", "mtu": 1450, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, "devname": "tap5ba59ff1-b1", "ovs_interfaceid": "5ba59ff1-b19b-4ba6-9ef2-07dccd6b3a55", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "meta": {}}] {{(pid=98179) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Feb 17 04:36:11.123056 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-139829ab-7d6f-45ca-bc8d-28907aef21ba tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Releasing lock "refresh_cache-62a16d76-4309-472d-9c9e-6e86b36a653c" {{(pid=98179) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:282}} Feb 17 04:36:11.124107 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-139829ab-7d6f-45ca-bc8d-28907aef21ba tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] 10.222.0.78 "POST /compute/v2.1/servers/62a16d76-4309-472d-9c9e-6e86b36a653c/action" status: 202 len: 0 microversion: 2.1 time: 3.156247 Feb 17 04:36:11.125049 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 593/1099] 10.222.0.78 () {60 vars in 1268 bytes} [Wed Feb 17 04:36:07 2021] POST /compute/v2.1/servers/62a16d76-4309-472d-9c9e-6e86b36a653c/action => generated 0 bytes in 3158 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Feb 17 04:36:11.299475 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-9dd47e96-b20f-4a91-b50b-b4931cd986f9 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:36:11.300216 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-9dd47e96-b20f-4a91-b50b-b4931cd986f9 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: 29d1ce27-f63b-4523-88be-55f65a6a2529] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:36:11.309923 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-9dd47e96-b20f-4a91-b50b-b4931cd986f9 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:11.310608 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-9dd47e96-b20f-4a91-b50b-b4931cd986f9 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:11.311800 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-9dd47e96-b20f-4a91-b50b-b4931cd986f9 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:11.312394 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-9dd47e96-b20f-4a91-b50b-b4931cd986f9 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:11.397111 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-f02ee52f-16b7-4046-861c-9e94f0951e54 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f3e4c3c174942c492405c9b112667de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5b2911946848de81be8f9741faa90f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:11.406960 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-f02ee52f-16b7-4046-861c-9e94f0951e54 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] 10.222.0.78 "GET /compute/v2.1/servers/b195626c-7ee1-4679-b956-f7ef7d6328f6" status: 200 len: 1765 microversion: 2.1 time: 0.383493 Feb 17 04:36:11.407818 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 507/1100] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:36:11 2021] GET /compute/v2.1/servers/b195626c-7ee1-4679-b956-f7ef7d6328f6 => generated 1765 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:36:11.538270 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-9dd47e96-b20f-4a91-b50b-b4931cd986f9 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2deb449189ba427a9b8fcb0e21f22566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2c8716a46f54187902492f8ce162f58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:11.547502 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-9dd47e96-b20f-4a91-b50b-b4931cd986f9 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "GET /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529" status: 200 len: 1676 microversion: 2.1 time: 0.252360 Feb 17 04:36:11.548124 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 594/1101] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:36:11 2021] GET /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529 => generated 1676 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:36:11.735566 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-1344bbc5-80bf-4651-ae46-2fc02ff47246 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:36:11.736619 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-1344bbc5-80bf-4651-ae46-2fc02ff47246 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:36:11.744520 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-1344bbc5-80bf-4651-ae46-2fc02ff47246 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:11.745037 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-1344bbc5-80bf-4651-ae46-2fc02ff47246 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:11.745883 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-1344bbc5-80bf-4651-ae46-2fc02ff47246 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:11.746403 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-1344bbc5-80bf-4651-ae46-2fc02ff47246 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:11.890401 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-1344bbc5-80bf-4651-ae46-2fc02ff47246 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "POST /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9/action" status: 200 len: 28627 microversion: 2.20 time: 0.158860 Feb 17 04:36:11.892079 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 508/1102] 10.222.0.78 () {62 vars in 1309 bytes} [Wed Feb 17 04:36:11 2021] POST /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9/action => generated 28627 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:36:12.425968 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-49a593c0-e84c-493f-9228-658e0a9e70e6 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:36:12.426582 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-49a593c0-e84c-493f-9228-658e0a9e70e6 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] [instance: b195626c-7ee1-4679-b956-f7ef7d6328f6] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:36:12.434463 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-49a593c0-e84c-493f-9228-658e0a9e70e6 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:12.434973 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-49a593c0-e84c-493f-9228-658e0a9e70e6 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:12.435860 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-49a593c0-e84c-493f-9228-658e0a9e70e6 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:12.436361 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-49a593c0-e84c-493f-9228-658e0a9e70e6 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:12.566919 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-9fe09337-128e-4039-b90c-57c86731721f tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:36:12.567825 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-9fe09337-128e-4039-b90c-57c86731721f tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: 29d1ce27-f63b-4523-88be-55f65a6a2529] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:36:12.576948 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-9fe09337-128e-4039-b90c-57c86731721f tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:12.577459 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-9fe09337-128e-4039-b90c-57c86731721f tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:12.578301 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-9fe09337-128e-4039-b90c-57c86731721f tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:12.578793 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-9fe09337-128e-4039-b90c-57c86731721f tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:12.655879 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-49a593c0-e84c-493f-9228-658e0a9e70e6 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f3e4c3c174942c492405c9b112667de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5b2911946848de81be8f9741faa90f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:12.665340 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-49a593c0-e84c-493f-9228-658e0a9e70e6 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] 10.222.0.78 "GET /compute/v2.1/servers/b195626c-7ee1-4679-b956-f7ef7d6328f6" status: 200 len: 1765 microversion: 2.1 time: 0.243524 Feb 17 04:36:12.665949 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 595/1103] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:36:12 2021] GET /compute/v2.1/servers/b195626c-7ee1-4679-b956-f7ef7d6328f6 => generated 1765 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:36:12.796165 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-9fe09337-128e-4039-b90c-57c86731721f tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2deb449189ba427a9b8fcb0e21f22566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2c8716a46f54187902492f8ce162f58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:12.805125 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-9fe09337-128e-4039-b90c-57c86731721f tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "GET /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529" status: 200 len: 1676 microversion: 2.1 time: 0.242875 Feb 17 04:36:12.805737 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 509/1104] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:36:12 2021] GET /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529 => generated 1676 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:36:12.903200 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-417fbd76-6dcc-41a0-a59b-aaf0410e6ff2 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:36:12.904374 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-417fbd76-6dcc-41a0-a59b-aaf0410e6ff2 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:36:12.912286 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-417fbd76-6dcc-41a0-a59b-aaf0410e6ff2 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:12.912810 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-417fbd76-6dcc-41a0-a59b-aaf0410e6ff2 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:12.913651 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-417fbd76-6dcc-41a0-a59b-aaf0410e6ff2 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:12.914150 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-417fbd76-6dcc-41a0-a59b-aaf0410e6ff2 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:13.047679 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-417fbd76-6dcc-41a0-a59b-aaf0410e6ff2 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "POST /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9/action" status: 200 len: 28627 microversion: 2.20 time: 0.148421 Feb 17 04:36:13.048446 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 596/1105] 10.222.0.78 () {62 vars in 1309 bytes} [Wed Feb 17 04:36:12 2021] POST /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9/action => generated 28627 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:36:13.684108 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-4fc59afb-47ee-4e5c-ac6d-762ec397e69b tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:36:13.684781 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-4fc59afb-47ee-4e5c-ac6d-762ec397e69b tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] [instance: b195626c-7ee1-4679-b956-f7ef7d6328f6] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:36:13.693155 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-4fc59afb-47ee-4e5c-ac6d-762ec397e69b tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:13.693666 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-4fc59afb-47ee-4e5c-ac6d-762ec397e69b tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:13.694513 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-4fc59afb-47ee-4e5c-ac6d-762ec397e69b tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:13.695013 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-4fc59afb-47ee-4e5c-ac6d-762ec397e69b tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:13.825782 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-e5744e47-0c8e-4031-9bee-03ecbb1b9122 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:36:13.826720 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-e5744e47-0c8e-4031-9bee-03ecbb1b9122 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: 29d1ce27-f63b-4523-88be-55f65a6a2529] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:36:13.835624 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-e5744e47-0c8e-4031-9bee-03ecbb1b9122 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:13.836140 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-e5744e47-0c8e-4031-9bee-03ecbb1b9122 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:13.837025 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-e5744e47-0c8e-4031-9bee-03ecbb1b9122 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:13.837651 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-e5744e47-0c8e-4031-9bee-03ecbb1b9122 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:13.912089 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-4fc59afb-47ee-4e5c-ac6d-762ec397e69b tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f3e4c3c174942c492405c9b112667de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5b2911946848de81be8f9741faa90f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:13.921907 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-4fc59afb-47ee-4e5c-ac6d-762ec397e69b tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] 10.222.0.78 "GET /compute/v2.1/servers/b195626c-7ee1-4679-b956-f7ef7d6328f6" status: 200 len: 1765 microversion: 2.1 time: 0.241787 Feb 17 04:36:13.922517 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 510/1106] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:36:13 2021] GET /compute/v2.1/servers/b195626c-7ee1-4679-b956-f7ef7d6328f6 => generated 1765 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:36:14.051082 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-e5744e47-0c8e-4031-9bee-03ecbb1b9122 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2deb449189ba427a9b8fcb0e21f22566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2c8716a46f54187902492f8ce162f58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:14.060061 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-e5744e47-0c8e-4031-9bee-03ecbb1b9122 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "GET /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529" status: 200 len: 1676 microversion: 2.1 time: 0.239669 Feb 17 04:36:14.060449 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-3cdf5213-1fc2-46a3-acff-f0c5e6ee43c4 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:36:14.060651 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 597/1107] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:36:13 2021] GET /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529 => generated 1676 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:36:14.061726 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-3cdf5213-1fc2-46a3-acff-f0c5e6ee43c4 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:36:14.069621 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-3cdf5213-1fc2-46a3-acff-f0c5e6ee43c4 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:14.070110 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-3cdf5213-1fc2-46a3-acff-f0c5e6ee43c4 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:14.070987 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-3cdf5213-1fc2-46a3-acff-f0c5e6ee43c4 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:14.071525 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-3cdf5213-1fc2-46a3-acff-f0c5e6ee43c4 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:14.348944 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-3cdf5213-1fc2-46a3-acff-f0c5e6ee43c4 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "POST /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9/action" status: 200 len: 28627 microversion: 2.20 time: 0.292506 Feb 17 04:36:14.349563 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 511/1108] 10.222.0.78 () {62 vars in 1309 bytes} [Wed Feb 17 04:36:14 2021] POST /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9/action => generated 28627 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Feb 17 04:36:14.940609 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-490f4db3-9b82-4a22-bf3a-9e261da14ed9 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:36:14.941284 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-490f4db3-9b82-4a22-bf3a-9e261da14ed9 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] [instance: b195626c-7ee1-4679-b956-f7ef7d6328f6] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:36:14.950481 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-490f4db3-9b82-4a22-bf3a-9e261da14ed9 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:14.950998 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-490f4db3-9b82-4a22-bf3a-9e261da14ed9 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:14.952557 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-490f4db3-9b82-4a22-bf3a-9e261da14ed9 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:14.953065 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-490f4db3-9b82-4a22-bf3a-9e261da14ed9 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:15.079380 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-609c7a81-ab57-4fe6-9b40-16806eb2dc26 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:36:15.080158 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-609c7a81-ab57-4fe6-9b40-16806eb2dc26 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: 29d1ce27-f63b-4523-88be-55f65a6a2529] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:36:15.088705 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-609c7a81-ab57-4fe6-9b40-16806eb2dc26 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:15.089212 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-609c7a81-ab57-4fe6-9b40-16806eb2dc26 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:15.091090 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-609c7a81-ab57-4fe6-9b40-16806eb2dc26 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:15.091654 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-609c7a81-ab57-4fe6-9b40-16806eb2dc26 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:15.170928 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-490f4db3-9b82-4a22-bf3a-9e261da14ed9 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f3e4c3c174942c492405c9b112667de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5b2911946848de81be8f9741faa90f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:15.181237 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-490f4db3-9b82-4a22-bf3a-9e261da14ed9 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] 10.222.0.78 "GET /compute/v2.1/servers/b195626c-7ee1-4679-b956-f7ef7d6328f6" status: 200 len: 1765 microversion: 2.1 time: 0.244804 Feb 17 04:36:15.181957 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 598/1109] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:36:14 2021] GET /compute/v2.1/servers/b195626c-7ee1-4679-b956-f7ef7d6328f6 => generated 1765 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:36:15.313911 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-609c7a81-ab57-4fe6-9b40-16806eb2dc26 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2deb449189ba427a9b8fcb0e21f22566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2c8716a46f54187902492f8ce162f58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:15.322824 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-609c7a81-ab57-4fe6-9b40-16806eb2dc26 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "GET /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529" status: 200 len: 1676 microversion: 2.1 time: 0.248584 Feb 17 04:36:15.323462 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 512/1110] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:36:15 2021] GET /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529 => generated 1676 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:36:15.361651 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-46a78711-b568-40ec-bb03-8328dcc3a856 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:36:15.362765 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-46a78711-b568-40ec-bb03-8328dcc3a856 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:36:15.370488 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-46a78711-b568-40ec-bb03-8328dcc3a856 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:15.370987 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-46a78711-b568-40ec-bb03-8328dcc3a856 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:15.371999 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-46a78711-b568-40ec-bb03-8328dcc3a856 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:15.372489 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-46a78711-b568-40ec-bb03-8328dcc3a856 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:15.542918 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-46a78711-b568-40ec-bb03-8328dcc3a856 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "POST /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9/action" status: 200 len: 28627 microversion: 2.20 time: 0.185170 Feb 17 04:36:15.544078 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 599/1111] 10.222.0.78 () {62 vars in 1309 bytes} [Wed Feb 17 04:36:15 2021] POST /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9/action => generated 28627 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:36:16.199725 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-0b082088-29e0-43a4-ad73-bce804c0dc09 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:36:16.200463 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-0b082088-29e0-43a4-ad73-bce804c0dc09 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] [instance: b195626c-7ee1-4679-b956-f7ef7d6328f6] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:36:16.208773 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-0b082088-29e0-43a4-ad73-bce804c0dc09 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:16.209275 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-0b082088-29e0-43a4-ad73-bce804c0dc09 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:16.210109 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-0b082088-29e0-43a4-ad73-bce804c0dc09 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:16.210598 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-0b082088-29e0-43a4-ad73-bce804c0dc09 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:16.343838 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-a8174844-21ab-4567-ba07-5186f82add64 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:36:16.344775 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-a8174844-21ab-4567-ba07-5186f82add64 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: 29d1ce27-f63b-4523-88be-55f65a6a2529] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:36:16.354406 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-a8174844-21ab-4567-ba07-5186f82add64 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:16.355064 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-a8174844-21ab-4567-ba07-5186f82add64 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:16.356869 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-a8174844-21ab-4567-ba07-5186f82add64 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:16.357462 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-a8174844-21ab-4567-ba07-5186f82add64 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:16.443390 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-0b082088-29e0-43a4-ad73-bce804c0dc09 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f3e4c3c174942c492405c9b112667de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5b2911946848de81be8f9741faa90f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:16.453810 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-0b082088-29e0-43a4-ad73-bce804c0dc09 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] 10.222.0.78 "GET /compute/v2.1/servers/b195626c-7ee1-4679-b956-f7ef7d6328f6" status: 200 len: 1765 microversion: 2.1 time: 0.258035 Feb 17 04:36:16.454386 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 513/1112] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:36:16 2021] GET /compute/v2.1/servers/b195626c-7ee1-4679-b956-f7ef7d6328f6 => generated 1765 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:36:16.554569 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-085aa88a-4b9e-4295-aeed-8d60023b0d4e tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:36:16.555976 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-085aa88a-4b9e-4295-aeed-8d60023b0d4e tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:36:16.564985 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-085aa88a-4b9e-4295-aeed-8d60023b0d4e tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:16.565503 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-085aa88a-4b9e-4295-aeed-8d60023b0d4e tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:16.566373 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-085aa88a-4b9e-4295-aeed-8d60023b0d4e tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:16.566871 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-085aa88a-4b9e-4295-aeed-8d60023b0d4e tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:16.717197 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-085aa88a-4b9e-4295-aeed-8d60023b0d4e tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "POST /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9/action" status: 200 len: 28627 microversion: 2.20 time: 0.166451 Feb 17 04:36:16.717816 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 514/1113] 10.222.0.78 () {62 vars in 1309 bytes} [Wed Feb 17 04:36:16 2021] POST /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9/action => generated 28627 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Feb 17 04:36:16.789936 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-a8174844-21ab-4567-ba07-5186f82add64 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2deb449189ba427a9b8fcb0e21f22566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2c8716a46f54187902492f8ce162f58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:16.800069 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-a8174844-21ab-4567-ba07-5186f82add64 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "GET /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529" status: 200 len: 1676 microversion: 2.1 time: 0.461843 Feb 17 04:36:16.800678 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 600/1114] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:36:16 2021] GET /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529 => generated 1676 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:36:17.472778 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-a293fa89-1574-4004-adcf-656a92710571 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:36:17.473557 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-a293fa89-1574-4004-adcf-656a92710571 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] [instance: b195626c-7ee1-4679-b956-f7ef7d6328f6] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:36:17.482890 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-a293fa89-1574-4004-adcf-656a92710571 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:17.483432 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-a293fa89-1574-4004-adcf-656a92710571 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:17.484537 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-a293fa89-1574-4004-adcf-656a92710571 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:17.485041 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-a293fa89-1574-4004-adcf-656a92710571 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:17.701015 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-a293fa89-1574-4004-adcf-656a92710571 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f3e4c3c174942c492405c9b112667de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5b2911946848de81be8f9741faa90f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:17.710550 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-a293fa89-1574-4004-adcf-656a92710571 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] 10.222.0.78 "GET /compute/v2.1/servers/b195626c-7ee1-4679-b956-f7ef7d6328f6" status: 200 len: 1765 microversion: 2.1 time: 0.242375 Feb 17 04:36:17.711218 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 515/1115] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:36:17 2021] GET /compute/v2.1/servers/b195626c-7ee1-4679-b956-f7ef7d6328f6 => generated 1765 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:36:17.729620 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-dbb5383e-f9df-4543-9fe4-8cb9215deb3a tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:36:17.731472 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-dbb5383e-f9df-4543-9fe4-8cb9215deb3a tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:36:17.740355 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-dbb5383e-f9df-4543-9fe4-8cb9215deb3a tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:17.740867 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-dbb5383e-f9df-4543-9fe4-8cb9215deb3a tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:17.741702 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-dbb5383e-f9df-4543-9fe4-8cb9215deb3a tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:17.742198 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-dbb5383e-f9df-4543-9fe4-8cb9215deb3a tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:17.819399 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-465a8512-6ab9-4bd0-904f-a8f94ec25f66 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:36:17.820077 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-465a8512-6ab9-4bd0-904f-a8f94ec25f66 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: 29d1ce27-f63b-4523-88be-55f65a6a2529] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:36:17.828014 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-465a8512-6ab9-4bd0-904f-a8f94ec25f66 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:17.828527 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-465a8512-6ab9-4bd0-904f-a8f94ec25f66 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:17.829372 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-465a8512-6ab9-4bd0-904f-a8f94ec25f66 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:17.829877 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-465a8512-6ab9-4bd0-904f-a8f94ec25f66 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:17.906091 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-dbb5383e-f9df-4543-9fe4-8cb9215deb3a tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "POST /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9/action" status: 200 len: 28627 microversion: 2.20 time: 0.180339 Feb 17 04:36:17.906981 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 601/1116] 10.222.0.78 () {62 vars in 1309 bytes} [Wed Feb 17 04:36:17 2021] POST /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9/action => generated 28627 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:36:18.045020 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-465a8512-6ab9-4bd0-904f-a8f94ec25f66 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2deb449189ba427a9b8fcb0e21f22566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2c8716a46f54187902492f8ce162f58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:18.053801 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-465a8512-6ab9-4bd0-904f-a8f94ec25f66 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "GET /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529" status: 200 len: 1676 microversion: 2.1 time: 0.238503 Feb 17 04:36:18.054393 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 516/1117] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:36:17 2021] GET /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529 => generated 1676 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:36:18.730058 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-d6d7570e-9957-4e97-bffd-aa4b874ea3d0 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:36:18.731806 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-d6d7570e-9957-4e97-bffd-aa4b874ea3d0 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] [instance: b195626c-7ee1-4679-b956-f7ef7d6328f6] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:36:18.741243 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-d6d7570e-9957-4e97-bffd-aa4b874ea3d0 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:18.741758 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-d6d7570e-9957-4e97-bffd-aa4b874ea3d0 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:18.742663 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-d6d7570e-9957-4e97-bffd-aa4b874ea3d0 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:18.743312 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-d6d7570e-9957-4e97-bffd-aa4b874ea3d0 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:18.918804 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-e6ba5ba0-0e34-4eb4-95b9-d3238447ed9c tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:36:18.920007 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-e6ba5ba0-0e34-4eb4-95b9-d3238447ed9c tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:36:18.928458 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-e6ba5ba0-0e34-4eb4-95b9-d3238447ed9c tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:18.928977 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-e6ba5ba0-0e34-4eb4-95b9-d3238447ed9c tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:18.929829 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-e6ba5ba0-0e34-4eb4-95b9-d3238447ed9c tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:18.930330 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-e6ba5ba0-0e34-4eb4-95b9-d3238447ed9c tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:18.965510 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-d6d7570e-9957-4e97-bffd-aa4b874ea3d0 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f3e4c3c174942c492405c9b112667de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5b2911946848de81be8f9741faa90f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:18.975143 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-d6d7570e-9957-4e97-bffd-aa4b874ea3d0 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] 10.222.0.78 "GET /compute/v2.1/servers/b195626c-7ee1-4679-b956-f7ef7d6328f6" status: 200 len: 1768 microversion: 2.1 time: 0.250009 Feb 17 04:36:18.975753 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 602/1118] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:36:18 2021] GET /compute/v2.1/servers/b195626c-7ee1-4679-b956-f7ef7d6328f6 => generated 1768 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:36:19.073436 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-7f9d3766-182f-4ad3-b989-450eafc59143 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:36:19.074103 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-7f9d3766-182f-4ad3-b989-450eafc59143 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: 29d1ce27-f63b-4523-88be-55f65a6a2529] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:36:19.082626 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-7f9d3766-182f-4ad3-b989-450eafc59143 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:19.083189 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-7f9d3766-182f-4ad3-b989-450eafc59143 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:19.084021 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-7f9d3766-182f-4ad3-b989-450eafc59143 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:19.084514 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-7f9d3766-182f-4ad3-b989-450eafc59143 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:19.094358 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-e6ba5ba0-0e34-4eb4-95b9-d3238447ed9c tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "POST /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9/action" status: 200 len: 28627 microversion: 2.20 time: 0.180023 Feb 17 04:36:19.095081 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 517/1119] 10.222.0.78 () {62 vars in 1309 bytes} [Wed Feb 17 04:36:18 2021] POST /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9/action => generated 28627 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:36:19.295979 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-7f9d3766-182f-4ad3-b989-450eafc59143 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2deb449189ba427a9b8fcb0e21f22566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2c8716a46f54187902492f8ce162f58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:19.304817 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-7f9d3766-182f-4ad3-b989-450eafc59143 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "GET /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529" status: 200 len: 1653 microversion: 2.1 time: 0.235429 Feb 17 04:36:19.305423 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 603/1120] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:36:19 2021] GET /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529 => generated 1653 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:36:19.324777 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-302870e4-6e17-431a-ba57-3b810e50e307 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:36:19.333637 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-302870e4-6e17-431a-ba57-3b810e50e307 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:19.334158 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-302870e4-6e17-431a-ba57-3b810e50e307 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:19.393560 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-302870e4-6e17-431a-ba57-3b810e50e307 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: 29d1ce27-f63b-4523-88be-55f65a6a2529] Going to try to start instance {{(pid=98178) start /opt/stack/nova/nova/compute/api.py:2603}} Feb 17 04:36:19.469135 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-302870e4-6e17-431a-ba57-3b810e50e307 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "POST /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529/action" status: 202 len: 0 microversion: 2.1 time: 0.149019 Feb 17 04:36:19.469827 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 518/1121] 10.222.0.78 () {60 vars in 1268 bytes} [Wed Feb 17 04:36:19 2021] POST /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529/action => generated 0 bytes in 151 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:36:19.479069 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-84f95dd1-5ff2-4b62-a48a-57435a55ea1c tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:36:19.480178 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-84f95dd1-5ff2-4b62-a48a-57435a55ea1c tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: 29d1ce27-f63b-4523-88be-55f65a6a2529] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:36:19.490426 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-84f95dd1-5ff2-4b62-a48a-57435a55ea1c tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:19.491195 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-84f95dd1-5ff2-4b62-a48a-57435a55ea1c tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:19.492063 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-84f95dd1-5ff2-4b62-a48a-57435a55ea1c tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:19.492564 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-84f95dd1-5ff2-4b62-a48a-57435a55ea1c tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:19.720530 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-84f95dd1-5ff2-4b62-a48a-57435a55ea1c tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2deb449189ba427a9b8fcb0e21f22566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2c8716a46f54187902492f8ce162f58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:19.729413 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-84f95dd1-5ff2-4b62-a48a-57435a55ea1c tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "GET /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529" status: 200 len: 1662 microversion: 2.1 time: 0.254670 Feb 17 04:36:19.730116 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 604/1122] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:36:19 2021] GET /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529 => generated 1662 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:36:20.108233 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-1a3ea5ae-80bb-45bf-83fc-588ffff7ee75 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:36:20.109639 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-1a3ea5ae-80bb-45bf-83fc-588ffff7ee75 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:36:20.117874 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-1a3ea5ae-80bb-45bf-83fc-588ffff7ee75 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:20.118383 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-1a3ea5ae-80bb-45bf-83fc-588ffff7ee75 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:20.119294 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-1a3ea5ae-80bb-45bf-83fc-588ffff7ee75 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:20.119796 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-1a3ea5ae-80bb-45bf-83fc-588ffff7ee75 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:20.268235 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-1a3ea5ae-80bb-45bf-83fc-588ffff7ee75 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "POST /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9/action" status: 200 len: 28627 microversion: 2.20 time: 0.164859 Feb 17 04:36:20.269272 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 519/1123] 10.222.0.78 () {62 vars in 1309 bytes} [Wed Feb 17 04:36:20 2021] POST /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9/action => generated 28627 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:36:20.749776 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-47c08dad-e082-4620-9670-aa6b73906445 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:36:20.750452 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-47c08dad-e082-4620-9670-aa6b73906445 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: 29d1ce27-f63b-4523-88be-55f65a6a2529] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:36:20.758802 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-47c08dad-e082-4620-9670-aa6b73906445 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:20.759351 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-47c08dad-e082-4620-9670-aa6b73906445 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:20.760190 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-47c08dad-e082-4620-9670-aa6b73906445 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:20.760685 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-47c08dad-e082-4620-9670-aa6b73906445 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:20.975860 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-47c08dad-e082-4620-9670-aa6b73906445 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2deb449189ba427a9b8fcb0e21f22566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2c8716a46f54187902492f8ce162f58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:20.985803 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-47c08dad-e082-4620-9670-aa6b73906445 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "GET /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529" status: 200 len: 1662 microversion: 2.1 time: 0.240575 Feb 17 04:36:20.986400 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 605/1124] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:36:20 2021] GET /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529 => generated 1662 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:36:21.282358 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-4fad071e-add0-4457-976d-504cce366720 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:36:21.283485 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-4fad071e-add0-4457-976d-504cce366720 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:36:21.291967 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-4fad071e-add0-4457-976d-504cce366720 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:21.292472 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-4fad071e-add0-4457-976d-504cce366720 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:21.293517 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-4fad071e-add0-4457-976d-504cce366720 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:21.294374 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-4fad071e-add0-4457-976d-504cce366720 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:21.594382 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-4fad071e-add0-4457-976d-504cce366720 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "POST /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9/action" status: 200 len: 28627 microversion: 2.20 time: 0.317059 Feb 17 04:36:21.595024 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 520/1125] 10.222.0.78 () {62 vars in 1309 bytes} [Wed Feb 17 04:36:21 2021] POST /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9/action => generated 28627 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:36:22.005018 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-43a1593f-673d-4b30-9955-1691e4422d59 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:36:22.005742 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-43a1593f-673d-4b30-9955-1691e4422d59 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: 29d1ce27-f63b-4523-88be-55f65a6a2529] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:36:22.013808 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-43a1593f-673d-4b30-9955-1691e4422d59 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:22.014323 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-43a1593f-673d-4b30-9955-1691e4422d59 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:22.015188 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-43a1593f-673d-4b30-9955-1691e4422d59 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:22.015691 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-43a1593f-673d-4b30-9955-1691e4422d59 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:22.240087 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-43a1593f-673d-4b30-9955-1691e4422d59 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2deb449189ba427a9b8fcb0e21f22566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2c8716a46f54187902492f8ce162f58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:22.249850 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-43a1593f-673d-4b30-9955-1691e4422d59 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "GET /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529" status: 200 len: 1666 microversion: 2.1 time: 0.248907 Feb 17 04:36:22.250460 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 606/1126] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:36:21 2021] GET /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529 => generated 1666 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:36:22.607821 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-03346660-f25f-489b-b1ea-4a1c4ff3fef4 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:36:22.609254 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-03346660-f25f-489b-b1ea-4a1c4ff3fef4 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:36:22.617796 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-03346660-f25f-489b-b1ea-4a1c4ff3fef4 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:22.618303 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-03346660-f25f-489b-b1ea-4a1c4ff3fef4 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:22.619157 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-03346660-f25f-489b-b1ea-4a1c4ff3fef4 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:22.619686 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-03346660-f25f-489b-b1ea-4a1c4ff3fef4 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:22.773328 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-03346660-f25f-489b-b1ea-4a1c4ff3fef4 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "POST /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9/action" status: 200 len: 28627 microversion: 2.20 time: 0.170664 Feb 17 04:36:22.774340 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 521/1127] 10.222.0.78 () {62 vars in 1309 bytes} [Wed Feb 17 04:36:22 2021] POST /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9/action => generated 28627 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:36:23.786648 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-09e42613-dbd6-405b-8268-d89e0e1f478f tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:36:23.787734 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-09e42613-dbd6-405b-8268-d89e0e1f478f tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:36:23.797572 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-09e42613-dbd6-405b-8268-d89e0e1f478f tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:23.798089 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-09e42613-dbd6-405b-8268-d89e0e1f478f tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:23.798942 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-09e42613-dbd6-405b-8268-d89e0e1f478f tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:23.799472 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-09e42613-dbd6-405b-8268-d89e0e1f478f tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:23.958728 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-09e42613-dbd6-405b-8268-d89e0e1f478f tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "POST /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9/action" status: 200 len: 28627 microversion: 2.20 time: 0.176034 Feb 17 04:36:23.959457 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 607/1128] 10.222.0.78 () {62 vars in 1309 bytes} [Wed Feb 17 04:36:23 2021] POST /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9/action => generated 28627 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:36:24.971714 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-fde26760-843c-492a-b37f-74f8a11c42a7 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:36:24.972864 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-fde26760-843c-492a-b37f-74f8a11c42a7 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:36:24.981565 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-fde26760-843c-492a-b37f-74f8a11c42a7 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:24.982077 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-fde26760-843c-492a-b37f-74f8a11c42a7 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:24.983137 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-fde26760-843c-492a-b37f-74f8a11c42a7 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:24.984140 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-fde26760-843c-492a-b37f-74f8a11c42a7 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:25.209754 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-fde26760-843c-492a-b37f-74f8a11c42a7 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "POST /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9/action" status: 200 len: 28627 microversion: 2.20 time: 0.243132 Feb 17 04:36:25.210482 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 522/1129] 10.222.0.78 () {62 vars in 1309 bytes} [Wed Feb 17 04:36:24 2021] POST /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9/action => generated 28627 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:36:26.223802 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-866fcdc7-c347-4ac5-8ef6-88d8d6ccaccc tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:36:26.225038 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-866fcdc7-c347-4ac5-8ef6-88d8d6ccaccc tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:36:26.233760 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-866fcdc7-c347-4ac5-8ef6-88d8d6ccaccc tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:26.234531 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-866fcdc7-c347-4ac5-8ef6-88d8d6ccaccc tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:26.235434 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-866fcdc7-c347-4ac5-8ef6-88d8d6ccaccc tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:26.235931 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-866fcdc7-c347-4ac5-8ef6-88d8d6ccaccc tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:26.432705 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-866fcdc7-c347-4ac5-8ef6-88d8d6ccaccc tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "POST /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9/action" status: 200 len: 28830 microversion: 2.20 time: 0.213331 Feb 17 04:36:26.433630 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 608/1130] 10.222.0.78 () {62 vars in 1309 bytes} [Wed Feb 17 04:36:26 2021] POST /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9/action => generated 28830 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:36:27.445742 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-9983e076-3c21-44a6-889b-9195650957f0 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:36:27.446890 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-9983e076-3c21-44a6-889b-9195650957f0 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:36:27.456332 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-9983e076-3c21-44a6-889b-9195650957f0 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:27.456854 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-9983e076-3c21-44a6-889b-9195650957f0 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:27.457708 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-9983e076-3c21-44a6-889b-9195650957f0 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:27.458209 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-9983e076-3c21-44a6-889b-9195650957f0 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:27.632929 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-9983e076-3c21-44a6-889b-9195650957f0 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "POST /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9/action" status: 200 len: 30188 microversion: 2.20 time: 0.191366 Feb 17 04:36:27.637528 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 523/1131] 10.222.0.78 () {62 vars in 1309 bytes} [Wed Feb 17 04:36:27 2021] POST /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9/action => generated 30188 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:36:28.646578 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-c298d4ff-ff07-4f55-9a5e-0052a03a1689 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:36:28.647785 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-c298d4ff-ff07-4f55-9a5e-0052a03a1689 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:36:28.656502 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-c298d4ff-ff07-4f55-9a5e-0052a03a1689 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:28.657019 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-c298d4ff-ff07-4f55-9a5e-0052a03a1689 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:28.657862 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-c298d4ff-ff07-4f55-9a5e-0052a03a1689 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:28.658362 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-c298d4ff-ff07-4f55-9a5e-0052a03a1689 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:28.852366 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-c298d4ff-ff07-4f55-9a5e-0052a03a1689 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "POST /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9/action" status: 200 len: 31680 microversion: 2.20 time: 0.210106 Feb 17 04:36:28.853064 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 609/1132] 10.222.0.78 () {62 vars in 1309 bytes} [Wed Feb 17 04:36:28 2021] POST /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9/action => generated 31680 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:36:29.866230 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-8db22f76-9227-4856-982f-318108297b86 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:36:29.867499 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-8db22f76-9227-4856-982f-318108297b86 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:36:29.876338 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-8db22f76-9227-4856-982f-318108297b86 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:29.876859 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-8db22f76-9227-4856-982f-318108297b86 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:29.877719 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-8db22f76-9227-4856-982f-318108297b86 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:29.878220 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-8db22f76-9227-4856-982f-318108297b86 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:30.056266 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-8db22f76-9227-4856-982f-318108297b86 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "POST /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9/action" status: 200 len: 32851 microversion: 2.20 time: 0.194464 Feb 17 04:36:30.056950 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 524/1133] 10.222.0.78 () {62 vars in 1309 bytes} [Wed Feb 17 04:36:29 2021] POST /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9/action => generated 32851 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:36:31.069335 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-69f0f70b-d655-4f31-8681-0d911f3ab7d2 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:36:31.070475 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-69f0f70b-d655-4f31-8681-0d911f3ab7d2 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:36:31.079820 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-69f0f70b-d655-4f31-8681-0d911f3ab7d2 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:31.080335 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-69f0f70b-d655-4f31-8681-0d911f3ab7d2 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:31.081176 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-69f0f70b-d655-4f31-8681-0d911f3ab7d2 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:31.081670 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-69f0f70b-d655-4f31-8681-0d911f3ab7d2 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:31.273846 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-69f0f70b-d655-4f31-8681-0d911f3ab7d2 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "POST /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9/action" status: 200 len: 33499 microversion: 2.20 time: 0.208870 Feb 17 04:36:31.274488 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 610/1134] 10.222.0.78 () {62 vars in 1309 bytes} [Wed Feb 17 04:36:31 2021] POST /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9/action => generated 33499 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Feb 17 04:36:32.288424 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-026836ff-8fab-466e-a9b9-fca3de97e72b tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:36:32.289555 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-026836ff-8fab-466e-a9b9-fca3de97e72b tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:36:32.298730 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-026836ff-8fab-466e-a9b9-fca3de97e72b tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:32.299269 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-026836ff-8fab-466e-a9b9-fca3de97e72b tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:32.300112 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-026836ff-8fab-466e-a9b9-fca3de97e72b tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:32.300604 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-026836ff-8fab-466e-a9b9-fca3de97e72b tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:32.490830 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-026836ff-8fab-466e-a9b9-fca3de97e72b tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "POST /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9/action" status: 200 len: 34120 microversion: 2.20 time: 0.207003 Feb 17 04:36:32.491557 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 525/1135] 10.222.0.78 () {62 vars in 1309 bytes} [Wed Feb 17 04:36:32 2021] POST /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9/action => generated 34120 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:36:33.504665 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-60549aa4-15e2-4209-8817-a87a61b65ff4 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:36:33.505844 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-60549aa4-15e2-4209-8817-a87a61b65ff4 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:36:33.514842 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-60549aa4-15e2-4209-8817-a87a61b65ff4 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:33.515397 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-60549aa4-15e2-4209-8817-a87a61b65ff4 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:33.516227 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-60549aa4-15e2-4209-8817-a87a61b65ff4 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:33.516720 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-60549aa4-15e2-4209-8817-a87a61b65ff4 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:33.712485 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-60549aa4-15e2-4209-8817-a87a61b65ff4 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "POST /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9/action" status: 200 len: 34954 microversion: 2.20 time: 0.212282 Feb 17 04:36:33.713215 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 611/1136] 10.222.0.78 () {62 vars in 1309 bytes} [Wed Feb 17 04:36:33 2021] POST /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9/action => generated 34954 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:36:34.726619 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-28baacb3-258f-4b30-b5fb-b8b7d4ef1f1e tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:36:34.727774 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-28baacb3-258f-4b30-b5fb-b8b7d4ef1f1e tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:36:34.736842 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-28baacb3-258f-4b30-b5fb-b8b7d4ef1f1e tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:34.737347 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-28baacb3-258f-4b30-b5fb-b8b7d4ef1f1e tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:34.738190 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-28baacb3-258f-4b30-b5fb-b8b7d4ef1f1e tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:34.738688 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-28baacb3-258f-4b30-b5fb-b8b7d4ef1f1e tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:34.899094 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-28baacb3-258f-4b30-b5fb-b8b7d4ef1f1e tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "POST /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9/action" status: 200 len: 35586 microversion: 2.20 time: 0.176777 Feb 17 04:36:34.899818 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 526/1137] 10.222.0.78 () {62 vars in 1309 bytes} [Wed Feb 17 04:36:34 2021] POST /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9/action => generated 35586 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:36:35.912703 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-b0a5a777-c736-4f7a-9b6b-f70b8acfac1a tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:36:35.913751 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-b0a5a777-c736-4f7a-9b6b-f70b8acfac1a tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:36:35.922952 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-b0a5a777-c736-4f7a-9b6b-f70b8acfac1a tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:35.923478 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-b0a5a777-c736-4f7a-9b6b-f70b8acfac1a tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:35.924306 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-b0a5a777-c736-4f7a-9b6b-f70b8acfac1a tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:35.924839 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-b0a5a777-c736-4f7a-9b6b-f70b8acfac1a tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:36.102386 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-b0a5a777-c736-4f7a-9b6b-f70b8acfac1a tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "POST /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9/action" status: 200 len: 36592 microversion: 2.20 time: 0.194150 Feb 17 04:36:36.103104 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 612/1138] 10.222.0.78 () {62 vars in 1309 bytes} [Wed Feb 17 04:36:35 2021] POST /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9/action => generated 36592 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:36:37.115842 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-139c391b-b0c1-4510-b6c7-941134fc4def tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:36:37.116961 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-139c391b-b0c1-4510-b6c7-941134fc4def tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:36:37.126121 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-139c391b-b0c1-4510-b6c7-941134fc4def tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:37.126628 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-139c391b-b0c1-4510-b6c7-941134fc4def tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:37.127519 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-139c391b-b0c1-4510-b6c7-941134fc4def tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:37.128021 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-139c391b-b0c1-4510-b6c7-941134fc4def tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:37.320013 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-139c391b-b0c1-4510-b6c7-941134fc4def tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "POST /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9/action" status: 200 len: 37594 microversion: 2.20 time: 0.208519 Feb 17 04:36:37.320727 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 527/1139] 10.222.0.78 () {62 vars in 1309 bytes} [Wed Feb 17 04:36:37 2021] POST /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9/action => generated 37594 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:36:38.333869 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-4ab72bf3-1152-4d06-a842-85c57e76dd4d tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:36:38.335009 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-4ab72bf3-1152-4d06-a842-85c57e76dd4d tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:36:38.344393 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-4ab72bf3-1152-4d06-a842-85c57e76dd4d tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:38.344906 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-4ab72bf3-1152-4d06-a842-85c57e76dd4d tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:38.345755 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-4ab72bf3-1152-4d06-a842-85c57e76dd4d tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:38.346254 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-4ab72bf3-1152-4d06-a842-85c57e76dd4d tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:38.511381 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-4ab72bf3-1152-4d06-a842-85c57e76dd4d tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "POST /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9/action" status: 200 len: 38179 microversion: 2.20 time: 0.181837 Feb 17 04:36:38.512138 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 613/1140] 10.222.0.78 () {62 vars in 1309 bytes} [Wed Feb 17 04:36:38 2021] POST /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9/action => generated 38179 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:36:39.525372 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-64c884b5-ab6a-4829-af37-c73adca8a7b8 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:36:39.526566 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-64c884b5-ab6a-4829-af37-c73adca8a7b8 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:36:39.535397 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-64c884b5-ab6a-4829-af37-c73adca8a7b8 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:39.535918 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-64c884b5-ab6a-4829-af37-c73adca8a7b8 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:39.536773 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-64c884b5-ab6a-4829-af37-c73adca8a7b8 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:39.537258 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-64c884b5-ab6a-4829-af37-c73adca8a7b8 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:39.701503 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-64c884b5-ab6a-4829-af37-c73adca8a7b8 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "POST /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9/action" status: 200 len: 38179 microversion: 2.20 time: 0.180370 Feb 17 04:36:39.702241 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 528/1141] 10.222.0.78 () {62 vars in 1309 bytes} [Wed Feb 17 04:36:39 2021] POST /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9/action => generated 38179 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:36:40.714997 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-c70e634b-781f-46be-a9dc-3ef8eba17dad tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:36:40.716190 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-c70e634b-781f-46be-a9dc-3ef8eba17dad tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:36:40.725489 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-c70e634b-781f-46be-a9dc-3ef8eba17dad tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:40.726003 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-c70e634b-781f-46be-a9dc-3ef8eba17dad tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:40.726854 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-c70e634b-781f-46be-a9dc-3ef8eba17dad tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:40.727408 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-c70e634b-781f-46be-a9dc-3ef8eba17dad tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:40.923386 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-c70e634b-781f-46be-a9dc-3ef8eba17dad tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "POST /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9/action" status: 200 len: 38320 microversion: 2.20 time: 0.212708 Feb 17 04:36:40.924101 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 614/1142] 10.222.0.78 () {62 vars in 1309 bytes} [Wed Feb 17 04:36:40 2021] POST /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9/action => generated 38320 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:36:40.935217 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-7cc20d42-164d-4898-9aec-9ea94254c2e8 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:36:40.936452 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-7cc20d42-164d-4898-9aec-9ea94254c2e8 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:36:40.944729 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-7cc20d42-164d-4898-9aec-9ea94254c2e8 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:40.945238 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-7cc20d42-164d-4898-9aec-9ea94254c2e8 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:40.946079 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-7cc20d42-164d-4898-9aec-9ea94254c2e8 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:40.946575 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-7cc20d42-164d-4898-9aec-9ea94254c2e8 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:41.008645 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-7cc20d42-164d-4898-9aec-9ea94254c2e8 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "GET /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9/ips" status: 200 len: 151 microversion: 2.20 time: 0.077840 Feb 17 04:36:41.009280 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 529/1143] 10.222.0.78 () {60 vars in 1279 bytes} [Wed Feb 17 04:36:40 2021] GET /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9/ips => generated 151 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 04:36:43.752127 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-844af39f-101b-45a2-850e-a0bd01aa035d tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:36:43.752814 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-844af39f-101b-45a2-850e-a0bd01aa035d tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:36:43.761403 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-844af39f-101b-45a2-850e-a0bd01aa035d tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:43.761908 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-844af39f-101b-45a2-850e-a0bd01aa035d tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:43.762741 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-844af39f-101b-45a2-850e-a0bd01aa035d tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:43.763259 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-844af39f-101b-45a2-850e-a0bd01aa035d tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:43.827733 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.objects.instance [None req-844af39f-101b-45a2-850e-a0bd01aa035d tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lazy-loading 'flavor' on Instance uuid 8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9 {{(pid=98179) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Feb 17 04:36:44.180145 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-844af39f-101b-45a2-850e-a0bd01aa035d tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "POST /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9/action" status: 202 len: 0 microversion: 2.20 time: 0.432985 Feb 17 04:36:44.181402 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 615/1144] 10.222.0.78 () {62 vars in 1309 bytes} [Wed Feb 17 04:36:43 2021] POST /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9/action => generated 0 bytes in 435 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Feb 17 04:36:44.191467 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-8f28d6a6-ed15-4b95-adf8-a69d5286d5a8 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:36:44.192149 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-8f28d6a6-ed15-4b95-adf8-a69d5286d5a8 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:36:44.200576 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-8f28d6a6-ed15-4b95-adf8-a69d5286d5a8 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:44.201870 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-8f28d6a6-ed15-4b95-adf8-a69d5286d5a8 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:44.202539 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-8f28d6a6-ed15-4b95-adf8-a69d5286d5a8 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:44.203241 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-8f28d6a6-ed15-4b95-adf8-a69d5286d5a8 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:44.418309 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-8f28d6a6-ed15-4b95-adf8-a69d5286d5a8 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:44.428338 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-8f28d6a6-ed15-4b95-adf8-a69d5286d5a8 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:44.429931 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-8f28d6a6-ed15-4b95-adf8-a69d5286d5a8 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:44.431140 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-8f28d6a6-ed15-4b95-adf8-a69d5286d5a8 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "GET /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9" status: 200 len: 1723 microversion: 2.20 time: 0.243786 Feb 17 04:36:44.431736 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 530/1145] 10.222.0.78 () {60 vars in 1267 bytes} [Wed Feb 17 04:36:44 2021] GET /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9 => generated 1723 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:36:45.453507 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-7fa252af-1b26-4288-a64a-0a3c90830762 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:36:45.454455 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-7fa252af-1b26-4288-a64a-0a3c90830762 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:36:45.463671 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-7fa252af-1b26-4288-a64a-0a3c90830762 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:45.464166 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-7fa252af-1b26-4288-a64a-0a3c90830762 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:45.465020 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-7fa252af-1b26-4288-a64a-0a3c90830762 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:45.465515 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-7fa252af-1b26-4288-a64a-0a3c90830762 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:45.715464 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-7fa252af-1b26-4288-a64a-0a3c90830762 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:45.727386 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-7fa252af-1b26-4288-a64a-0a3c90830762 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:45.728990 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-7fa252af-1b26-4288-a64a-0a3c90830762 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:45.730211 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-7fa252af-1b26-4288-a64a-0a3c90830762 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "GET /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9" status: 200 len: 1723 microversion: 2.20 time: 0.281937 Feb 17 04:36:45.730807 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 616/1146] 10.222.0.78 () {60 vars in 1267 bytes} [Wed Feb 17 04:36:45 2021] GET /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9 => generated 1723 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:36:46.750827 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-ac57f980-2d65-4cc4-a9df-cdb7db281b15 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:36:46.751526 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-ac57f980-2d65-4cc4-a9df-cdb7db281b15 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:36:46.760902 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-ac57f980-2d65-4cc4-a9df-cdb7db281b15 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:46.761703 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-ac57f980-2d65-4cc4-a9df-cdb7db281b15 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:46.762588 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-ac57f980-2d65-4cc4-a9df-cdb7db281b15 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:46.763128 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-ac57f980-2d65-4cc4-a9df-cdb7db281b15 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:46.974505 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-ac57f980-2d65-4cc4-a9df-cdb7db281b15 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:46.984584 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-ac57f980-2d65-4cc4-a9df-cdb7db281b15 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:46.986163 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-ac57f980-2d65-4cc4-a9df-cdb7db281b15 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:46.987370 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-ac57f980-2d65-4cc4-a9df-cdb7db281b15 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "GET /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9" status: 200 len: 1723 microversion: 2.20 time: 0.240910 Feb 17 04:36:46.987970 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 531/1147] 10.222.0.78 () {60 vars in 1267 bytes} [Wed Feb 17 04:36:46 2021] GET /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9 => generated 1723 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:36:48.008190 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-9e773f7c-8f2b-49cb-99c5-fc693c40e420 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:36:48.008877 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-9e773f7c-8f2b-49cb-99c5-fc693c40e420 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:36:48.018468 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-9e773f7c-8f2b-49cb-99c5-fc693c40e420 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:48.018982 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-9e773f7c-8f2b-49cb-99c5-fc693c40e420 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:48.019885 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-9e773f7c-8f2b-49cb-99c5-fc693c40e420 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:48.020358 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-9e773f7c-8f2b-49cb-99c5-fc693c40e420 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:48.231984 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-9e773f7c-8f2b-49cb-99c5-fc693c40e420 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:48.241708 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-9e773f7c-8f2b-49cb-99c5-fc693c40e420 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:48.243320 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-9e773f7c-8f2b-49cb-99c5-fc693c40e420 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:48.244486 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-9e773f7c-8f2b-49cb-99c5-fc693c40e420 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "GET /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9" status: 200 len: 1723 microversion: 2.20 time: 0.240421 Feb 17 04:36:48.245069 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 617/1148] 10.222.0.78 () {60 vars in 1267 bytes} [Wed Feb 17 04:36:48 2021] GET /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9 => generated 1723 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:36:49.265563 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-2bd40b13-cadf-4ddd-8698-bf5cfb8bb997 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:36:49.266166 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-2bd40b13-cadf-4ddd-8698-bf5cfb8bb997 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:36:49.273993 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-2bd40b13-cadf-4ddd-8698-bf5cfb8bb997 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:49.274493 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-2bd40b13-cadf-4ddd-8698-bf5cfb8bb997 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:49.275348 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-2bd40b13-cadf-4ddd-8698-bf5cfb8bb997 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:49.275841 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-2bd40b13-cadf-4ddd-8698-bf5cfb8bb997 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:49.493285 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-2bd40b13-cadf-4ddd-8698-bf5cfb8bb997 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:49.503422 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-2bd40b13-cadf-4ddd-8698-bf5cfb8bb997 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:49.505027 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-2bd40b13-cadf-4ddd-8698-bf5cfb8bb997 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:49.506264 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-2bd40b13-cadf-4ddd-8698-bf5cfb8bb997 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "GET /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9" status: 200 len: 1723 microversion: 2.20 time: 0.245488 Feb 17 04:36:49.506861 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 532/1149] 10.222.0.78 () {60 vars in 1267 bytes} [Wed Feb 17 04:36:49 2021] GET /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9 => generated 1723 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:36:50.526115 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-06193fbc-4c35-496a-aecf-72ca1911b1bc tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:36:50.526794 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-06193fbc-4c35-496a-aecf-72ca1911b1bc tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:36:50.535090 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-06193fbc-4c35-496a-aecf-72ca1911b1bc tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:50.535644 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-06193fbc-4c35-496a-aecf-72ca1911b1bc tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:50.536473 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-06193fbc-4c35-496a-aecf-72ca1911b1bc tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:50.536963 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-06193fbc-4c35-496a-aecf-72ca1911b1bc tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:50.750318 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-06193fbc-4c35-496a-aecf-72ca1911b1bc tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:50.759753 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-06193fbc-4c35-496a-aecf-72ca1911b1bc tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:50.761465 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-06193fbc-4c35-496a-aecf-72ca1911b1bc tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:50.762652 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-06193fbc-4c35-496a-aecf-72ca1911b1bc tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "GET /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9" status: 200 len: 1723 microversion: 2.20 time: 0.240582 Feb 17 04:36:50.763273 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 618/1150] 10.222.0.78 () {60 vars in 1267 bytes} [Wed Feb 17 04:36:50 2021] GET /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9 => generated 1723 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:36:51.783046 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-38c82e63-3551-4699-81ca-944b0438520e tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:36:51.783743 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-38c82e63-3551-4699-81ca-944b0438520e tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:36:51.792242 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-38c82e63-3551-4699-81ca-944b0438520e tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:51.792757 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-38c82e63-3551-4699-81ca-944b0438520e tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:51.793600 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-38c82e63-3551-4699-81ca-944b0438520e tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:51.794580 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-38c82e63-3551-4699-81ca-944b0438520e tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:52.016333 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-38c82e63-3551-4699-81ca-944b0438520e tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:52.025577 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-38c82e63-3551-4699-81ca-944b0438520e tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:52.027176 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-38c82e63-3551-4699-81ca-944b0438520e tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:52.028361 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-38c82e63-3551-4699-81ca-944b0438520e tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "GET /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9" status: 200 len: 1723 microversion: 2.20 time: 0.249446 Feb 17 04:36:52.028939 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 533/1151] 10.222.0.78 () {60 vars in 1267 bytes} [Wed Feb 17 04:36:51 2021] GET /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9 => generated 1723 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:36:53.048530 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-9c9c2742-1853-4809-b2b5-a4c1f043ec68 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:36:53.049327 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-9c9c2742-1853-4809-b2b5-a4c1f043ec68 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:36:53.057618 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-9c9c2742-1853-4809-b2b5-a4c1f043ec68 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:53.058122 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-9c9c2742-1853-4809-b2b5-a4c1f043ec68 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:53.058958 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-9c9c2742-1853-4809-b2b5-a4c1f043ec68 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:53.059514 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-9c9c2742-1853-4809-b2b5-a4c1f043ec68 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:53.281914 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-9c9c2742-1853-4809-b2b5-a4c1f043ec68 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:53.291296 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-9c9c2742-1853-4809-b2b5-a4c1f043ec68 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:53.292891 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-9c9c2742-1853-4809-b2b5-a4c1f043ec68 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:53.294085 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-9c9c2742-1853-4809-b2b5-a4c1f043ec68 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "GET /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9" status: 200 len: 1723 microversion: 2.20 time: 0.250029 Feb 17 04:36:53.294688 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 619/1152] 10.222.0.78 () {60 vars in 1267 bytes} [Wed Feb 17 04:36:53 2021] GET /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9 => generated 1723 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:36:54.315833 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-27e765be-0ccd-4fdf-b703-f8f798e5f538 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:36:54.316504 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-27e765be-0ccd-4fdf-b703-f8f798e5f538 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:36:54.324401 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-27e765be-0ccd-4fdf-b703-f8f798e5f538 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:54.324913 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-27e765be-0ccd-4fdf-b703-f8f798e5f538 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:54.325748 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-27e765be-0ccd-4fdf-b703-f8f798e5f538 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:54.326842 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-27e765be-0ccd-4fdf-b703-f8f798e5f538 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:54.540866 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-27e765be-0ccd-4fdf-b703-f8f798e5f538 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:54.550264 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-27e765be-0ccd-4fdf-b703-f8f798e5f538 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:54.551865 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-27e765be-0ccd-4fdf-b703-f8f798e5f538 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:54.553055 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-27e765be-0ccd-4fdf-b703-f8f798e5f538 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "GET /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9" status: 200 len: 1723 microversion: 2.20 time: 0.241577 Feb 17 04:36:54.553647 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 534/1153] 10.222.0.78 () {60 vars in 1267 bytes} [Wed Feb 17 04:36:54 2021] GET /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9 => generated 1723 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:36:55.573407 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-6dc80531-f7c8-4a79-a79e-5594eeb05e86 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:36:55.574070 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-6dc80531-f7c8-4a79-a79e-5594eeb05e86 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:36:55.582141 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-6dc80531-f7c8-4a79-a79e-5594eeb05e86 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:55.582641 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-6dc80531-f7c8-4a79-a79e-5594eeb05e86 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:55.583523 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-6dc80531-f7c8-4a79-a79e-5594eeb05e86 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:55.584008 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-6dc80531-f7c8-4a79-a79e-5594eeb05e86 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:55.796115 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-6dc80531-f7c8-4a79-a79e-5594eeb05e86 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:55.805462 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-6dc80531-f7c8-4a79-a79e-5594eeb05e86 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:55.807058 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-6dc80531-f7c8-4a79-a79e-5594eeb05e86 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:55.808471 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-6dc80531-f7c8-4a79-a79e-5594eeb05e86 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "GET /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9" status: 200 len: 1723 microversion: 2.20 time: 0.239149 Feb 17 04:36:55.809061 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 620/1154] 10.222.0.78 () {60 vars in 1267 bytes} [Wed Feb 17 04:36:55 2021] GET /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9 => generated 1723 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:36:56.828404 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-47a6f2ed-860d-4adf-9b2b-83e46fc005c7 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:36:56.829065 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-47a6f2ed-860d-4adf-9b2b-83e46fc005c7 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:36:56.837048 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-47a6f2ed-860d-4adf-9b2b-83e46fc005c7 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:56.837553 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-47a6f2ed-860d-4adf-9b2b-83e46fc005c7 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:56.838394 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-47a6f2ed-860d-4adf-9b2b-83e46fc005c7 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:56.838889 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-47a6f2ed-860d-4adf-9b2b-83e46fc005c7 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:57.055794 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-47a6f2ed-860d-4adf-9b2b-83e46fc005c7 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:57.065865 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-47a6f2ed-860d-4adf-9b2b-83e46fc005c7 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:57.067495 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-47a6f2ed-860d-4adf-9b2b-83e46fc005c7 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:57.068693 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-47a6f2ed-860d-4adf-9b2b-83e46fc005c7 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "GET /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9" status: 200 len: 1723 microversion: 2.20 time: 0.244911 Feb 17 04:36:57.069286 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 535/1155] 10.222.0.78 () {60 vars in 1267 bytes} [Wed Feb 17 04:36:56 2021] GET /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9 => generated 1723 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:36:58.088444 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-a9979c28-df67-4a34-8ad7-ffae91e78b9e tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:36:58.089111 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-a9979c28-df67-4a34-8ad7-ffae91e78b9e tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:36:58.097308 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-a9979c28-df67-4a34-8ad7-ffae91e78b9e tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:58.097791 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-a9979c28-df67-4a34-8ad7-ffae91e78b9e tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:58.098669 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-a9979c28-df67-4a34-8ad7-ffae91e78b9e tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:58.099190 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-a9979c28-df67-4a34-8ad7-ffae91e78b9e tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:58.315318 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-a9979c28-df67-4a34-8ad7-ffae91e78b9e tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:58.324637 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-a9979c28-df67-4a34-8ad7-ffae91e78b9e tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:58.327281 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-a9979c28-df67-4a34-8ad7-ffae91e78b9e tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:58.328195 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-a9979c28-df67-4a34-8ad7-ffae91e78b9e tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "GET /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9" status: 200 len: 1723 microversion: 2.20 time: 0.243830 Feb 17 04:36:58.328781 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 621/1156] 10.222.0.78 () {60 vars in 1267 bytes} [Wed Feb 17 04:36:58 2021] GET /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9 => generated 1723 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 17 04:36:59.348396 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-f673ae3e-fb99-4ee5-ab18-5cd655311ea2 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:36:59.349019 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-f673ae3e-fb99-4ee5-ab18-5cd655311ea2 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:36:59.356944 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-f673ae3e-fb99-4ee5-ab18-5cd655311ea2 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:59.357457 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-f673ae3e-fb99-4ee5-ab18-5cd655311ea2 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:59.358301 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-f673ae3e-fb99-4ee5-ab18-5cd655311ea2 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:59.359082 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-f673ae3e-fb99-4ee5-ab18-5cd655311ea2 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:59.574569 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-f673ae3e-fb99-4ee5-ab18-5cd655311ea2 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:59.584555 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-f673ae3e-fb99-4ee5-ab18-5cd655311ea2 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:59.586169 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-f673ae3e-fb99-4ee5-ab18-5cd655311ea2 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:59.587392 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-f673ae3e-fb99-4ee5-ab18-5cd655311ea2 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "GET /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9" status: 200 len: 1723 microversion: 2.20 time: 0.243156 Feb 17 04:36:59.587986 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 536/1157] 10.222.0.78 () {60 vars in 1267 bytes} [Wed Feb 17 04:36:59 2021] GET /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9 => generated 1723 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:37:00.607227 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-4ecb5c57-9b09-4b8c-95b6-12867652550e tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:37:00.607913 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-4ecb5c57-9b09-4b8c-95b6-12867652550e tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:37:00.616197 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-4ecb5c57-9b09-4b8c-95b6-12867652550e tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:00.616714 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-4ecb5c57-9b09-4b8c-95b6-12867652550e tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:00.617551 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-4ecb5c57-9b09-4b8c-95b6-12867652550e tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:00.618046 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-4ecb5c57-9b09-4b8c-95b6-12867652550e tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:00.834809 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-4ecb5c57-9b09-4b8c-95b6-12867652550e tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:00.845301 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-4ecb5c57-9b09-4b8c-95b6-12867652550e tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:00.846896 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-4ecb5c57-9b09-4b8c-95b6-12867652550e tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:00.848127 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-4ecb5c57-9b09-4b8c-95b6-12867652550e tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "GET /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9" status: 200 len: 1723 microversion: 2.20 time: 0.245050 Feb 17 04:37:00.848717 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 622/1158] 10.222.0.78 () {60 vars in 1267 bytes} [Wed Feb 17 04:37:00 2021] GET /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9 => generated 1723 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:37:01.868316 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-7c1d733e-6f75-491d-89ae-e309681ab1c0 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:37:01.868994 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-7c1d733e-6f75-491d-89ae-e309681ab1c0 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:37:01.877539 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-7c1d733e-6f75-491d-89ae-e309681ab1c0 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:01.878051 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-7c1d733e-6f75-491d-89ae-e309681ab1c0 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:01.878936 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-7c1d733e-6f75-491d-89ae-e309681ab1c0 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:01.879463 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-7c1d733e-6f75-491d-89ae-e309681ab1c0 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:02.089542 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-7c1d733e-6f75-491d-89ae-e309681ab1c0 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:02.099608 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-7c1d733e-6f75-491d-89ae-e309681ab1c0 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:02.101187 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-7c1d733e-6f75-491d-89ae-e309681ab1c0 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:02.102378 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-7c1d733e-6f75-491d-89ae-e309681ab1c0 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "GET /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9" status: 200 len: 1744 microversion: 2.20 time: 0.238175 Feb 17 04:37:02.102974 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 537/1159] 10.222.0.78 () {60 vars in 1267 bytes} [Wed Feb 17 04:37:01 2021] GET /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9 => generated 1744 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:37:03.122791 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-75ac4317-c343-41c8-8f7c-76d95de861bc tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:37:03.124548 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-75ac4317-c343-41c8-8f7c-76d95de861bc tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:37:03.132979 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-75ac4317-c343-41c8-8f7c-76d95de861bc tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:03.133493 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-75ac4317-c343-41c8-8f7c-76d95de861bc tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:03.134345 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-75ac4317-c343-41c8-8f7c-76d95de861bc tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:03.134840 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-75ac4317-c343-41c8-8f7c-76d95de861bc tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:03.355204 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-75ac4317-c343-41c8-8f7c-76d95de861bc tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:03.365643 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-75ac4317-c343-41c8-8f7c-76d95de861bc tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:03.367262 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-75ac4317-c343-41c8-8f7c-76d95de861bc tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:03.368446 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-75ac4317-c343-41c8-8f7c-76d95de861bc tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "GET /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9" status: 200 len: 1744 microversion: 2.20 time: 0.249844 Feb 17 04:37:03.369037 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 623/1160] 10.222.0.78 () {60 vars in 1267 bytes} [Wed Feb 17 04:37:03 2021] GET /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9 => generated 1744 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:37:04.389140 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-f7a63463-2b1f-4f7e-bd0d-bf822d763ccd tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:37:04.389892 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-f7a63463-2b1f-4f7e-bd0d-bf822d763ccd tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:37:04.397793 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-f7a63463-2b1f-4f7e-bd0d-bf822d763ccd tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:04.398251 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-f7a63463-2b1f-4f7e-bd0d-bf822d763ccd tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:04.399143 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-f7a63463-2b1f-4f7e-bd0d-bf822d763ccd tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:04.399643 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-f7a63463-2b1f-4f7e-bd0d-bf822d763ccd tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:04.616950 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-f7a63463-2b1f-4f7e-bd0d-bf822d763ccd tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:04.626418 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-f7a63463-2b1f-4f7e-bd0d-bf822d763ccd tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:04.628028 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-f7a63463-2b1f-4f7e-bd0d-bf822d763ccd tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:04.629224 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-f7a63463-2b1f-4f7e-bd0d-bf822d763ccd tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "GET /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9" status: 200 len: 1744 microversion: 2.20 time: 0.244825 Feb 17 04:37:04.629824 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 538/1161] 10.222.0.78 () {60 vars in 1267 bytes} [Wed Feb 17 04:37:04 2021] GET /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9 => generated 1744 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:37:05.648792 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-1bae07c6-fba3-424d-a353-2d62d8933a79 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:37:05.649458 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-1bae07c6-fba3-424d-a353-2d62d8933a79 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:37:05.657494 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-1bae07c6-fba3-424d-a353-2d62d8933a79 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:05.658001 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-1bae07c6-fba3-424d-a353-2d62d8933a79 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:05.658832 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-1bae07c6-fba3-424d-a353-2d62d8933a79 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:05.659352 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-1bae07c6-fba3-424d-a353-2d62d8933a79 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:05.874373 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-1bae07c6-fba3-424d-a353-2d62d8933a79 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:05.884697 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-1bae07c6-fba3-424d-a353-2d62d8933a79 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:05.886272 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-1bae07c6-fba3-424d-a353-2d62d8933a79 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:05.887482 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-1bae07c6-fba3-424d-a353-2d62d8933a79 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "GET /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9" status: 200 len: 1744 microversion: 2.20 time: 0.242722 Feb 17 04:37:05.888078 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 624/1162] 10.222.0.78 () {60 vars in 1267 bytes} [Wed Feb 17 04:37:05 2021] GET /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9 => generated 1744 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:37:06.908428 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-a7175225-3686-4720-94cf-240b81217da3 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:37:06.909093 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-a7175225-3686-4720-94cf-240b81217da3 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:37:06.916957 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-a7175225-3686-4720-94cf-240b81217da3 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:06.917465 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-a7175225-3686-4720-94cf-240b81217da3 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:06.918299 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-a7175225-3686-4720-94cf-240b81217da3 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:06.918791 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-a7175225-3686-4720-94cf-240b81217da3 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:07.133480 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-a7175225-3686-4720-94cf-240b81217da3 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:07.144073 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-a7175225-3686-4720-94cf-240b81217da3 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:07.145675 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-a7175225-3686-4720-94cf-240b81217da3 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:07.146858 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-a7175225-3686-4720-94cf-240b81217da3 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "GET /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9" status: 200 len: 1744 microversion: 2.20 time: 0.243685 Feb 17 04:37:07.147713 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 539/1163] 10.222.0.78 () {60 vars in 1267 bytes} [Wed Feb 17 04:37:06 2021] GET /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9 => generated 1744 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:37:08.166948 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-e37df5d2-fbe8-4e27-b9b5-120efee9d0fc tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:37:08.167657 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-e37df5d2-fbe8-4e27-b9b5-120efee9d0fc tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:37:08.176298 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-e37df5d2-fbe8-4e27-b9b5-120efee9d0fc tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:08.176814 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-e37df5d2-fbe8-4e27-b9b5-120efee9d0fc tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:08.177662 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-e37df5d2-fbe8-4e27-b9b5-120efee9d0fc tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:08.178158 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-e37df5d2-fbe8-4e27-b9b5-120efee9d0fc tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:08.395312 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-e37df5d2-fbe8-4e27-b9b5-120efee9d0fc tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:08.404556 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-e37df5d2-fbe8-4e27-b9b5-120efee9d0fc tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:08.406186 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-e37df5d2-fbe8-4e27-b9b5-120efee9d0fc tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:08.407380 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-e37df5d2-fbe8-4e27-b9b5-120efee9d0fc tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "GET /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9" status: 200 len: 1744 microversion: 2.20 time: 0.244404 Feb 17 04:37:08.407966 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 625/1164] 10.222.0.78 () {60 vars in 1267 bytes} [Wed Feb 17 04:37:08 2021] GET /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9 => generated 1744 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:37:09.426979 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-66c2f67a-75b1-41d0-8a3b-043c4f694421 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:37:09.427620 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-66c2f67a-75b1-41d0-8a3b-043c4f694421 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:37:09.436151 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-66c2f67a-75b1-41d0-8a3b-043c4f694421 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:09.436823 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-66c2f67a-75b1-41d0-8a3b-043c4f694421 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:09.437674 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-66c2f67a-75b1-41d0-8a3b-043c4f694421 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:09.438177 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-66c2f67a-75b1-41d0-8a3b-043c4f694421 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:09.647757 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-66c2f67a-75b1-41d0-8a3b-043c4f694421 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:09.657179 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-66c2f67a-75b1-41d0-8a3b-043c4f694421 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:09.658761 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-66c2f67a-75b1-41d0-8a3b-043c4f694421 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:09.659996 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-66c2f67a-75b1-41d0-8a3b-043c4f694421 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "GET /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9" status: 200 len: 1744 microversion: 2.20 time: 0.237244 Feb 17 04:37:09.660593 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 540/1165] 10.222.0.78 () {60 vars in 1267 bytes} [Wed Feb 17 04:37:09 2021] GET /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9 => generated 1744 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:37:10.680211 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-eddc4015-e76a-4427-9865-e733f298661f tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:37:10.681695 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-eddc4015-e76a-4427-9865-e733f298661f tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:37:10.691463 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-eddc4015-e76a-4427-9865-e733f298661f tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:10.691910 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-eddc4015-e76a-4427-9865-e733f298661f tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:10.692767 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-eddc4015-e76a-4427-9865-e733f298661f tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:10.693266 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-eddc4015-e76a-4427-9865-e733f298661f tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:10.925977 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-eddc4015-e76a-4427-9865-e733f298661f tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:10.936595 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-eddc4015-e76a-4427-9865-e733f298661f tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:10.938720 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-eddc4015-e76a-4427-9865-e733f298661f tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:10.940044 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-eddc4015-e76a-4427-9865-e733f298661f tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "GET /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9" status: 200 len: 1739 microversion: 2.20 time: 0.263954 Feb 17 04:37:10.940716 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 626/1166] 10.222.0.78 () {60 vars in 1267 bytes} [Wed Feb 17 04:37:10 2021] GET /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9 => generated 1739 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:37:11.961122 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-d8c13c23-b179-4462-84e5-3f5ed07d2540 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:37:11.961846 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-d8c13c23-b179-4462-84e5-3f5ed07d2540 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:37:11.972995 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-d8c13c23-b179-4462-84e5-3f5ed07d2540 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:11.973481 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-d8c13c23-b179-4462-84e5-3f5ed07d2540 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:11.974365 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-d8c13c23-b179-4462-84e5-3f5ed07d2540 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:11.974864 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-d8c13c23-b179-4462-84e5-3f5ed07d2540 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:12.208154 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-d8c13c23-b179-4462-84e5-3f5ed07d2540 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:12.219593 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-d8c13c23-b179-4462-84e5-3f5ed07d2540 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:12.221202 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-d8c13c23-b179-4462-84e5-3f5ed07d2540 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:12.222424 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-d8c13c23-b179-4462-84e5-3f5ed07d2540 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "GET /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9" status: 200 len: 1739 microversion: 2.20 time: 0.265714 Feb 17 04:37:12.223220 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 541/1167] 10.222.0.78 () {60 vars in 1267 bytes} [Wed Feb 17 04:37:11 2021] GET /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9 => generated 1739 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:37:13.243183 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-b8f052b9-79fe-4442-a704-4f7aafbf0756 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:37:13.243850 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-b8f052b9-79fe-4442-a704-4f7aafbf0756 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:37:13.252902 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-b8f052b9-79fe-4442-a704-4f7aafbf0756 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:13.253417 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-b8f052b9-79fe-4442-a704-4f7aafbf0756 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:13.254281 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-b8f052b9-79fe-4442-a704-4f7aafbf0756 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:13.254796 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-b8f052b9-79fe-4442-a704-4f7aafbf0756 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:13.490625 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-b8f052b9-79fe-4442-a704-4f7aafbf0756 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:13.502119 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-b8f052b9-79fe-4442-a704-4f7aafbf0756 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:13.503803 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-b8f052b9-79fe-4442-a704-4f7aafbf0756 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:13.505014 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-b8f052b9-79fe-4442-a704-4f7aafbf0756 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "GET /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9" status: 200 len: 1739 microversion: 2.20 time: 0.266010 Feb 17 04:37:13.505625 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 627/1168] 10.222.0.78 () {60 vars in 1267 bytes} [Wed Feb 17 04:37:13 2021] GET /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9 => generated 1739 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:37:14.525321 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-5041eba3-bf8f-4d2e-a6d5-96a22b99f97f tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:37:14.526005 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-5041eba3-bf8f-4d2e-a6d5-96a22b99f97f tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:37:14.534346 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-5041eba3-bf8f-4d2e-a6d5-96a22b99f97f tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:14.534846 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-5041eba3-bf8f-4d2e-a6d5-96a22b99f97f tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:14.535741 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-5041eba3-bf8f-4d2e-a6d5-96a22b99f97f tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:14.536233 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-5041eba3-bf8f-4d2e-a6d5-96a22b99f97f tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:14.757575 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-5041eba3-bf8f-4d2e-a6d5-96a22b99f97f tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:14.768312 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-5041eba3-bf8f-4d2e-a6d5-96a22b99f97f tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:14.769911 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-5041eba3-bf8f-4d2e-a6d5-96a22b99f97f tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:14.771129 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-5041eba3-bf8f-4d2e-a6d5-96a22b99f97f tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "GET /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9" status: 200 len: 1739 microversion: 2.20 time: 0.250079 Feb 17 04:37:14.771796 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 542/1169] 10.222.0.78 () {60 vars in 1267 bytes} [Wed Feb 17 04:37:14 2021] GET /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9 => generated 1739 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:37:15.791000 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-09143b2a-8ac2-45dd-b183-c62363290597 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:37:15.791990 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-09143b2a-8ac2-45dd-b183-c62363290597 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:37:15.801944 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-09143b2a-8ac2-45dd-b183-c62363290597 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:15.802463 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-09143b2a-8ac2-45dd-b183-c62363290597 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:15.803361 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-09143b2a-8ac2-45dd-b183-c62363290597 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:15.803883 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-09143b2a-8ac2-45dd-b183-c62363290597 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:16.035910 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-09143b2a-8ac2-45dd-b183-c62363290597 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:16.046076 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-09143b2a-8ac2-45dd-b183-c62363290597 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:16.047698 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-09143b2a-8ac2-45dd-b183-c62363290597 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:16.048907 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-09143b2a-8ac2-45dd-b183-c62363290597 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "GET /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9" status: 200 len: 1739 microversion: 2.20 time: 0.262024 Feb 17 04:37:16.049588 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 628/1170] 10.222.0.78 () {60 vars in 1267 bytes} [Wed Feb 17 04:37:15 2021] GET /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9 => generated 1739 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:37:17.086972 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-604eefb1-a371-4259-bc52-6c9b79ad64b0 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:37:17.086972 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-604eefb1-a371-4259-bc52-6c9b79ad64b0 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:37:17.090769 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-604eefb1-a371-4259-bc52-6c9b79ad64b0 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:17.091471 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-604eefb1-a371-4259-bc52-6c9b79ad64b0 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:17.092356 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-604eefb1-a371-4259-bc52-6c9b79ad64b0 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:17.092866 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-604eefb1-a371-4259-bc52-6c9b79ad64b0 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:17.328475 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-604eefb1-a371-4259-bc52-6c9b79ad64b0 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:17.342675 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-604eefb1-a371-4259-bc52-6c9b79ad64b0 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:17.344456 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-604eefb1-a371-4259-bc52-6c9b79ad64b0 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:17.345696 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-604eefb1-a371-4259-bc52-6c9b79ad64b0 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "GET /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9" status: 200 len: 1739 microversion: 2.20 time: 0.281378 Feb 17 04:37:17.346284 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 543/1171] 10.222.0.78 () {60 vars in 1267 bytes} [Wed Feb 17 04:37:17 2021] GET /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9 => generated 1739 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:37:18.367126 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-09604196-ba0e-4ae6-bb1c-0c57005cbf30 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:37:18.368380 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-09604196-ba0e-4ae6-bb1c-0c57005cbf30 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:37:18.377044 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-09604196-ba0e-4ae6-bb1c-0c57005cbf30 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:18.377545 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-09604196-ba0e-4ae6-bb1c-0c57005cbf30 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:18.378387 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-09604196-ba0e-4ae6-bb1c-0c57005cbf30 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:18.378876 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-09604196-ba0e-4ae6-bb1c-0c57005cbf30 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:18.626131 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-09604196-ba0e-4ae6-bb1c-0c57005cbf30 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:18.636470 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-09604196-ba0e-4ae6-bb1c-0c57005cbf30 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:18.638258 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-09604196-ba0e-4ae6-bb1c-0c57005cbf30 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:18.639540 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-09604196-ba0e-4ae6-bb1c-0c57005cbf30 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "GET /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9" status: 200 len: 1739 microversion: 2.20 time: 0.276609 Feb 17 04:37:18.640360 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 629/1172] 10.222.0.78 () {60 vars in 1267 bytes} [Wed Feb 17 04:37:18 2021] GET /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9 => generated 1739 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:37:19.660488 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-58237519-e5c8-4b65-b2d0-bb9465207ae8 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:37:19.661206 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-58237519-e5c8-4b65-b2d0-bb9465207ae8 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:37:19.669725 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-58237519-e5c8-4b65-b2d0-bb9465207ae8 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:19.670237 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-58237519-e5c8-4b65-b2d0-bb9465207ae8 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:19.671109 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-58237519-e5c8-4b65-b2d0-bb9465207ae8 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:19.671614 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-58237519-e5c8-4b65-b2d0-bb9465207ae8 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:19.916328 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-58237519-e5c8-4b65-b2d0-bb9465207ae8 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:19.925697 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-58237519-e5c8-4b65-b2d0-bb9465207ae8 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:19.927312 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-58237519-e5c8-4b65-b2d0-bb9465207ae8 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:19.928503 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-58237519-e5c8-4b65-b2d0-bb9465207ae8 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "GET /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9" status: 200 len: 1739 microversion: 2.20 time: 0.272772 Feb 17 04:37:19.929292 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 544/1173] 10.222.0.78 () {60 vars in 1267 bytes} [Wed Feb 17 04:37:19 2021] GET /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9 => generated 1739 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:37:20.947884 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-545d9962-673a-414c-90cd-4ce36cc23799 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:37:20.948557 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-545d9962-673a-414c-90cd-4ce36cc23799 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:37:20.959464 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-545d9962-673a-414c-90cd-4ce36cc23799 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:20.959464 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-545d9962-673a-414c-90cd-4ce36cc23799 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:20.959464 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-545d9962-673a-414c-90cd-4ce36cc23799 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:20.959464 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-545d9962-673a-414c-90cd-4ce36cc23799 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:21.196062 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-545d9962-673a-414c-90cd-4ce36cc23799 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:21.206420 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-545d9962-673a-414c-90cd-4ce36cc23799 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:21.208038 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-545d9962-673a-414c-90cd-4ce36cc23799 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:21.209472 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-545d9962-673a-414c-90cd-4ce36cc23799 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "GET /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9" status: 200 len: 1739 microversion: 2.20 time: 0.265596 Feb 17 04:37:21.210061 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 630/1174] 10.222.0.78 () {60 vars in 1267 bytes} [Wed Feb 17 04:37:20 2021] GET /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9 => generated 1739 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:37:22.230654 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-e518d4bd-b80e-4e1f-8c33-efcff9fb5d8e tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:37:22.231356 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-e518d4bd-b80e-4e1f-8c33-efcff9fb5d8e tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:37:22.240000 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-e518d4bd-b80e-4e1f-8c33-efcff9fb5d8e tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:22.240514 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-e518d4bd-b80e-4e1f-8c33-efcff9fb5d8e tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:22.241351 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-e518d4bd-b80e-4e1f-8c33-efcff9fb5d8e tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:22.241846 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-e518d4bd-b80e-4e1f-8c33-efcff9fb5d8e tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:22.456529 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-e518d4bd-b80e-4e1f-8c33-efcff9fb5d8e tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:22.465885 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-e518d4bd-b80e-4e1f-8c33-efcff9fb5d8e tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:22.467508 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-e518d4bd-b80e-4e1f-8c33-efcff9fb5d8e tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:22.468697 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-e518d4bd-b80e-4e1f-8c33-efcff9fb5d8e tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "GET /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9" status: 200 len: 1739 microversion: 2.20 time: 0.242109 Feb 17 04:37:22.469341 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 545/1175] 10.222.0.78 () {60 vars in 1267 bytes} [Wed Feb 17 04:37:22 2021] GET /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9 => generated 1739 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:37:23.489699 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-1245a742-86e6-4d8b-8073-31ee90e32c6f tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:37:23.490413 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-1245a742-86e6-4d8b-8073-31ee90e32c6f tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:37:23.498634 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-1245a742-86e6-4d8b-8073-31ee90e32c6f tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:23.498913 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-1245a742-86e6-4d8b-8073-31ee90e32c6f tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:23.499834 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-1245a742-86e6-4d8b-8073-31ee90e32c6f tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:23.500416 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-1245a742-86e6-4d8b-8073-31ee90e32c6f tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:23.723924 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-1245a742-86e6-4d8b-8073-31ee90e32c6f tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:23.733284 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-1245a742-86e6-4d8b-8073-31ee90e32c6f tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:23.735810 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-1245a742-86e6-4d8b-8073-31ee90e32c6f tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:23.737126 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-1245a742-86e6-4d8b-8073-31ee90e32c6f tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "GET /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9" status: 200 len: 1721 microversion: 2.20 time: 0.252709 Feb 17 04:37:23.737716 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 631/1176] 10.222.0.78 () {60 vars in 1267 bytes} [Wed Feb 17 04:37:23 2021] GET /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9 => generated 1721 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:37:24.757531 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-c26353b7-99b8-4a4b-81b3-6fba21bf79c6 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:37:24.758207 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-c26353b7-99b8-4a4b-81b3-6fba21bf79c6 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:37:24.766147 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-c26353b7-99b8-4a4b-81b3-6fba21bf79c6 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:24.766661 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-c26353b7-99b8-4a4b-81b3-6fba21bf79c6 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:24.767530 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-c26353b7-99b8-4a4b-81b3-6fba21bf79c6 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:24.768030 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-c26353b7-99b8-4a4b-81b3-6fba21bf79c6 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:24.983746 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-c26353b7-99b8-4a4b-81b3-6fba21bf79c6 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:24.993523 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-c26353b7-99b8-4a4b-81b3-6fba21bf79c6 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:24.995108 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-c26353b7-99b8-4a4b-81b3-6fba21bf79c6 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:24.996285 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-c26353b7-99b8-4a4b-81b3-6fba21bf79c6 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "GET /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9" status: 200 len: 1721 microversion: 2.20 time: 0.242826 Feb 17 04:37:24.996872 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 546/1177] 10.222.0.78 () {60 vars in 1267 bytes} [Wed Feb 17 04:37:24 2021] GET /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9 => generated 1721 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:37:26.015541 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-b1909b87-cb4b-4ebb-93da-17fb0161115d tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:37:26.017386 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-b1909b87-cb4b-4ebb-93da-17fb0161115d tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:37:26.025291 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-b1909b87-cb4b-4ebb-93da-17fb0161115d tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:26.025804 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-b1909b87-cb4b-4ebb-93da-17fb0161115d tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:26.026628 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-b1909b87-cb4b-4ebb-93da-17fb0161115d tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:26.027142 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-b1909b87-cb4b-4ebb-93da-17fb0161115d tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:26.249989 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-b1909b87-cb4b-4ebb-93da-17fb0161115d tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:26.261008 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-b1909b87-cb4b-4ebb-93da-17fb0161115d tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:26.262577 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-b1909b87-cb4b-4ebb-93da-17fb0161115d tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:26.263776 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-b1909b87-cb4b-4ebb-93da-17fb0161115d tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "GET /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9" status: 200 len: 1721 microversion: 2.20 time: 0.252348 Feb 17 04:37:26.264486 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 632/1178] 10.222.0.78 () {60 vars in 1267 bytes} [Wed Feb 17 04:37:26 2021] GET /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9 => generated 1721 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:37:27.284851 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-b2d80f3d-1736-4946-b317-e895ce88b6dd tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:37:27.285508 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-b2d80f3d-1736-4946-b317-e895ce88b6dd tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:37:27.293435 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-b2d80f3d-1736-4946-b317-e895ce88b6dd tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:27.293929 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-b2d80f3d-1736-4946-b317-e895ce88b6dd tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:27.294775 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-b2d80f3d-1736-4946-b317-e895ce88b6dd tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:27.295355 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-b2d80f3d-1736-4946-b317-e895ce88b6dd tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:27.327451 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [req-017be78e-7d9e-482d-99dc-9e336d871295 req-567f63d2-8562-4dc5-9925-78f6a7be9ae4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9", "name": "network-vif-unplugged", "status": "completed", "tag": "05ddcb41-fa3f-4fa9-a81d-e152e7b80f04"}]} {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:37:27.331088 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:37:27.331088 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: warnings.warn(msg) Feb 17 04:37:27.341669 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [req-017be78e-7d9e-482d-99dc-9e336d871295 req-567f63d2-8562-4dc5-9925-78f6a7be9ae4 service nova] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:27.342170 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [req-017be78e-7d9e-482d-99dc-9e336d871295 req-567f63d2-8562-4dc5-9925-78f6a7be9ae4 service nova] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:27.362462 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.compute.server_external_events [req-017be78e-7d9e-482d-99dc-9e336d871295 req-567f63d2-8562-4dc5-9925-78f6a7be9ae4 service nova] Unable to find a host for instance 8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9. Dropping event network-vif-unplugged {{(pid=98179) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:141}} Feb 17 04:37:27.363562 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [req-017be78e-7d9e-482d-99dc-9e336d871295 req-567f63d2-8562-4dc5-9925-78f6a7be9ae4 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.040499 Feb 17 04:37:27.364314 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 633/1179] 10.222.0.78 () {64 vars in 1308 bytes} [Wed Feb 17 04:37:27 2021] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 42 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Feb 17 04:37:27.517628 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-b2d80f3d-1736-4946-b317-e895ce88b6dd tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:27.526925 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-b2d80f3d-1736-4946-b317-e895ce88b6dd tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:27.528526 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-b2d80f3d-1736-4946-b317-e895ce88b6dd tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:27.529704 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-b2d80f3d-1736-4946-b317-e895ce88b6dd tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "GET /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9" status: 200 len: 1664 microversion: 2.20 time: 0.249267 Feb 17 04:37:27.530299 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 547/1180] 10.222.0.78 () {60 vars in 1267 bytes} [Wed Feb 17 04:37:27 2021] GET /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9 => generated 1664 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:37:27.549776 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-0342a19d-cb87-4434-aae3-c7568b89f0de tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1cad403e-6a9a-4743-92d3-bf815e78c519"}} {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:37:27.550899 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-0342a19d-cb87-4434-aae3-c7568b89f0de tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:37:27.558799 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-0342a19d-cb87-4434-aae3-c7568b89f0de tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:27.559341 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-0342a19d-cb87-4434-aae3-c7568b89f0de tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:27.560177 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-0342a19d-cb87-4434-aae3-c7568b89f0de tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:27.560671 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-0342a19d-cb87-4434-aae3-c7568b89f0de tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:28.009276 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-0342a19d-cb87-4434-aae3-c7568b89f0de tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "POST /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.464523 Feb 17 04:37:28.015355 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 634/1181] 10.222.0.78 () {62 vars in 1354 bytes} [Wed Feb 17 04:37:27 2021] POST /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9/os-volume_attachments => generated 188 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 04:37:28.126784 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-0f87e82a-df60-42a9-a322-03efb9dd55dc tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:37:28.127439 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-0f87e82a-df60-42a9-a322-03efb9dd55dc tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:37:28.135794 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-0f87e82a-df60-42a9-a322-03efb9dd55dc tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:28.136693 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-0f87e82a-df60-42a9-a322-03efb9dd55dc tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:28.137781 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-0f87e82a-df60-42a9-a322-03efb9dd55dc tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:28.138480 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-0f87e82a-df60-42a9-a322-03efb9dd55dc tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:28.299915 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: ERROR oslo.messaging._drivers.impl_rabbit [None req-0f87e82a-df60-42a9-a322-03efb9dd55dc tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [1b004fe6-ff5c-4fb0-a48c-28ac8e5f1089] AMQP server on 10.222.0.78:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Feb 17 04:37:29.316490 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO oslo.messaging._drivers.impl_rabbit [None req-0f87e82a-df60-42a9-a322-03efb9dd55dc tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [1b004fe6-ff5c-4fb0-a48c-28ac8e5f1089] Reconnected to AMQP server on 10.222.0.78:5672 via [amqp] client with port 58672. Feb 17 04:37:29.319916 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-0f87e82a-df60-42a9-a322-03efb9dd55dc tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "POST /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9/action" status: 202 len: 0 microversion: 2.20 time: 1.197906 Feb 17 04:37:29.320588 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 548/1182] 10.222.0.78 () {62 vars in 1309 bytes} [Wed Feb 17 04:37:28 2021] POST /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9/action => generated 0 bytes in 1199 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Feb 17 04:37:29.330051 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-a6372bc0-a2d7-4bac-81cf-5eaa698906c6 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:37:29.330708 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-a6372bc0-a2d7-4bac-81cf-5eaa698906c6 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:37:29.338565 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-a6372bc0-a2d7-4bac-81cf-5eaa698906c6 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:29.339091 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-a6372bc0-a2d7-4bac-81cf-5eaa698906c6 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:29.339936 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-a6372bc0-a2d7-4bac-81cf-5eaa698906c6 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:29.340422 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-a6372bc0-a2d7-4bac-81cf-5eaa698906c6 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:29.561706 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-a6372bc0-a2d7-4bac-81cf-5eaa698906c6 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:29.572190 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-a6372bc0-a2d7-4bac-81cf-5eaa698906c6 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:29.573777 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-a6372bc0-a2d7-4bac-81cf-5eaa698906c6 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:29.574973 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-a6372bc0-a2d7-4bac-81cf-5eaa698906c6 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "GET /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9" status: 200 len: 1750 microversion: 2.20 time: 0.249940 Feb 17 04:37:29.575621 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 635/1183] 10.222.0.78 () {60 vars in 1267 bytes} [Wed Feb 17 04:37:29 2021] GET /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9 => generated 1750 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:37:30.595300 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-047196f0-5534-40b9-9b4f-73e41f404465 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:37:30.595979 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-047196f0-5534-40b9-9b4f-73e41f404465 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:37:30.604102 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-047196f0-5534-40b9-9b4f-73e41f404465 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:30.604611 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-047196f0-5534-40b9-9b4f-73e41f404465 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:30.605455 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-047196f0-5534-40b9-9b4f-73e41f404465 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:30.605951 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-047196f0-5534-40b9-9b4f-73e41f404465 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:30.826351 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-047196f0-5534-40b9-9b4f-73e41f404465 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:30.837474 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-047196f0-5534-40b9-9b4f-73e41f404465 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:30.839213 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-047196f0-5534-40b9-9b4f-73e41f404465 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:30.840408 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-047196f0-5534-40b9-9b4f-73e41f404465 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "GET /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9" status: 200 len: 1750 microversion: 2.20 time: 0.249678 Feb 17 04:37:30.841032 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 549/1184] 10.222.0.78 () {60 vars in 1267 bytes} [Wed Feb 17 04:37:30 2021] GET /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9 => generated 1750 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:37:31.861268 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-8f56fb23-0527-410f-a4a7-9440e9868679 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:37:31.861945 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-8f56fb23-0527-410f-a4a7-9440e9868679 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:37:31.869947 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-8f56fb23-0527-410f-a4a7-9440e9868679 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:31.870461 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-8f56fb23-0527-410f-a4a7-9440e9868679 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:31.871347 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-8f56fb23-0527-410f-a4a7-9440e9868679 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:31.871851 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-8f56fb23-0527-410f-a4a7-9440e9868679 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:32.097544 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-8f56fb23-0527-410f-a4a7-9440e9868679 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:32.107399 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-8f56fb23-0527-410f-a4a7-9440e9868679 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:32.109269 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-8f56fb23-0527-410f-a4a7-9440e9868679 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:32.110678 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-8f56fb23-0527-410f-a4a7-9440e9868679 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "GET /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9" status: 200 len: 1750 microversion: 2.20 time: 0.254406 Feb 17 04:37:32.111301 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 636/1185] 10.222.0.78 () {60 vars in 1267 bytes} [Wed Feb 17 04:37:31 2021] GET /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9 => generated 1750 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:37:33.130422 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-6826b41a-c0bd-409c-a35f-3afc27feab0f tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:37:33.131117 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-6826b41a-c0bd-409c-a35f-3afc27feab0f tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:37:33.139329 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-6826b41a-c0bd-409c-a35f-3afc27feab0f tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:33.139845 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-6826b41a-c0bd-409c-a35f-3afc27feab0f tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:33.140711 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-6826b41a-c0bd-409c-a35f-3afc27feab0f tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:33.142040 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-6826b41a-c0bd-409c-a35f-3afc27feab0f tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:33.357438 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-6826b41a-c0bd-409c-a35f-3afc27feab0f tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:33.368204 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-6826b41a-c0bd-409c-a35f-3afc27feab0f tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:33.369795 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-6826b41a-c0bd-409c-a35f-3afc27feab0f tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:33.370980 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-6826b41a-c0bd-409c-a35f-3afc27feab0f tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "GET /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9" status: 200 len: 1750 microversion: 2.20 time: 0.244891 Feb 17 04:37:33.371604 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 550/1186] 10.222.0.78 () {60 vars in 1267 bytes} [Wed Feb 17 04:37:33 2021] GET /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9 => generated 1750 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:37:34.390063 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-1e4ec332-e87d-4d06-acad-906dc8a68928 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:37:34.390747 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-1e4ec332-e87d-4d06-acad-906dc8a68928 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:37:34.398921 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-1e4ec332-e87d-4d06-acad-906dc8a68928 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:34.399478 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-1e4ec332-e87d-4d06-acad-906dc8a68928 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:34.400313 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-1e4ec332-e87d-4d06-acad-906dc8a68928 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:34.400804 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-1e4ec332-e87d-4d06-acad-906dc8a68928 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:34.613986 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-1e4ec332-e87d-4d06-acad-906dc8a68928 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:34.623756 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-1e4ec332-e87d-4d06-acad-906dc8a68928 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:34.626133 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-1e4ec332-e87d-4d06-acad-906dc8a68928 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:34.627571 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-1e4ec332-e87d-4d06-acad-906dc8a68928 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "GET /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9" status: 200 len: 1752 microversion: 2.20 time: 0.241550 Feb 17 04:37:34.628167 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 637/1187] 10.222.0.78 () {60 vars in 1267 bytes} [Wed Feb 17 04:37:34 2021] GET /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9 => generated 1752 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:37:35.648740 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-cbe51880-8c79-4fea-9f38-864da388c1cb tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:37:35.649405 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-cbe51880-8c79-4fea-9f38-864da388c1cb tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:37:35.657836 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-cbe51880-8c79-4fea-9f38-864da388c1cb tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:35.658353 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-cbe51880-8c79-4fea-9f38-864da388c1cb tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:35.659237 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-cbe51880-8c79-4fea-9f38-864da388c1cb tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:35.659734 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-cbe51880-8c79-4fea-9f38-864da388c1cb tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:36.092617 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-cbe51880-8c79-4fea-9f38-864da388c1cb tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:36.102683 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-cbe51880-8c79-4fea-9f38-864da388c1cb tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:36.104311 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-cbe51880-8c79-4fea-9f38-864da388c1cb tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:36.105502 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-cbe51880-8c79-4fea-9f38-864da388c1cb tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "GET /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9" status: 200 len: 1752 microversion: 2.20 time: 0.461129 Feb 17 04:37:36.106101 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 551/1188] 10.222.0.78 () {60 vars in 1267 bytes} [Wed Feb 17 04:37:35 2021] GET /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9 => generated 1752 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:37:37.126285 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-0a5e9c08-44f5-44ed-986d-ee75785ba0cc tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:37:37.127056 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-0a5e9c08-44f5-44ed-986d-ee75785ba0cc tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:37:37.138166 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-0a5e9c08-44f5-44ed-986d-ee75785ba0cc tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:37.138680 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-0a5e9c08-44f5-44ed-986d-ee75785ba0cc tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:37.139786 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-0a5e9c08-44f5-44ed-986d-ee75785ba0cc tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:37.140275 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-0a5e9c08-44f5-44ed-986d-ee75785ba0cc tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:37.368310 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-0a5e9c08-44f5-44ed-986d-ee75785ba0cc tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:37.378212 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-0a5e9c08-44f5-44ed-986d-ee75785ba0cc tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:37.379818 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-0a5e9c08-44f5-44ed-986d-ee75785ba0cc tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:37.381002 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-0a5e9c08-44f5-44ed-986d-ee75785ba0cc tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "GET /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9" status: 200 len: 1808 microversion: 2.20 time: 0.259429 Feb 17 04:37:37.381585 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 638/1189] 10.222.0.78 () {60 vars in 1267 bytes} [Wed Feb 17 04:37:37 2021] GET /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9 => generated 1808 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:37:38.400499 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-9d6845b0-e906-4170-a120-9266a5ff5365 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:37:38.401206 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-9d6845b0-e906-4170-a120-9266a5ff5365 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:37:38.410095 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-9d6845b0-e906-4170-a120-9266a5ff5365 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:38.410605 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-9d6845b0-e906-4170-a120-9266a5ff5365 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:38.411504 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-9d6845b0-e906-4170-a120-9266a5ff5365 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:38.411996 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-9d6845b0-e906-4170-a120-9266a5ff5365 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:38.645523 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-9d6845b0-e906-4170-a120-9266a5ff5365 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:38.656104 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-9d6845b0-e906-4170-a120-9266a5ff5365 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:38.658688 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-9d6845b0-e906-4170-a120-9266a5ff5365 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:38.659937 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-9d6845b0-e906-4170-a120-9266a5ff5365 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "GET /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9" status: 200 len: 1808 microversion: 2.20 time: 0.263763 Feb 17 04:37:38.660547 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 552/1190] 10.222.0.78 () {60 vars in 1267 bytes} [Wed Feb 17 04:37:38 2021] GET /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9 => generated 1808 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:37:39.681912 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-6f704316-6d44-4aa7-99b2-fb6b9d3b4291 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:37:39.682586 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-6f704316-6d44-4aa7-99b2-fb6b9d3b4291 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:37:39.692858 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-6f704316-6d44-4aa7-99b2-fb6b9d3b4291 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:39.693377 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-6f704316-6d44-4aa7-99b2-fb6b9d3b4291 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:39.694244 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-6f704316-6d44-4aa7-99b2-fb6b9d3b4291 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:39.694750 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-6f704316-6d44-4aa7-99b2-fb6b9d3b4291 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:39.919143 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-6f704316-6d44-4aa7-99b2-fb6b9d3b4291 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:39.929564 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-6f704316-6d44-4aa7-99b2-fb6b9d3b4291 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:39.931167 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-6f704316-6d44-4aa7-99b2-fb6b9d3b4291 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:39.932409 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-6f704316-6d44-4aa7-99b2-fb6b9d3b4291 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "GET /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9" status: 200 len: 1808 microversion: 2.20 time: 0.254587 Feb 17 04:37:39.932947 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 639/1191] 10.222.0.78 () {60 vars in 1267 bytes} [Wed Feb 17 04:37:39 2021] GET /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9 => generated 1808 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:37:40.956146 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-8f9acc2c-734c-4f4d-8eea-f15edab46006 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:37:40.956793 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-8f9acc2c-734c-4f4d-8eea-f15edab46006 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:37:40.964844 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-8f9acc2c-734c-4f4d-8eea-f15edab46006 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:40.965364 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-8f9acc2c-734c-4f4d-8eea-f15edab46006 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:40.966229 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-8f9acc2c-734c-4f4d-8eea-f15edab46006 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:40.966728 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-8f9acc2c-734c-4f4d-8eea-f15edab46006 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:41.184235 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-8f9acc2c-734c-4f4d-8eea-f15edab46006 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:41.195863 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-8f9acc2c-734c-4f4d-8eea-f15edab46006 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:41.197454 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-8f9acc2c-734c-4f4d-8eea-f15edab46006 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:41.198652 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-8f9acc2c-734c-4f4d-8eea-f15edab46006 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "GET /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9" status: 200 len: 1808 microversion: 2.20 time: 0.246877 Feb 17 04:37:41.199267 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 553/1192] 10.222.0.78 () {60 vars in 1267 bytes} [Wed Feb 17 04:37:40 2021] GET /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9 => generated 1808 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:37:42.218195 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-f66d41be-f6f5-4e0e-ad11-8367dce1dd32 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:37:42.219853 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-f66d41be-f6f5-4e0e-ad11-8367dce1dd32 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:37:42.227401 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-f66d41be-f6f5-4e0e-ad11-8367dce1dd32 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:42.227909 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-f66d41be-f6f5-4e0e-ad11-8367dce1dd32 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:42.228740 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-f66d41be-f6f5-4e0e-ad11-8367dce1dd32 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:42.229233 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-f66d41be-f6f5-4e0e-ad11-8367dce1dd32 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:42.450353 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-f66d41be-f6f5-4e0e-ad11-8367dce1dd32 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:42.460736 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-f66d41be-f6f5-4e0e-ad11-8367dce1dd32 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:42.462322 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-f66d41be-f6f5-4e0e-ad11-8367dce1dd32 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:42.463553 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-f66d41be-f6f5-4e0e-ad11-8367dce1dd32 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "GET /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9" status: 200 len: 1808 microversion: 2.20 time: 0.249551 Feb 17 04:37:42.464134 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 640/1193] 10.222.0.78 () {60 vars in 1267 bytes} [Wed Feb 17 04:37:42 2021] GET /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9 => generated 1808 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:37:42.595853 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-5dc2b30c-8082-4da5-8092-e08146d3a5ea tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-TestMinimumBasicScenario-678213976"}} {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:37:42.596468 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-5dc2b30c-8082-4da5-8092-e08146d3a5ea tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] [instance: b195626c-7ee1-4679-b956-f7ef7d6328f6] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:37:42.604743 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-5dc2b30c-8082-4da5-8092-e08146d3a5ea tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:42.605256 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-5dc2b30c-8082-4da5-8092-e08146d3a5ea tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:42.606317 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-5dc2b30c-8082-4da5-8092-e08146d3a5ea tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:42.606817 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-5dc2b30c-8082-4da5-8092-e08146d3a5ea tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:42.824545 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.network.security_group_api [None req-5dc2b30c-8082-4da5-8092-e08146d3a5ea tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Removing security group 914f5156-aeff-4c7c-abd4-a5e7718c83fd from port b60a0e42-338e-46c0-ba43-9b2027219e08 Feb 17 04:37:43.484769 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-0459bfdf-150e-450a-aae8-923e71c6f511 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:37:43.485554 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-0459bfdf-150e-450a-aae8-923e71c6f511 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:37:43.493804 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-0459bfdf-150e-450a-aae8-923e71c6f511 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:43.494317 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-0459bfdf-150e-450a-aae8-923e71c6f511 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:43.495253 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-0459bfdf-150e-450a-aae8-923e71c6f511 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:43.495755 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-0459bfdf-150e-450a-aae8-923e71c6f511 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:43.600910 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-5dc2b30c-8082-4da5-8092-e08146d3a5ea tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] 10.222.0.78 "POST /compute/v2.1/servers/b195626c-7ee1-4679-b956-f7ef7d6328f6/action" status: 202 len: 0 microversion: 2.1 time: 1.009845 Feb 17 04:37:43.601567 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 554/1194] 10.222.0.78 () {60 vars in 1268 bytes} [Wed Feb 17 04:37:42 2021] POST /compute/v2.1/servers/b195626c-7ee1-4679-b956-f7ef7d6328f6/action => generated 0 bytes in 1011 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:37:43.611694 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-f9df1283-16de-4e04-a20f-12e86efe86f8 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Calling method '.version_select at 0x7f57c89807b8>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:37:43.759332 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-0459bfdf-150e-450a-aae8-923e71c6f511 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:43.774491 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-0459bfdf-150e-450a-aae8-923e71c6f511 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:43.774491 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-0459bfdf-150e-450a-aae8-923e71c6f511 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:43.775208 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-0459bfdf-150e-450a-aae8-923e71c6f511 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "GET /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9" status: 200 len: 1808 microversion: 2.20 time: 0.294829 Feb 17 04:37:43.776408 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 641/1195] 10.222.0.78 () {60 vars in 1267 bytes} [Wed Feb 17 04:37:43 2021] GET /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9 => generated 1808 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 17 04:37:43.784522 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [req-a8d68b73-3745-465f-a86f-1b9118d679a8 req-5a58ff85-1c51-47d2-8afc-4745a7b5869d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b195626c-7ee1-4679-b956-f7ef7d6328f6", "tag": "b60a0e42-338e-46c0-ba43-9b2027219e08"}]} {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:37:43.784522 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:37:43.784522 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: warnings.warn(msg) Feb 17 04:37:43.794549 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [req-a8d68b73-3745-465f-a86f-1b9118d679a8 req-5a58ff85-1c51-47d2-8afc-4745a7b5869d service nova] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:43.795231 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [req-a8d68b73-3745-465f-a86f-1b9118d679a8 req-5a58ff85-1c51-47d2-8afc-4745a7b5869d service nova] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:43.815616 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.compute.server_external_events [req-a8d68b73-3745-465f-a86f-1b9118d679a8 req-5a58ff85-1c51-47d2-8afc-4745a7b5869d service nova] Creating event network-changed:b60a0e42-338e-46c0-ba43-9b2027219e08 for instance b195626c-7ee1-4679-b956-f7ef7d6328f6 on hv-cinder-75998 Feb 17 04:37:43.821500 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [req-a8d68b73-3745-465f-a86f-1b9118d679a8 req-5a58ff85-1c51-47d2-8afc-4745a7b5869d service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043537 Feb 17 04:37:43.822296 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 642/1196] 10.222.0.78 () {64 vars in 1308 bytes} [Wed Feb 17 04:37:43 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:37:43.905896 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-f9df1283-16de-4e04-a20f-12e86efe86f8 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] 10.222.0.78 "DELETE /compute/v2.1/os-security-groups/914f5156-aeff-4c7c-abd4-a5e7718c83fd" status: 202 len: 0 microversion: 2.1 time: 0.299645 Feb 17 04:37:43.906698 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 555/1197] 10.222.0.78 () {58 vars in 1262 bytes} [Wed Feb 17 04:37:43 2021] DELETE /compute/v2.1/os-security-groups/914f5156-aeff-4c7c-abd4-a5e7718c83fd => generated 0 bytes in 301 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Feb 17 04:37:43.916538 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-a50a7785-b68a-4a0f-899c-c980f7c63367 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Calling method '.version_select at 0x7f57c8773ea0>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:37:44.443535 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-a50a7785-b68a-4a0f-899c-c980f7c63367 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] [instance: b195626c-7ee1-4679-b956-f7ef7d6328f6] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:37:44.461246 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-a50a7785-b68a-4a0f-899c-c980f7c63367 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:44.461764 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-a50a7785-b68a-4a0f-899c-c980f7c63367 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:44.462649 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-a50a7785-b68a-4a0f-899c-c980f7c63367 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:44.463203 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-a50a7785-b68a-4a0f-899c-c980f7c63367 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:44.526806 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-a50a7785-b68a-4a0f-899c-c980f7c63367 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Acquired lock "refresh_cache-b195626c-7ee1-4679-b956-f7ef7d6328f6" {{(pid=98179) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:266}} Feb 17 04:37:44.800651 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-015ec3b6-c813-42c9-a7f1-70e699acecfd tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:37:44.801331 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-015ec3b6-c813-42c9-a7f1-70e699acecfd tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:37:44.822130 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-015ec3b6-c813-42c9-a7f1-70e699acecfd tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:44.822651 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-015ec3b6-c813-42c9-a7f1-70e699acecfd tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:44.823548 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-015ec3b6-c813-42c9-a7f1-70e699acecfd tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:44.824057 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-015ec3b6-c813-42c9-a7f1-70e699acecfd tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:45.070542 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-015ec3b6-c813-42c9-a7f1-70e699acecfd tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:45.081937 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-015ec3b6-c813-42c9-a7f1-70e699acecfd tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:45.084048 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-015ec3b6-c813-42c9-a7f1-70e699acecfd tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:45.085633 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-015ec3b6-c813-42c9-a7f1-70e699acecfd tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "GET /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9" status: 200 len: 1808 microversion: 2.20 time: 0.289666 Feb 17 04:37:45.086352 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 556/1198] 10.222.0.78 () {60 vars in 1267 bytes} [Wed Feb 17 04:37:44 2021] GET /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9 => generated 1808 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:37:46.105614 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-58fc095d-4f1b-4cfa-aefa-5635e4fb84a9 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:37:46.106189 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-58fc095d-4f1b-4cfa-aefa-5635e4fb84a9 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:37:46.117253 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-58fc095d-4f1b-4cfa-aefa-5635e4fb84a9 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:46.118177 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-58fc095d-4f1b-4cfa-aefa-5635e4fb84a9 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:46.119318 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-58fc095d-4f1b-4cfa-aefa-5635e4fb84a9 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:46.120012 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-58fc095d-4f1b-4cfa-aefa-5635e4fb84a9 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:46.411128 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-58fc095d-4f1b-4cfa-aefa-5635e4fb84a9 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:46.421564 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-58fc095d-4f1b-4cfa-aefa-5635e4fb84a9 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:46.423330 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-58fc095d-4f1b-4cfa-aefa-5635e4fb84a9 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:46.424662 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-58fc095d-4f1b-4cfa-aefa-5635e4fb84a9 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "GET /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9" status: 200 len: 1808 microversion: 2.20 time: 0.323441 Feb 17 04:37:46.425310 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 557/1199] 10.222.0.78 () {60 vars in 1267 bytes} [Wed Feb 17 04:37:46 2021] GET /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9 => generated 1808 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 17 04:37:46.430226 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-958062dd-a399-4baf-96d7-63e1e02e6b32 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:37:46.430784 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-958062dd-a399-4baf-96d7-63e1e02e6b32 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: 29d1ce27-f63b-4523-88be-55f65a6a2529] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:37:46.439226 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-958062dd-a399-4baf-96d7-63e1e02e6b32 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:46.439737 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-958062dd-a399-4baf-96d7-63e1e02e6b32 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:46.440597 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-958062dd-a399-4baf-96d7-63e1e02e6b32 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:46.441095 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-958062dd-a399-4baf-96d7-63e1e02e6b32 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:46.510075 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-958062dd-a399-4baf-96d7-63e1e02e6b32 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: 29d1ce27-f63b-4523-88be-55f65a6a2529] Going to try to terminate instance {{(pid=98178) delete /opt/stack/nova/nova/compute/api.py:2540}} Feb 17 04:37:46.662530 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-958062dd-a399-4baf-96d7-63e1e02e6b32 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "DELETE /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529" status: 204 len: 0 microversion: 2.1 time: 0.235611 Feb 17 04:37:46.663127 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 558/1200] 10.222.0.78 () {58 vars in 1229 bytes} [Wed Feb 17 04:37:46 2021] DELETE /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 17 04:37:46.672827 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-53f63988-35f7-4fbf-af27-460408db3678 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:37:46.673649 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-53f63988-35f7-4fbf-af27-460408db3678 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: 29d1ce27-f63b-4523-88be-55f65a6a2529] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:37:46.681541 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-53f63988-35f7-4fbf-af27-460408db3678 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:46.682050 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-53f63988-35f7-4fbf-af27-460408db3678 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:46.682904 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-53f63988-35f7-4fbf-af27-460408db3678 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:46.683439 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-53f63988-35f7-4fbf-af27-460408db3678 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:46.804301 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.network.neutron [None req-a50a7785-b68a-4a0f-899c-c980f7c63367 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] [instance: b195626c-7ee1-4679-b956-f7ef7d6328f6] Building network info cache for instance {{(pid=98179) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1836}} Feb 17 04:37:46.983963 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-53f63988-35f7-4fbf-af27-460408db3678 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2deb449189ba427a9b8fcb0e21f22566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2c8716a46f54187902492f8ce162f58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:46.994981 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-53f63988-35f7-4fbf-af27-460408db3678 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "GET /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529" status: 200 len: 1672 microversion: 2.1 time: 0.327066 Feb 17 04:37:47.006833 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 559/1201] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:37:46 2021] GET /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529 => generated 1672 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:37:47.012772 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [req-9a58ea08-3f50-4502-83f8-66ae5ba4319d req-4ee3c003-3ff0-474a-a90e-ab78e316e2a9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b195626c-7ee1-4679-b956-f7ef7d6328f6", "tag": "b60a0e42-338e-46c0-ba43-9b2027219e08"}]} {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:37:47.014633 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:37:47.014633 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: warnings.warn(msg) Feb 17 04:37:47.027938 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [req-9a58ea08-3f50-4502-83f8-66ae5ba4319d req-4ee3c003-3ff0-474a-a90e-ab78e316e2a9 service nova] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:47.028883 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [req-9a58ea08-3f50-4502-83f8-66ae5ba4319d req-4ee3c003-3ff0-474a-a90e-ab78e316e2a9 service nova] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:47.052386 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.compute.server_external_events [req-9a58ea08-3f50-4502-83f8-66ae5ba4319d req-4ee3c003-3ff0-474a-a90e-ab78e316e2a9 service nova] Creating event network-changed:b60a0e42-338e-46c0-ba43-9b2027219e08 for instance b195626c-7ee1-4679-b956-f7ef7d6328f6 on hv-cinder-75998 Feb 17 04:37:47.058893 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [req-9a58ea08-3f50-4502-83f8-66ae5ba4319d req-4ee3c003-3ff0-474a-a90e-ab78e316e2a9 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049724 Feb 17 04:37:47.059936 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 560/1202] 10.222.0.78 () {64 vars in 1308 bytes} [Wed Feb 17 04:37:47 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:37:47.445436 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-186c2b58-fc80-4abc-b4d8-e71cad8c0349 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:37:47.446210 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-186c2b58-fc80-4abc-b4d8-e71cad8c0349 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:37:47.457515 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-186c2b58-fc80-4abc-b4d8-e71cad8c0349 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:47.458036 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-186c2b58-fc80-4abc-b4d8-e71cad8c0349 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:47.458907 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-186c2b58-fc80-4abc-b4d8-e71cad8c0349 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:47.459434 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-186c2b58-fc80-4abc-b4d8-e71cad8c0349 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:47.720094 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-186c2b58-fc80-4abc-b4d8-e71cad8c0349 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:47.732438 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-186c2b58-fc80-4abc-b4d8-e71cad8c0349 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:47.735752 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-186c2b58-fc80-4abc-b4d8-e71cad8c0349 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:47.738913 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-186c2b58-fc80-4abc-b4d8-e71cad8c0349 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "GET /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9" status: 200 len: 1808 microversion: 2.20 time: 0.296401 Feb 17 04:37:47.738913 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 561/1203] 10.222.0.78 () {60 vars in 1267 bytes} [Wed Feb 17 04:37:47 2021] GET /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9 => generated 1808 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:37:47.832139 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.network.neutron [None req-a50a7785-b68a-4a0f-899c-c980f7c63367 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] [instance: b195626c-7ee1-4679-b956-f7ef7d6328f6] Updating instance_info_cache with network_info: [{"id": "b60a0e42-338e-46c0-ba43-9b2027219e08", "address": "fa:16:3e:12:7d:d7", "network": {"id": "10e65970-91b2-49d9-93cf-ec97654274a6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1096464601-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "0d5b2911946848de81be8f9741faa90f", "mtu": 1450, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, "devname": "tapb60a0e42-33", "ovs_interfaceid": "b60a0e42-338e-46c0-ba43-9b2027219e08", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "meta": {}}] {{(pid=98179) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Feb 17 04:37:47.843255 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-a50a7785-b68a-4a0f-899c-c980f7c63367 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Releasing lock "refresh_cache-b195626c-7ee1-4679-b956-f7ef7d6328f6" {{(pid=98179) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:282}} Feb 17 04:37:47.844816 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-a50a7785-b68a-4a0f-899c-c980f7c63367 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] 10.222.0.78 "DELETE /compute/v2.1/os-floating-ips/4c3ecb51-ee5a-4ff9-ac29-7b9887784640" status: 202 len: 0 microversion: 2.1 time: 3.933064 Feb 17 04:37:47.845469 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 643/1204] 10.222.0.78 () {58 vars in 1253 bytes} [Wed Feb 17 04:37:43 2021] DELETE /compute/v2.1/os-floating-ips/4c3ecb51-ee5a-4ff9-ac29-7b9887784640 => generated 0 bytes in 3935 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:37:47.854573 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-5e8ed5db-b2fe-420a-8780-8b8daf02f6f8 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:37:47.855355 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-5e8ed5db-b2fe-420a-8780-8b8daf02f6f8 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] [instance: b195626c-7ee1-4679-b956-f7ef7d6328f6] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:37:47.865607 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-5e8ed5db-b2fe-420a-8780-8b8daf02f6f8 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:47.866124 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-5e8ed5db-b2fe-420a-8780-8b8daf02f6f8 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:47.867000 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-5e8ed5db-b2fe-420a-8780-8b8daf02f6f8 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:47.867645 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-5e8ed5db-b2fe-420a-8780-8b8daf02f6f8 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:48.017133 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-e3d48594-12a1-4976-8472-5a4ca328572d tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:37:48.017833 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-e3d48594-12a1-4976-8472-5a4ca328572d tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: 29d1ce27-f63b-4523-88be-55f65a6a2529] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:37:48.039790 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-e3d48594-12a1-4976-8472-5a4ca328572d tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:48.040005 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-e3d48594-12a1-4976-8472-5a4ca328572d tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:48.041034 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-e3d48594-12a1-4976-8472-5a4ca328572d tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:48.041722 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-e3d48594-12a1-4976-8472-5a4ca328572d tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:48.054915 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.objects.instance [None req-5e8ed5db-b2fe-420a-8780-8b8daf02f6f8 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lazy-loading 'services' on Instance uuid b195626c-7ee1-4679-b956-f7ef7d6328f6 {{(pid=98178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Feb 17 04:37:48.220262 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-5e8ed5db-b2fe-420a-8780-8b8daf02f6f8 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] 10.222.0.78 "DELETE /compute/v2.1/servers/b195626c-7ee1-4679-b956-f7ef7d6328f6/os-volume_attachments/ec1eef41-849e-4737-ae92-2ac8b0099fa5" status: 202 len: 0 microversion: 2.1 time: 0.369520 Feb 17 04:37:48.221036 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 562/1205] 10.222.0.78 () {58 vars in 1406 bytes} [Wed Feb 17 04:37:47 2021] DELETE /compute/v2.1/servers/b195626c-7ee1-4679-b956-f7ef7d6328f6/os-volume_attachments/ec1eef41-849e-4737-ae92-2ac8b0099fa5 => generated 0 bytes in 371 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:37:48.230799 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-100f08aa-79c3-4c58-b924-1ae49a945d38 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:37:48.232100 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-100f08aa-79c3-4c58-b924-1ae49a945d38 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] [instance: b195626c-7ee1-4679-b956-f7ef7d6328f6] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:37:48.241267 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-100f08aa-79c3-4c58-b924-1ae49a945d38 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:48.241787 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-100f08aa-79c3-4c58-b924-1ae49a945d38 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:48.242654 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-100f08aa-79c3-4c58-b924-1ae49a945d38 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:48.243186 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-100f08aa-79c3-4c58-b924-1ae49a945d38 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:48.320187 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-100f08aa-79c3-4c58-b924-1ae49a945d38 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] 10.222.0.78 "GET /compute/v2.1/servers/b195626c-7ee1-4679-b956-f7ef7d6328f6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.094125 Feb 17 04:37:48.321148 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 563/1206] 10.222.0.78 () {58 vars in 1292 bytes} [Wed Feb 17 04:37:48 2021] GET /compute/v2.1/servers/b195626c-7ee1-4679-b956-f7ef7d6328f6/os-volume_attachments => generated 197 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 17 04:37:48.326666 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-e3d48594-12a1-4976-8472-5a4ca328572d tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2deb449189ba427a9b8fcb0e21f22566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2c8716a46f54187902492f8ce162f58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:48.339869 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-e3d48594-12a1-4976-8472-5a4ca328572d tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "GET /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529" status: 200 len: 1672 microversion: 2.1 time: 0.327524 Feb 17 04:37:48.340503 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 644/1207] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:37:48 2021] GET /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529 => generated 1672 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:37:48.756955 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-2a9aea52-db85-430e-baea-516c44f699ac tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:37:48.757763 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-2a9aea52-db85-430e-baea-516c44f699ac tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:37:48.766879 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-2a9aea52-db85-430e-baea-516c44f699ac tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:48.767470 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-2a9aea52-db85-430e-baea-516c44f699ac tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:48.768326 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-2a9aea52-db85-430e-baea-516c44f699ac tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:48.768861 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-2a9aea52-db85-430e-baea-516c44f699ac tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:48.993051 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-2a9aea52-db85-430e-baea-516c44f699ac tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:49.004589 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-2a9aea52-db85-430e-baea-516c44f699ac tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:49.006265 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-2a9aea52-db85-430e-baea-516c44f699ac tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:49.007640 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-2a9aea52-db85-430e-baea-516c44f699ac tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "GET /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9" status: 200 len: 1808 microversion: 2.20 time: 0.254803 Feb 17 04:37:49.008250 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 564/1208] 10.222.0.78 () {60 vars in 1267 bytes} [Wed Feb 17 04:37:48 2021] GET /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9 => generated 1808 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:37:49.333208 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-53e51a4b-4fc7-4b1a-a242-13c836f91d8f tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:37:49.334284 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-53e51a4b-4fc7-4b1a-a242-13c836f91d8f tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] [instance: b195626c-7ee1-4679-b956-f7ef7d6328f6] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:37:49.342432 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-53e51a4b-4fc7-4b1a-a242-13c836f91d8f tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:49.342983 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-53e51a4b-4fc7-4b1a-a242-13c836f91d8f tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:49.343951 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-53e51a4b-4fc7-4b1a-a242-13c836f91d8f tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:49.344668 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-53e51a4b-4fc7-4b1a-a242-13c836f91d8f tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:49.360791 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-3e71819f-d07d-4eda-81d0-1ac6a56a04c8 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:37:49.362117 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-3e71819f-d07d-4eda-81d0-1ac6a56a04c8 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: 29d1ce27-f63b-4523-88be-55f65a6a2529] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:37:49.370339 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-3e71819f-d07d-4eda-81d0-1ac6a56a04c8 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:49.370860 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-3e71819f-d07d-4eda-81d0-1ac6a56a04c8 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:49.371783 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-3e71819f-d07d-4eda-81d0-1ac6a56a04c8 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:49.377627 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-3e71819f-d07d-4eda-81d0-1ac6a56a04c8 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:49.421525 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-53e51a4b-4fc7-4b1a-a242-13c836f91d8f tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] 10.222.0.78 "GET /compute/v2.1/servers/b195626c-7ee1-4679-b956-f7ef7d6328f6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.092872 Feb 17 04:37:49.423262 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 645/1209] 10.222.0.78 () {58 vars in 1292 bytes} [Wed Feb 17 04:37:49 2021] GET /compute/v2.1/servers/b195626c-7ee1-4679-b956-f7ef7d6328f6/os-volume_attachments => generated 197 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:37:49.604273 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-3e71819f-d07d-4eda-81d0-1ac6a56a04c8 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2deb449189ba427a9b8fcb0e21f22566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2c8716a46f54187902492f8ce162f58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:49.614280 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-3e71819f-d07d-4eda-81d0-1ac6a56a04c8 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "GET /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529" status: 200 len: 1672 microversion: 2.1 time: 0.258969 Feb 17 04:37:49.614906 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 565/1210] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:37:49 2021] GET /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529 => generated 1672 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:37:50.028900 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-7e411a7e-df91-4671-a5cf-7aab42a115f9 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:37:50.029790 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-7e411a7e-df91-4671-a5cf-7aab42a115f9 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:37:50.038800 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-7e411a7e-df91-4671-a5cf-7aab42a115f9 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:50.039728 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-7e411a7e-df91-4671-a5cf-7aab42a115f9 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:50.041252 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-7e411a7e-df91-4671-a5cf-7aab42a115f9 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:50.042169 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-7e411a7e-df91-4671-a5cf-7aab42a115f9 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:50.271758 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-7e411a7e-df91-4671-a5cf-7aab42a115f9 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:50.281908 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-7e411a7e-df91-4671-a5cf-7aab42a115f9 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:50.284263 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-7e411a7e-df91-4671-a5cf-7aab42a115f9 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:50.285462 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-7e411a7e-df91-4671-a5cf-7aab42a115f9 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "GET /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9" status: 200 len: 1808 microversion: 2.20 time: 0.260859 Feb 17 04:37:50.286058 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 646/1211] 10.222.0.78 () {60 vars in 1267 bytes} [Wed Feb 17 04:37:50 2021] GET /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9 => generated 1808 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 17 04:37:50.435308 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-70bd4f66-638f-419b-8bca-d80474a7bae0 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:37:50.436351 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-70bd4f66-638f-419b-8bca-d80474a7bae0 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] [instance: b195626c-7ee1-4679-b956-f7ef7d6328f6] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:37:50.445287 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-70bd4f66-638f-419b-8bca-d80474a7bae0 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:50.445796 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-70bd4f66-638f-419b-8bca-d80474a7bae0 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:50.446694 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-70bd4f66-638f-419b-8bca-d80474a7bae0 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:50.447168 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-70bd4f66-638f-419b-8bca-d80474a7bae0 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:50.517902 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-70bd4f66-638f-419b-8bca-d80474a7bae0 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] 10.222.0.78 "GET /compute/v2.1/servers/b195626c-7ee1-4679-b956-f7ef7d6328f6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.086668 Feb 17 04:37:50.518535 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 566/1212] 10.222.0.78 () {58 vars in 1292 bytes} [Wed Feb 17 04:37:50 2021] GET /compute/v2.1/servers/b195626c-7ee1-4679-b956-f7ef7d6328f6/os-volume_attachments => generated 197 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:37:50.633957 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-aae7386f-af39-4488-bdb0-e00c836d292c tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:37:50.634560 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-aae7386f-af39-4488-bdb0-e00c836d292c tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: 29d1ce27-f63b-4523-88be-55f65a6a2529] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:37:50.643394 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-aae7386f-af39-4488-bdb0-e00c836d292c tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:50.643907 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-aae7386f-af39-4488-bdb0-e00c836d292c tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:50.644814 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-aae7386f-af39-4488-bdb0-e00c836d292c tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:50.645250 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-aae7386f-af39-4488-bdb0-e00c836d292c tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:50.867771 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-aae7386f-af39-4488-bdb0-e00c836d292c tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2deb449189ba427a9b8fcb0e21f22566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2c8716a46f54187902492f8ce162f58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:50.877006 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-aae7386f-af39-4488-bdb0-e00c836d292c tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "GET /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529" status: 200 len: 1672 microversion: 2.1 time: 0.246999 Feb 17 04:37:50.877605 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 647/1213] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:37:50 2021] GET /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529 => generated 1672 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:37:51.305228 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-d0320604-f9d6-4f97-8eef-43cec5fbce07 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:37:51.305898 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-d0320604-f9d6-4f97-8eef-43cec5fbce07 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:37:51.314074 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-d0320604-f9d6-4f97-8eef-43cec5fbce07 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:51.314733 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-d0320604-f9d6-4f97-8eef-43cec5fbce07 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:51.315655 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-d0320604-f9d6-4f97-8eef-43cec5fbce07 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:51.316178 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-d0320604-f9d6-4f97-8eef-43cec5fbce07 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:51.530240 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-7c56c4a2-b06a-418f-bc51-dcd0277aff2c tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:37:51.531406 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-7c56c4a2-b06a-418f-bc51-dcd0277aff2c tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] [instance: b195626c-7ee1-4679-b956-f7ef7d6328f6] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:37:51.540850 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-7c56c4a2-b06a-418f-bc51-dcd0277aff2c tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:51.541357 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-7c56c4a2-b06a-418f-bc51-dcd0277aff2c tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:51.541753 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-d0320604-f9d6-4f97-8eef-43cec5fbce07 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:51.542200 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-7c56c4a2-b06a-418f-bc51-dcd0277aff2c tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:51.542689 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-7c56c4a2-b06a-418f-bc51-dcd0277aff2c tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:51.552764 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-d0320604-f9d6-4f97-8eef-43cec5fbce07 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:51.554368 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-d0320604-f9d6-4f97-8eef-43cec5fbce07 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:51.555595 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-d0320604-f9d6-4f97-8eef-43cec5fbce07 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "GET /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9" status: 200 len: 1808 microversion: 2.20 time: 0.254468 Feb 17 04:37:51.556188 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 567/1214] 10.222.0.78 () {60 vars in 1267 bytes} [Wed Feb 17 04:37:51 2021] GET /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9 => generated 1808 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:37:51.614776 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-7c56c4a2-b06a-418f-bc51-dcd0277aff2c tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] 10.222.0.78 "GET /compute/v2.1/servers/b195626c-7ee1-4679-b956-f7ef7d6328f6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.088560 Feb 17 04:37:51.615584 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 648/1215] 10.222.0.78 () {58 vars in 1292 bytes} [Wed Feb 17 04:37:51 2021] GET /compute/v2.1/servers/b195626c-7ee1-4679-b956-f7ef7d6328f6/os-volume_attachments => generated 197 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 17 04:37:51.895356 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-3c7d62d5-1343-4626-97c8-e026be6a207c tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:37:51.895992 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-3c7d62d5-1343-4626-97c8-e026be6a207c tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: 29d1ce27-f63b-4523-88be-55f65a6a2529] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:37:51.903952 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-3c7d62d5-1343-4626-97c8-e026be6a207c tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:51.904465 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-3c7d62d5-1343-4626-97c8-e026be6a207c tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:51.905304 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-3c7d62d5-1343-4626-97c8-e026be6a207c tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:51.905797 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-3c7d62d5-1343-4626-97c8-e026be6a207c tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:52.125044 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-3c7d62d5-1343-4626-97c8-e026be6a207c tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2deb449189ba427a9b8fcb0e21f22566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2c8716a46f54187902492f8ce162f58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:52.139600 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-3c7d62d5-1343-4626-97c8-e026be6a207c tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "GET /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529" status: 200 len: 1672 microversion: 2.1 time: 0.248380 Feb 17 04:37:52.140509 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 568/1216] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:37:51 2021] GET /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529 => generated 1672 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:37:52.576510 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-72f34e04-dddd-43d6-92c6-dc896b8f5f01 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:37:52.577188 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-72f34e04-dddd-43d6-92c6-dc896b8f5f01 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:37:52.585343 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-72f34e04-dddd-43d6-92c6-dc896b8f5f01 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:52.585859 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-72f34e04-dddd-43d6-92c6-dc896b8f5f01 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:52.586696 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-72f34e04-dddd-43d6-92c6-dc896b8f5f01 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:52.587217 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-72f34e04-dddd-43d6-92c6-dc896b8f5f01 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:52.628325 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-15b26802-c1ac-4a75-b1a4-23a01fdf32a3 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:37:52.629355 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-15b26802-c1ac-4a75-b1a4-23a01fdf32a3 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] [instance: b195626c-7ee1-4679-b956-f7ef7d6328f6] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:37:52.637153 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-15b26802-c1ac-4a75-b1a4-23a01fdf32a3 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:52.637779 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-15b26802-c1ac-4a75-b1a4-23a01fdf32a3 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:52.638614 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-15b26802-c1ac-4a75-b1a4-23a01fdf32a3 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:52.639120 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-15b26802-c1ac-4a75-b1a4-23a01fdf32a3 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:52.708200 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-15b26802-c1ac-4a75-b1a4-23a01fdf32a3 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] 10.222.0.78 "GET /compute/v2.1/servers/b195626c-7ee1-4679-b956-f7ef7d6328f6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.084913 Feb 17 04:37:52.708801 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 569/1217] 10.222.0.78 () {58 vars in 1292 bytes} [Wed Feb 17 04:37:52 2021] GET /compute/v2.1/servers/b195626c-7ee1-4679-b956-f7ef7d6328f6/os-volume_attachments => generated 197 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 17 04:37:52.803804 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-72f34e04-dddd-43d6-92c6-dc896b8f5f01 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:52.813889 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-72f34e04-dddd-43d6-92c6-dc896b8f5f01 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:52.815989 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-72f34e04-dddd-43d6-92c6-dc896b8f5f01 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:52.817170 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-72f34e04-dddd-43d6-92c6-dc896b8f5f01 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "GET /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9" status: 200 len: 1808 microversion: 2.20 time: 0.244824 Feb 17 04:37:52.817772 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 649/1218] 10.222.0.78 () {60 vars in 1267 bytes} [Wed Feb 17 04:37:52 2021] GET /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9 => generated 1808 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:37:53.161949 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-bfd656b1-a7f7-475f-b3eb-75a978542b29 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:37:53.162697 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-bfd656b1-a7f7-475f-b3eb-75a978542b29 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: 29d1ce27-f63b-4523-88be-55f65a6a2529] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:37:53.170457 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-bfd656b1-a7f7-475f-b3eb-75a978542b29 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:53.170959 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-bfd656b1-a7f7-475f-b3eb-75a978542b29 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:53.171819 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-bfd656b1-a7f7-475f-b3eb-75a978542b29 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:53.172307 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-bfd656b1-a7f7-475f-b3eb-75a978542b29 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:53.391715 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-bfd656b1-a7f7-475f-b3eb-75a978542b29 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2deb449189ba427a9b8fcb0e21f22566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2c8716a46f54187902492f8ce162f58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:53.400781 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-bfd656b1-a7f7-475f-b3eb-75a978542b29 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "GET /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529" status: 200 len: 1672 microversion: 2.1 time: 0.243099 Feb 17 04:37:53.401389 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 570/1219] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:37:53 2021] GET /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529 => generated 1672 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:37:53.720545 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-0f081790-f036-47cb-a029-a9b777a7fc52 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:37:53.721656 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-0f081790-f036-47cb-a029-a9b777a7fc52 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] [instance: b195626c-7ee1-4679-b956-f7ef7d6328f6] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:37:53.729545 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-0f081790-f036-47cb-a029-a9b777a7fc52 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:53.730045 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-0f081790-f036-47cb-a029-a9b777a7fc52 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:53.730870 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-0f081790-f036-47cb-a029-a9b777a7fc52 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:53.731381 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-0f081790-f036-47cb-a029-a9b777a7fc52 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:53.803731 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-0f081790-f036-47cb-a029-a9b777a7fc52 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] 10.222.0.78 "GET /compute/v2.1/servers/b195626c-7ee1-4679-b956-f7ef7d6328f6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.087403 Feb 17 04:37:53.804342 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 650/1220] 10.222.0.78 () {58 vars in 1292 bytes} [Wed Feb 17 04:37:53 2021] GET /compute/v2.1/servers/b195626c-7ee1-4679-b956-f7ef7d6328f6/os-volume_attachments => generated 197 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:37:53.836652 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-59a4f647-01fc-4d1f-9a60-c2a326c21e7a tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:37:53.837368 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-59a4f647-01fc-4d1f-9a60-c2a326c21e7a tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:37:53.845400 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-59a4f647-01fc-4d1f-9a60-c2a326c21e7a tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:53.845962 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-59a4f647-01fc-4d1f-9a60-c2a326c21e7a tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:53.846801 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-59a4f647-01fc-4d1f-9a60-c2a326c21e7a tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:53.847331 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-59a4f647-01fc-4d1f-9a60-c2a326c21e7a tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:54.076077 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-59a4f647-01fc-4d1f-9a60-c2a326c21e7a tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:54.086667 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-59a4f647-01fc-4d1f-9a60-c2a326c21e7a tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:54.088255 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-59a4f647-01fc-4d1f-9a60-c2a326c21e7a tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:54.089441 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-59a4f647-01fc-4d1f-9a60-c2a326c21e7a tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "GET /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9" status: 200 len: 1808 microversion: 2.20 time: 0.256782 Feb 17 04:37:54.090021 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 571/1221] 10.222.0.78 () {60 vars in 1267 bytes} [Wed Feb 17 04:37:53 2021] GET /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9 => generated 1808 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:37:54.420101 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-c7a11d08-10ff-4168-89b9-170e9ef41aa6 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:37:54.420703 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-c7a11d08-10ff-4168-89b9-170e9ef41aa6 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: 29d1ce27-f63b-4523-88be-55f65a6a2529] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:37:54.429249 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-c7a11d08-10ff-4168-89b9-170e9ef41aa6 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:54.429760 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-c7a11d08-10ff-4168-89b9-170e9ef41aa6 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:54.430589 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-c7a11d08-10ff-4168-89b9-170e9ef41aa6 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:54.431104 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-c7a11d08-10ff-4168-89b9-170e9ef41aa6 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:54.774847 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-c7a11d08-10ff-4168-89b9-170e9ef41aa6 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2deb449189ba427a9b8fcb0e21f22566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2c8716a46f54187902492f8ce162f58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:54.784314 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-c7a11d08-10ff-4168-89b9-170e9ef41aa6 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "GET /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529" status: 200 len: 1672 microversion: 2.1 time: 0.368280 Feb 17 04:37:54.784919 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 651/1222] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:37:54 2021] GET /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529 => generated 1672 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:37:54.816535 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-1e28be55-f99f-456c-ba44-7631de1e8c6c tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:37:54.817577 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-1e28be55-f99f-456c-ba44-7631de1e8c6c tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] [instance: b195626c-7ee1-4679-b956-f7ef7d6328f6] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:37:54.825481 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-1e28be55-f99f-456c-ba44-7631de1e8c6c tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:54.825988 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-1e28be55-f99f-456c-ba44-7631de1e8c6c tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:54.826822 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-1e28be55-f99f-456c-ba44-7631de1e8c6c tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:54.827341 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-1e28be55-f99f-456c-ba44-7631de1e8c6c tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:54.897529 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-1e28be55-f99f-456c-ba44-7631de1e8c6c tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] 10.222.0.78 "GET /compute/v2.1/servers/b195626c-7ee1-4679-b956-f7ef7d6328f6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.085559 Feb 17 04:37:54.898144 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 572/1223] 10.222.0.78 () {58 vars in 1292 bytes} [Wed Feb 17 04:37:54 2021] GET /compute/v2.1/servers/b195626c-7ee1-4679-b956-f7ef7d6328f6/os-volume_attachments => generated 197 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:37:55.109586 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-bcc816df-c94f-4373-a0d7-480579a1a762 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:37:55.110251 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-bcc816df-c94f-4373-a0d7-480579a1a762 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:37:55.118636 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-bcc816df-c94f-4373-a0d7-480579a1a762 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:55.119198 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-bcc816df-c94f-4373-a0d7-480579a1a762 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:55.120033 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-bcc816df-c94f-4373-a0d7-480579a1a762 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:55.120529 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-bcc816df-c94f-4373-a0d7-480579a1a762 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:55.334746 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-bcc816df-c94f-4373-a0d7-480579a1a762 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:55.344922 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-bcc816df-c94f-4373-a0d7-480579a1a762 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:55.347799 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-bcc816df-c94f-4373-a0d7-480579a1a762 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:55.349013 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-bcc816df-c94f-4373-a0d7-480579a1a762 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "GET /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9" status: 200 len: 1808 microversion: 2.20 time: 0.243807 Feb 17 04:37:55.349609 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 652/1224] 10.222.0.78 () {60 vars in 1267 bytes} [Wed Feb 17 04:37:55 2021] GET /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9 => generated 1808 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:37:55.802980 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-1f7181d7-3251-4c29-ace8-216b2331c54b tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:37:55.803678 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-1f7181d7-3251-4c29-ace8-216b2331c54b tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: 29d1ce27-f63b-4523-88be-55f65a6a2529] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:37:55.812100 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-1f7181d7-3251-4c29-ace8-216b2331c54b tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:55.812618 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-1f7181d7-3251-4c29-ace8-216b2331c54b tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:55.813493 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-1f7181d7-3251-4c29-ace8-216b2331c54b tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:55.814516 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-1f7181d7-3251-4c29-ace8-216b2331c54b tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:55.911211 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-e9c65108-da5f-449a-8306-0f2007bfcb28 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:37:55.912327 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-e9c65108-da5f-449a-8306-0f2007bfcb28 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] [instance: b195626c-7ee1-4679-b956-f7ef7d6328f6] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:37:55.920836 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-e9c65108-da5f-449a-8306-0f2007bfcb28 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:55.921460 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-e9c65108-da5f-449a-8306-0f2007bfcb28 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:55.922407 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-e9c65108-da5f-449a-8306-0f2007bfcb28 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:55.923000 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-e9c65108-da5f-449a-8306-0f2007bfcb28 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:55.998695 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-e9c65108-da5f-449a-8306-0f2007bfcb28 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] 10.222.0.78 "GET /compute/v2.1/servers/b195626c-7ee1-4679-b956-f7ef7d6328f6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.092591 Feb 17 04:37:55.999442 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 653/1225] 10.222.0.78 () {58 vars in 1292 bytes} [Wed Feb 17 04:37:55 2021] GET /compute/v2.1/servers/b195626c-7ee1-4679-b956-f7ef7d6328f6/os-volume_attachments => generated 197 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 17 04:37:56.257349 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-1f7181d7-3251-4c29-ace8-216b2331c54b tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2deb449189ba427a9b8fcb0e21f22566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2c8716a46f54187902492f8ce162f58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:56.266179 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-1f7181d7-3251-4c29-ace8-216b2331c54b tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "GET /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529" status: 200 len: 1672 microversion: 2.1 time: 0.467575 Feb 17 04:37:56.266773 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 573/1226] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:37:55 2021] GET /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529 => generated 1672 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:37:56.369511 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-c2b7b657-01a0-4457-abba-bd284f892a0c tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:37:56.369847 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-c2b7b657-01a0-4457-abba-bd284f892a0c tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:37:56.377808 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-c2b7b657-01a0-4457-abba-bd284f892a0c tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:56.378322 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-c2b7b657-01a0-4457-abba-bd284f892a0c tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:56.379220 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-c2b7b657-01a0-4457-abba-bd284f892a0c tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:56.379722 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-c2b7b657-01a0-4457-abba-bd284f892a0c tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:56.597739 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-c2b7b657-01a0-4457-abba-bd284f892a0c tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:56.607714 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-c2b7b657-01a0-4457-abba-bd284f892a0c tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:56.609574 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-c2b7b657-01a0-4457-abba-bd284f892a0c tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:56.610768 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-c2b7b657-01a0-4457-abba-bd284f892a0c tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "GET /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9" status: 200 len: 1808 microversion: 2.20 time: 0.245837 Feb 17 04:37:56.611531 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 654/1227] 10.222.0.78 () {60 vars in 1267 bytes} [Wed Feb 17 04:37:56 2021] GET /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9 => generated 1808 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:37:57.011309 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-2cee38bd-8bd6-4773-a725-ea1ae3ac89e3 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:37:57.012351 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-2cee38bd-8bd6-4773-a725-ea1ae3ac89e3 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] [instance: b195626c-7ee1-4679-b956-f7ef7d6328f6] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:37:57.021317 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-2cee38bd-8bd6-4773-a725-ea1ae3ac89e3 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:57.021830 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-2cee38bd-8bd6-4773-a725-ea1ae3ac89e3 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:57.022680 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-2cee38bd-8bd6-4773-a725-ea1ae3ac89e3 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:57.023231 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-2cee38bd-8bd6-4773-a725-ea1ae3ac89e3 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:57.098034 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-2cee38bd-8bd6-4773-a725-ea1ae3ac89e3 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] 10.222.0.78 "GET /compute/v2.1/servers/b195626c-7ee1-4679-b956-f7ef7d6328f6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.090749 Feb 17 04:37:57.098671 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 574/1228] 10.222.0.78 () {58 vars in 1292 bytes} [Wed Feb 17 04:37:57 2021] GET /compute/v2.1/servers/b195626c-7ee1-4679-b956-f7ef7d6328f6/os-volume_attachments => generated 197 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:37:57.286506 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-6db642a6-6dde-4453-9a3d-04c856f9fbaa tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:37:57.287349 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-6db642a6-6dde-4453-9a3d-04c856f9fbaa tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: 29d1ce27-f63b-4523-88be-55f65a6a2529] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:37:57.295858 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-6db642a6-6dde-4453-9a3d-04c856f9fbaa tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:57.296671 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-6db642a6-6dde-4453-9a3d-04c856f9fbaa tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:57.297656 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-6db642a6-6dde-4453-9a3d-04c856f9fbaa tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:57.298258 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-6db642a6-6dde-4453-9a3d-04c856f9fbaa tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:57.518517 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-6db642a6-6dde-4453-9a3d-04c856f9fbaa tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2deb449189ba427a9b8fcb0e21f22566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2c8716a46f54187902492f8ce162f58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:57.527438 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-6db642a6-6dde-4453-9a3d-04c856f9fbaa tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "GET /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529" status: 200 len: 1672 microversion: 2.1 time: 0.245724 Feb 17 04:37:57.528055 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 655/1229] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:37:57 2021] GET /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529 => generated 1672 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:37:57.630625 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-6a03c39a-937c-4f7f-b43b-73262fa787b6 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:37:57.631346 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-6a03c39a-937c-4f7f-b43b-73262fa787b6 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:37:57.639072 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-6a03c39a-937c-4f7f-b43b-73262fa787b6 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:57.639601 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-6a03c39a-937c-4f7f-b43b-73262fa787b6 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:57.640428 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-6a03c39a-937c-4f7f-b43b-73262fa787b6 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:57.640914 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-6a03c39a-937c-4f7f-b43b-73262fa787b6 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:58.034813 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-6a03c39a-937c-4f7f-b43b-73262fa787b6 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:58.045132 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-6a03c39a-937c-4f7f-b43b-73262fa787b6 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:58.047021 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-6a03c39a-937c-4f7f-b43b-73262fa787b6 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:58.048251 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-6a03c39a-937c-4f7f-b43b-73262fa787b6 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "GET /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9" status: 200 len: 1808 microversion: 2.20 time: 0.421932 Feb 17 04:37:58.048860 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 575/1230] 10.222.0.78 () {60 vars in 1267 bytes} [Wed Feb 17 04:37:57 2021] GET /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9 => generated 1808 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:37:58.110741 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-a5d4e729-a4fa-4858-ac52-91e4da2bd588 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:37:58.111842 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-a5d4e729-a4fa-4858-ac52-91e4da2bd588 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] [instance: b195626c-7ee1-4679-b956-f7ef7d6328f6] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:37:58.119678 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-a5d4e729-a4fa-4858-ac52-91e4da2bd588 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:58.120193 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-a5d4e729-a4fa-4858-ac52-91e4da2bd588 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:58.121047 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-a5d4e729-a4fa-4858-ac52-91e4da2bd588 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:58.121543 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-a5d4e729-a4fa-4858-ac52-91e4da2bd588 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:58.195449 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-a5d4e729-a4fa-4858-ac52-91e4da2bd588 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] 10.222.0.78 "GET /compute/v2.1/servers/b195626c-7ee1-4679-b956-f7ef7d6328f6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.089116 Feb 17 04:37:58.196076 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 656/1231] 10.222.0.78 () {58 vars in 1292 bytes} [Wed Feb 17 04:37:58 2021] GET /compute/v2.1/servers/b195626c-7ee1-4679-b956-f7ef7d6328f6/os-volume_attachments => generated 25 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 17 04:37:58.207102 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-25a30cb9-7fbd-4a12-b43e-43e23de70878 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:37:58.207655 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-25a30cb9-7fbd-4a12-b43e-43e23de70878 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] [instance: b195626c-7ee1-4679-b956-f7ef7d6328f6] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:37:58.215682 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-25a30cb9-7fbd-4a12-b43e-43e23de70878 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:58.216266 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-25a30cb9-7fbd-4a12-b43e-43e23de70878 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:58.217182 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-25a30cb9-7fbd-4a12-b43e-43e23de70878 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:58.217766 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-25a30cb9-7fbd-4a12-b43e-43e23de70878 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:58.386635 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.wsgi [None req-25a30cb9-7fbd-4a12-b43e-43e23de70878 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] HTTP exception thrown: Instance b195626c-7ee1-4679-b956-f7ef7d6328f6 is not attached to volume ec1eef41-849e-4737-ae92-2ac8b0099fa5 Feb 17 04:37:58.387359 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-25a30cb9-7fbd-4a12-b43e-43e23de70878 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Returning 404 to user: Instance b195626c-7ee1-4679-b956-f7ef7d6328f6 is not attached to volume ec1eef41-849e-4737-ae92-2ac8b0099fa5 {{(pid=98178) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 17 04:37:58.388283 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-25a30cb9-7fbd-4a12-b43e-43e23de70878 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] 10.222.0.78 "DELETE /compute/v2.1/servers/b195626c-7ee1-4679-b956-f7ef7d6328f6/os-volume_attachments/ec1eef41-849e-4737-ae92-2ac8b0099fa5" status: 404 len: 154 microversion: 2.1 time: 0.186017 Feb 17 04:37:58.388899 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 576/1232] 10.222.0.78 () {58 vars in 1406 bytes} [Wed Feb 17 04:37:58 2021] DELETE /compute/v2.1/servers/b195626c-7ee1-4679-b956-f7ef7d6328f6/os-volume_attachments/ec1eef41-849e-4737-ae92-2ac8b0099fa5 => generated 154 bytes in 187 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 17 04:37:58.546008 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-e9eac200-6568-418b-ba2d-03ae949386b3 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:37:58.546675 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-e9eac200-6568-418b-ba2d-03ae949386b3 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: 29d1ce27-f63b-4523-88be-55f65a6a2529] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:37:58.556298 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-e9eac200-6568-418b-ba2d-03ae949386b3 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:58.556808 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-e9eac200-6568-418b-ba2d-03ae949386b3 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:58.557651 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-e9eac200-6568-418b-ba2d-03ae949386b3 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:58.558141 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-e9eac200-6568-418b-ba2d-03ae949386b3 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:58.774786 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-e9eac200-6568-418b-ba2d-03ae949386b3 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2deb449189ba427a9b8fcb0e21f22566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2c8716a46f54187902492f8ce162f58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:58.784187 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-e9eac200-6568-418b-ba2d-03ae949386b3 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "GET /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529" status: 200 len: 1672 microversion: 2.1 time: 0.242155 Feb 17 04:37:58.784780 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 657/1233] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:37:58 2021] GET /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529 => generated 1672 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:37:59.069325 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-5a1f8696-c9bc-44af-9294-5b7c096195b6 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:37:59.070227 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-5a1f8696-c9bc-44af-9294-5b7c096195b6 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:37:59.078461 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-5a1f8696-c9bc-44af-9294-5b7c096195b6 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:59.079083 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-5a1f8696-c9bc-44af-9294-5b7c096195b6 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:59.080189 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-5a1f8696-c9bc-44af-9294-5b7c096195b6 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:59.080791 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-5a1f8696-c9bc-44af-9294-5b7c096195b6 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:59.728444 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [req-a7aa5d47-1b77-447f-9567-155c72a4432d req-97df29e9-43ca-4001-8483-570251f408dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29d1ce27-f63b-4523-88be-55f65a6a2529", "name": "network-vif-deleted", "tag": "55e2629a-f0a2-41a8-b1d3-df6b83ba5111"}]} {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:37:59.730348 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:37:59.730348 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: warnings.warn(msg) Feb 17 04:37:59.749640 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-5a1f8696-c9bc-44af-9294-5b7c096195b6 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:59.758951 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [req-a7aa5d47-1b77-447f-9567-155c72a4432d req-97df29e9-43ca-4001-8483-570251f408dd service nova] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:59.759685 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [req-a7aa5d47-1b77-447f-9567-155c72a4432d req-97df29e9-43ca-4001-8483-570251f408dd service nova] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:59.761696 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-5a1f8696-c9bc-44af-9294-5b7c096195b6 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:59.763744 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-5a1f8696-c9bc-44af-9294-5b7c096195b6 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:59.765138 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-5a1f8696-c9bc-44af-9294-5b7c096195b6 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "GET /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9" status: 200 len: 1808 microversion: 2.20 time: 0.701149 Feb 17 04:37:59.765894 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 577/1234] 10.222.0.78 () {60 vars in 1267 bytes} [Wed Feb 17 04:37:59 2021] GET /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9 => generated 1808 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:37:59.797849 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.compute.server_external_events [req-a7aa5d47-1b77-447f-9567-155c72a4432d req-97df29e9-43ca-4001-8483-570251f408dd service nova] Creating event network-vif-deleted:55e2629a-f0a2-41a8-b1d3-df6b83ba5111 for instance 29d1ce27-f63b-4523-88be-55f65a6a2529 on hv-cinder-75998 Feb 17 04:37:59.802856 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-906254ae-f056-4091-ae69-10a62e16ee6a tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:37:59.803552 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-906254ae-f056-4091-ae69-10a62e16ee6a tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: 29d1ce27-f63b-4523-88be-55f65a6a2529] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:37:59.815557 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [req-a7aa5d47-1b77-447f-9567-155c72a4432d req-97df29e9-43ca-4001-8483-570251f408dd service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089351 Feb 17 04:37:59.820358 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 658/1235] 10.222.0.78 () {64 vars in 1308 bytes} [Wed Feb 17 04:37:59 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:37:59.824024 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-906254ae-f056-4091-ae69-10a62e16ee6a tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:59.825036 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-906254ae-f056-4091-ae69-10a62e16ee6a tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:59.826778 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-906254ae-f056-4091-ae69-10a62e16ee6a tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:59.827737 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-906254ae-f056-4091-ae69-10a62e16ee6a tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:59.933028 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-207cf951-93ed-431b-b021-d13dd8556c8c tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:37:59.933874 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-207cf951-93ed-431b-b021-d13dd8556c8c tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] [instance: b195626c-7ee1-4679-b956-f7ef7d6328f6] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:37:59.943854 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-207cf951-93ed-431b-b021-d13dd8556c8c tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:59.944600 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-207cf951-93ed-431b-b021-d13dd8556c8c tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:59.945879 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-207cf951-93ed-431b-b021-d13dd8556c8c tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:59.946531 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-207cf951-93ed-431b-b021-d13dd8556c8c tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:00.028509 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-207cf951-93ed-431b-b021-d13dd8556c8c tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] [instance: b195626c-7ee1-4679-b956-f7ef7d6328f6] Going to try to terminate instance {{(pid=98179) delete /opt/stack/nova/nova/compute/api.py:2540}} Feb 17 04:38:00.030028 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-906254ae-f056-4091-ae69-10a62e16ee6a tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2deb449189ba427a9b8fcb0e21f22566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2c8716a46f54187902492f8ce162f58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:38:00.043555 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-906254ae-f056-4091-ae69-10a62e16ee6a tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "GET /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529" status: 200 len: 1323 microversion: 2.1 time: 0.245383 Feb 17 04:38:00.044965 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 578/1236] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:37:59 2021] GET /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529 => generated 1323 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:38:00.210341 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-207cf951-93ed-431b-b021-d13dd8556c8c tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] 10.222.0.78 "DELETE /compute/v2.1/servers/b195626c-7ee1-4679-b956-f7ef7d6328f6" status: 204 len: 0 microversion: 2.1 time: 0.282431 Feb 17 04:38:00.210999 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 659/1237] 10.222.0.78 () {58 vars in 1229 bytes} [Wed Feb 17 04:37:59 2021] DELETE /compute/v2.1/servers/b195626c-7ee1-4679-b956-f7ef7d6328f6 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Feb 17 04:38:00.220872 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-5816b067-48af-4490-a49c-a00452cd8d78 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:38:00.221726 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-5816b067-48af-4490-a49c-a00452cd8d78 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] [instance: b195626c-7ee1-4679-b956-f7ef7d6328f6] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:38:00.230061 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-5816b067-48af-4490-a49c-a00452cd8d78 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:00.230579 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-5816b067-48af-4490-a49c-a00452cd8d78 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:00.231506 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-5816b067-48af-4490-a49c-a00452cd8d78 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:00.232048 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-5816b067-48af-4490-a49c-a00452cd8d78 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:00.476761 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-5816b067-48af-4490-a49c-a00452cd8d78 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f3e4c3c174942c492405c9b112667de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5b2911946848de81be8f9741faa90f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:38:00.487939 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-5816b067-48af-4490-a49c-a00452cd8d78 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] 10.222.0.78 "GET /compute/v2.1/servers/b195626c-7ee1-4679-b956-f7ef7d6328f6" status: 200 len: 1554 microversion: 2.1 time: 0.271942 Feb 17 04:38:00.490202 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 579/1238] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:38:00 2021] GET /compute/v2.1/servers/b195626c-7ee1-4679-b956-f7ef7d6328f6 => generated 1554 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:38:00.793378 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-d10c01f3-5f4f-4478-9c14-20e3565e8365 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:38:00.795505 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-d10c01f3-5f4f-4478-9c14-20e3565e8365 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:38:00.809897 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-d10c01f3-5f4f-4478-9c14-20e3565e8365 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:00.810731 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-d10c01f3-5f4f-4478-9c14-20e3565e8365 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:00.811673 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-d10c01f3-5f4f-4478-9c14-20e3565e8365 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:00.812169 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-d10c01f3-5f4f-4478-9c14-20e3565e8365 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:01.058356 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-d10c01f3-5f4f-4478-9c14-20e3565e8365 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:38:01.065040 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-a7d8317f-209f-48d7-82ca-9fcc0f3f501d tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:38:01.065725 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-a7d8317f-209f-48d7-82ca-9fcc0f3f501d tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: 29d1ce27-f63b-4523-88be-55f65a6a2529] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:38:01.071670 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-d10c01f3-5f4f-4478-9c14-20e3565e8365 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:38:01.073411 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-d10c01f3-5f4f-4478-9c14-20e3565e8365 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:38:01.074568 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-a7d8317f-209f-48d7-82ca-9fcc0f3f501d tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:01.074854 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-d10c01f3-5f4f-4478-9c14-20e3565e8365 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "GET /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9" status: 200 len: 1808 microversion: 2.20 time: 0.286106 Feb 17 04:38:01.075121 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-a7d8317f-209f-48d7-82ca-9fcc0f3f501d tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:01.075958 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 660/1239] 10.222.0.78 () {60 vars in 1267 bytes} [Wed Feb 17 04:38:00 2021] GET /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9 => generated 1808 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:38:01.077776 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-a7d8317f-209f-48d7-82ca-9fcc0f3f501d tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:01.078373 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-a7d8317f-209f-48d7-82ca-9fcc0f3f501d tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:01.140620 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.wsgi [None req-a7d8317f-209f-48d7-82ca-9fcc0f3f501d tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] HTTP exception thrown: Instance 29d1ce27-f63b-4523-88be-55f65a6a2529 could not be found. Feb 17 04:38:01.141617 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-a7d8317f-209f-48d7-82ca-9fcc0f3f501d tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Returning 404 to user: Instance 29d1ce27-f63b-4523-88be-55f65a6a2529 could not be found. {{(pid=98178) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 17 04:38:01.142908 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-a7d8317f-209f-48d7-82ca-9fcc0f3f501d tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "GET /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529" status: 404 len: 111 microversion: 2.1 time: 0.082445 Feb 17 04:38:01.147171 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 580/1240] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:38:01 2021] GET /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 17 04:38:01.152850 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-4ebf3c6c-3afa-420b-94ce-f92911b1cb34 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Calling method '.version_select at 0x7f57c87191e0>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:38:01.174771 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-4ebf3c6c-3afa-420b-94ce-f92911b1cb34 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1175688493" status: 202 len: 0 microversion: 2.1 time: 0.026085 Feb 17 04:38:01.175912 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 661/1241] 10.222.0.78 () {58 vars in 1211 bytes} [Wed Feb 17 04:38:01 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1175688493 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:38:01.506447 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-034a7a48-c8af-41a7-9682-44436a919d64 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:38:01.507234 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-034a7a48-c8af-41a7-9682-44436a919d64 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] [instance: b195626c-7ee1-4679-b956-f7ef7d6328f6] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:38:01.515395 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-034a7a48-c8af-41a7-9682-44436a919d64 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:01.515919 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-034a7a48-c8af-41a7-9682-44436a919d64 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:01.516773 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-034a7a48-c8af-41a7-9682-44436a919d64 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:01.518280 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-034a7a48-c8af-41a7-9682-44436a919d64 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:01.765284 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-034a7a48-c8af-41a7-9682-44436a919d64 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f3e4c3c174942c492405c9b112667de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5b2911946848de81be8f9741faa90f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:38:01.776535 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-034a7a48-c8af-41a7-9682-44436a919d64 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] 10.222.0.78 "GET /compute/v2.1/servers/b195626c-7ee1-4679-b956-f7ef7d6328f6" status: 200 len: 1554 microversion: 2.1 time: 0.274090 Feb 17 04:38:01.777645 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 581/1242] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:38:01 2021] GET /compute/v2.1/servers/b195626c-7ee1-4679-b956-f7ef7d6328f6 => generated 1554 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:38:02.094718 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-aedd1e32-a3a7-4bce-883c-a949cf0d68cb tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:38:02.096234 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-aedd1e32-a3a7-4bce-883c-a949cf0d68cb tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:38:02.107128 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-aedd1e32-a3a7-4bce-883c-a949cf0d68cb tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:02.107638 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-aedd1e32-a3a7-4bce-883c-a949cf0d68cb tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:02.108751 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-aedd1e32-a3a7-4bce-883c-a949cf0d68cb tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:02.109240 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-aedd1e32-a3a7-4bce-883c-a949cf0d68cb tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:02.382416 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-aedd1e32-a3a7-4bce-883c-a949cf0d68cb tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:38:02.392961 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-aedd1e32-a3a7-4bce-883c-a949cf0d68cb tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:38:02.394735 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-aedd1e32-a3a7-4bce-883c-a949cf0d68cb tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:38:02.395969 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-aedd1e32-a3a7-4bce-883c-a949cf0d68cb tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "GET /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9" status: 200 len: 1808 microversion: 2.20 time: 0.306021 Feb 17 04:38:02.396576 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 662/1243] 10.222.0.78 () {60 vars in 1267 bytes} [Wed Feb 17 04:38:02 2021] GET /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9 => generated 1808 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:38:02.796904 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-1f982309-dd69-4a8e-82a1-f5c73c34b8c7 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:38:02.797575 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-1f982309-dd69-4a8e-82a1-f5c73c34b8c7 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] [instance: b195626c-7ee1-4679-b956-f7ef7d6328f6] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:38:02.806743 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-1f982309-dd69-4a8e-82a1-f5c73c34b8c7 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:02.807312 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-1f982309-dd69-4a8e-82a1-f5c73c34b8c7 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:02.808150 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-1f982309-dd69-4a8e-82a1-f5c73c34b8c7 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:02.808639 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-1f982309-dd69-4a8e-82a1-f5c73c34b8c7 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:03.197169 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-1f982309-dd69-4a8e-82a1-f5c73c34b8c7 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f3e4c3c174942c492405c9b112667de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5b2911946848de81be8f9741faa90f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:38:03.207657 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-1f982309-dd69-4a8e-82a1-f5c73c34b8c7 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] 10.222.0.78 "GET /compute/v2.1/servers/b195626c-7ee1-4679-b956-f7ef7d6328f6" status: 200 len: 1554 microversion: 2.1 time: 0.415087 Feb 17 04:38:03.208563 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 582/1244] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:38:02 2021] GET /compute/v2.1/servers/b195626c-7ee1-4679-b956-f7ef7d6328f6 => generated 1554 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:38:03.415515 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-48ce8596-500c-4f26-b638-3e51c0a2f377 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:38:03.416195 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-48ce8596-500c-4f26-b638-3e51c0a2f377 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:38:03.425287 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-48ce8596-500c-4f26-b638-3e51c0a2f377 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:03.425778 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-48ce8596-500c-4f26-b638-3e51c0a2f377 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:03.426908 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-48ce8596-500c-4f26-b638-3e51c0a2f377 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:03.427504 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-48ce8596-500c-4f26-b638-3e51c0a2f377 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:03.670819 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [req-b4094d8c-e840-474d-8b7d-e5220a57e0bf req-ad2fa856-a22c-42f2-bf21-31359cdfc9b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b195626c-7ee1-4679-b956-f7ef7d6328f6", "name": "network-vif-unplugged", "status": "completed", "tag": "b60a0e42-338e-46c0-ba43-9b2027219e08"}]} {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:38:03.673007 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:38:03.673007 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: warnings.warn(msg) Feb 17 04:38:03.683768 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [req-b4094d8c-e840-474d-8b7d-e5220a57e0bf req-ad2fa856-a22c-42f2-bf21-31359cdfc9b7 service nova] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:03.684269 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [req-b4094d8c-e840-474d-8b7d-e5220a57e0bf req-ad2fa856-a22c-42f2-bf21-31359cdfc9b7 service nova] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:03.706422 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.compute.server_external_events [req-b4094d8c-e840-474d-8b7d-e5220a57e0bf req-ad2fa856-a22c-42f2-bf21-31359cdfc9b7 service nova] Creating event network-vif-unplugged:b60a0e42-338e-46c0-ba43-9b2027219e08 for instance b195626c-7ee1-4679-b956-f7ef7d6328f6 on hv-cinder-75998 Feb 17 04:38:03.711732 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [req-b4094d8c-e840-474d-8b7d-e5220a57e0bf req-ad2fa856-a22c-42f2-bf21-31359cdfc9b7 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044657 Feb 17 04:38:03.712821 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 583/1245] 10.222.0.78 () {64 vars in 1308 bytes} [Wed Feb 17 04:38:03 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:38:03.750572 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-48ce8596-500c-4f26-b638-3e51c0a2f377 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:38:03.762136 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-48ce8596-500c-4f26-b638-3e51c0a2f377 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:38:03.764362 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-48ce8596-500c-4f26-b638-3e51c0a2f377 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:38:03.765463 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-48ce8596-500c-4f26-b638-3e51c0a2f377 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "GET /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9" status: 200 len: 1808 microversion: 2.20 time: 0.353994 Feb 17 04:38:03.766249 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 663/1246] 10.222.0.78 () {60 vars in 1267 bytes} [Wed Feb 17 04:38:03 2021] GET /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9 => generated 1808 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:38:03.802839 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-8600d8a6-d76e-4baa-be50-09d0a8d0dfd8 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Action: 'create', calling method: .version_select at 0x7f57c8573d08>, body: {"keypair": {"name": "tempest-keypair-508379513"}} {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:38:03.826784 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.quota [None req-8600d8a6-d76e-4baa-be50-09d0a8d0dfd8 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Getting quotas for project a2c8716a46f54187902492f8ce162f58. Resources: {'key_pairs'} {{(pid=98178) _get_quotas /opt/stack/nova/nova/quota.py:388}} Feb 17 04:38:03.831377 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.quota [None req-8600d8a6-d76e-4baa-be50-09d0a8d0dfd8 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Getting quotas for user 2deb449189ba427a9b8fcb0e21f22566 and project a2c8716a46f54187902492f8ce162f58. Resources: {'key_pairs'} {{(pid=98178) _get_quotas /opt/stack/nova/nova/quota.py:380}} Feb 17 04:38:03.994175 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.quota [None req-8600d8a6-d76e-4baa-be50-09d0a8d0dfd8 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Getting quotas for project a2c8716a46f54187902492f8ce162f58. Resources: {'key_pairs'} {{(pid=98178) _get_quotas /opt/stack/nova/nova/quota.py:388}} Feb 17 04:38:03.998284 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.quota [None req-8600d8a6-d76e-4baa-be50-09d0a8d0dfd8 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Getting quotas for user 2deb449189ba427a9b8fcb0e21f22566 and project a2c8716a46f54187902492f8ce162f58. Resources: {'key_pairs'} {{(pid=98178) _get_quotas /opt/stack/nova/nova/quota.py:380}} Feb 17 04:38:04.012110 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-8600d8a6-d76e-4baa-be50-09d0a8d0dfd8 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 2300 microversion: 2.1 time: 0.214790 Feb 17 04:38:04.012773 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 584/1247] 10.222.0.78 () {60 vars in 1148 bytes} [Wed Feb 17 04:38:03 2021] POST /compute/v2.1/os-keypairs => generated 2300 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:38:04.226411 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-9a77701b-e2ed-4487-b0f3-9c8c8ff7a9fe tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:38:04.227120 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-9a77701b-e2ed-4487-b0f3-9c8c8ff7a9fe tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] [instance: b195626c-7ee1-4679-b956-f7ef7d6328f6] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:38:04.237604 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-9a77701b-e2ed-4487-b0f3-9c8c8ff7a9fe tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:04.237941 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-9a77701b-e2ed-4487-b0f3-9c8c8ff7a9fe tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:04.238852 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-9a77701b-e2ed-4487-b0f3-9c8c8ff7a9fe tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:04.239746 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-9a77701b-e2ed-4487-b0f3-9c8c8ff7a9fe tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:04.474610 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-9a77701b-e2ed-4487-b0f3-9c8c8ff7a9fe tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f3e4c3c174942c492405c9b112667de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5b2911946848de81be8f9741faa90f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:38:04.483823 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-9a77701b-e2ed-4487-b0f3-9c8c8ff7a9fe tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] 10.222.0.78 "GET /compute/v2.1/servers/b195626c-7ee1-4679-b956-f7ef7d6328f6" status: 200 len: 1554 microversion: 2.1 time: 0.261128 Feb 17 04:38:04.484424 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 664/1248] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:38:04 2021] GET /compute/v2.1/servers/b195626c-7ee1-4679-b956-f7ef7d6328f6 => generated 1554 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:38:04.786891 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-5561118a-d793-486f-8b38-8eaaefd53b86 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:38:04.787720 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-5561118a-d793-486f-8b38-8eaaefd53b86 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:38:04.797256 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-5561118a-d793-486f-8b38-8eaaefd53b86 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:04.797775 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-5561118a-d793-486f-8b38-8eaaefd53b86 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:04.798737 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-5561118a-d793-486f-8b38-8eaaefd53b86 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:04.799269 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-5561118a-d793-486f-8b38-8eaaefd53b86 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:05.209621 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [req-bd0d5d49-e8d5-4c32-aaec-4776f63b6f54 req-28d9f7fa-731a-44a4-b83f-71bb94d8a775 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b195626c-7ee1-4679-b956-f7ef7d6328f6", "name": "network-vif-deleted", "tag": "b60a0e42-338e-46c0-ba43-9b2027219e08"}]} {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:38:05.211821 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:38:05.211821 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: warnings.warn(msg) Feb 17 04:38:05.221483 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [req-bd0d5d49-e8d5-4c32-aaec-4776f63b6f54 req-28d9f7fa-731a-44a4-b83f-71bb94d8a775 service nova] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:05.222137 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [req-bd0d5d49-e8d5-4c32-aaec-4776f63b6f54 req-28d9f7fa-731a-44a4-b83f-71bb94d8a775 service nova] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:05.239581 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-5561118a-d793-486f-8b38-8eaaefd53b86 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:38:05.244527 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.compute.server_external_events [req-bd0d5d49-e8d5-4c32-aaec-4776f63b6f54 req-28d9f7fa-731a-44a4-b83f-71bb94d8a775 service nova] Creating event network-vif-deleted:b60a0e42-338e-46c0-ba43-9b2027219e08 for instance b195626c-7ee1-4679-b956-f7ef7d6328f6 on hv-cinder-75998 Feb 17 04:38:05.250450 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [req-bd0d5d49-e8d5-4c32-aaec-4776f63b6f54 req-28d9f7fa-731a-44a4-b83f-71bb94d8a775 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044903 Feb 17 04:38:05.251409 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 665/1249] 10.222.0.78 () {64 vars in 1308 bytes} [Wed Feb 17 04:38:05 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:38:05.251552 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-5561118a-d793-486f-8b38-8eaaefd53b86 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:38:05.253688 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-5561118a-d793-486f-8b38-8eaaefd53b86 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:38:05.254787 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-5561118a-d793-486f-8b38-8eaaefd53b86 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "GET /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9" status: 200 len: 1808 microversion: 2.20 time: 0.472225 Feb 17 04:38:05.255408 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 585/1250] 10.222.0.78 () {60 vars in 1267 bytes} [Wed Feb 17 04:38:04 2021] GET /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9 => generated 1808 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:38:05.504691 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-a0a18744-ff07-43cd-bb94-55ada369edfa tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:38:05.505481 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-a0a18744-ff07-43cd-bb94-55ada369edfa tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] [instance: b195626c-7ee1-4679-b956-f7ef7d6328f6] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:38:05.514479 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-a0a18744-ff07-43cd-bb94-55ada369edfa tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:05.515128 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-a0a18744-ff07-43cd-bb94-55ada369edfa tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:05.516258 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-a0a18744-ff07-43cd-bb94-55ada369edfa tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:05.518090 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-a0a18744-ff07-43cd-bb94-55ada369edfa tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:05.598627 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-a0a18744-ff07-43cd-bb94-55ada369edfa tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:05.599177 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-a0a18744-ff07-43cd-bb94-55ada369edfa tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:05.599705 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.objects.instance [None req-a0a18744-ff07-43cd-bb94-55ada369edfa tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lazy-loading 'fault' on Instance uuid b195626c-7ee1-4679-b956-f7ef7d6328f6 {{(pid=98179) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Feb 17 04:38:05.670746 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-a0a18744-ff07-43cd-bb94-55ada369edfa tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f3e4c3c174942c492405c9b112667de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5b2911946848de81be8f9741faa90f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:38:05.680626 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-a0a18744-ff07-43cd-bb94-55ada369edfa tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] 10.222.0.78 "GET /compute/v2.1/servers/b195626c-7ee1-4679-b956-f7ef7d6328f6" status: 200 len: 1348 microversion: 2.1 time: 0.181542 Feb 17 04:38:05.681237 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 666/1251] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:38:05 2021] GET /compute/v2.1/servers/b195626c-7ee1-4679-b956-f7ef7d6328f6 => generated 1348 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:38:06.274531 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-19bfc499-2a7d-4d9f-96d3-61da3eed8874 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:38:06.275158 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-19bfc499-2a7d-4d9f-96d3-61da3eed8874 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:38:06.283570 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-19bfc499-2a7d-4d9f-96d3-61da3eed8874 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:06.284163 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-19bfc499-2a7d-4d9f-96d3-61da3eed8874 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:06.285025 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-19bfc499-2a7d-4d9f-96d3-61da3eed8874 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:06.285528 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-19bfc499-2a7d-4d9f-96d3-61da3eed8874 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:06.508986 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-19bfc499-2a7d-4d9f-96d3-61da3eed8874 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:38:06.520489 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-19bfc499-2a7d-4d9f-96d3-61da3eed8874 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:38:06.522433 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-19bfc499-2a7d-4d9f-96d3-61da3eed8874 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:38:06.523683 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-19bfc499-2a7d-4d9f-96d3-61da3eed8874 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "GET /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9" status: 200 len: 1808 microversion: 2.20 time: 0.253317 Feb 17 04:38:06.524280 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 586/1252] 10.222.0.78 () {60 vars in 1267 bytes} [Wed Feb 17 04:38:06 2021] GET /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9 => generated 1808 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:38:06.602101 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [req-9aa8627b-c157-40f1-98aa-79db25ddea23 req-12493f48-2f52-43e6-8c55-8b80ae3564dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9", "name": "network-vif-plugged", "status": "completed", "tag": "05ddcb41-fa3f-4fa9-a81d-e152e7b80f04"}]} {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:38:06.603932 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:38:06.603932 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: warnings.warn(msg) Feb 17 04:38:06.614647 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [req-9aa8627b-c157-40f1-98aa-79db25ddea23 req-12493f48-2f52-43e6-8c55-8b80ae3564dd service nova] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:06.615184 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [req-9aa8627b-c157-40f1-98aa-79db25ddea23 req-12493f48-2f52-43e6-8c55-8b80ae3564dd service nova] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:06.632761 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.compute.server_external_events [req-9aa8627b-c157-40f1-98aa-79db25ddea23 req-12493f48-2f52-43e6-8c55-8b80ae3564dd service nova] Creating event network-vif-plugged:05ddcb41-fa3f-4fa9-a81d-e152e7b80f04 for instance 8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9 on hv-cinder-75998 Feb 17 04:38:06.638213 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [req-9aa8627b-c157-40f1-98aa-79db25ddea23 req-12493f48-2f52-43e6-8c55-8b80ae3564dd service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040337 Feb 17 04:38:06.639399 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 667/1253] 10.222.0.78 () {64 vars in 1308 bytes} [Wed Feb 17 04:38:06 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:38:06.699968 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-e4215a99-a041-414f-883c-a2aa8a6713d3 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:38:06.700645 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-e4215a99-a041-414f-883c-a2aa8a6713d3 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] [instance: b195626c-7ee1-4679-b956-f7ef7d6328f6] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:38:06.709347 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-e4215a99-a041-414f-883c-a2aa8a6713d3 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:06.709863 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-e4215a99-a041-414f-883c-a2aa8a6713d3 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:06.710716 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-e4215a99-a041-414f-883c-a2aa8a6713d3 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:06.711250 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-e4215a99-a041-414f-883c-a2aa8a6713d3 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:06.768362 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.wsgi [None req-e4215a99-a041-414f-883c-a2aa8a6713d3 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] HTTP exception thrown: Instance b195626c-7ee1-4679-b956-f7ef7d6328f6 could not be found. Feb 17 04:38:06.769036 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-e4215a99-a041-414f-883c-a2aa8a6713d3 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Returning 404 to user: Instance b195626c-7ee1-4679-b956-f7ef7d6328f6 could not be found. {{(pid=98178) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 17 04:38:06.769936 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-e4215a99-a041-414f-883c-a2aa8a6713d3 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] 10.222.0.78 "GET /compute/v2.1/servers/b195626c-7ee1-4679-b956-f7ef7d6328f6" status: 404 len: 111 microversion: 2.1 time: 0.074062 Feb 17 04:38:06.770546 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 587/1254] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:38:06 2021] GET /compute/v2.1/servers/b195626c-7ee1-4679-b956-f7ef7d6328f6 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 17 04:38:06.772440 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-2cf05463-f7b9-4d33-b42f-55b6edd26699 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1300017573", "imageRef": "b005ed36-a85a-4c46-ba22-9fa8c5ec62e5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a4759f4f-636c-409c-a003-149d7d8e5a4a"}], "security_groups": [{"name": "tempest-securitygroup--72357758"}], "key_name": "tempest-keypair-508379513", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:38:06.778869 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-2f224c81-dbda-4bd3-92ba-25a34f6fad75 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] Calling method '.version_select at 0x7f57c8828ea0>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:38:06.795487 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-2f224c81-dbda-4bd3-92ba-25a34f6fad75 tempest-TestMinimumBasicScenario-434084501 tempest-TestMinimumBasicScenario-434084501-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1612377343" status: 202 len: 0 microversion: 2.1 time: 0.020333 Feb 17 04:38:06.796313 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 588/1255] 10.222.0.78 () {58 vars in 1262 bytes} [Wed Feb 17 04:38:06 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1612377343 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Feb 17 04:38:06.910183 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.network.neutron [None req-2cf05463-f7b9-4d33-b42f-55b6edd26699 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] validate_networks() for [('a4759f4f-636c-409c-a003-149d7d8e5a4a', None, None, None)] {{(pid=98179) validate_networks /opt/stack/nova/nova/network/neutron.py:2345}} Feb 17 04:38:07.543154 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-c96bd83c-8fc7-41e6-b28e-4b1544c151f9 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:38:07.543873 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-c96bd83c-8fc7-41e6-b28e-4b1544c151f9 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:38:07.553334 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-c96bd83c-8fc7-41e6-b28e-4b1544c151f9 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:07.553784 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-c96bd83c-8fc7-41e6-b28e-4b1544c151f9 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:07.555004 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-c96bd83c-8fc7-41e6-b28e-4b1544c151f9 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:07.555538 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-c96bd83c-8fc7-41e6-b28e-4b1544c151f9 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:07.557372 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.virt.hardware [None req-2cf05463-f7b9-4d33-b42f-55b6edd26699 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Flavor limits 0:0:0 {{(pid=98179) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 17 04:38:07.557854 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.virt.hardware [None req-2cf05463-f7b9-4d33-b42f-55b6edd26699 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Image limits 0:0:0 {{(pid=98179) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Feb 17 04:38:07.558397 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.virt.hardware [None req-2cf05463-f7b9-4d33-b42f-55b6edd26699 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Flavor pref 0:0:0 {{(pid=98179) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 17 04:38:07.558861 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.virt.hardware [None req-2cf05463-f7b9-4d33-b42f-55b6edd26699 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Image pref 0:0:0 {{(pid=98179) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Feb 17 04:38:07.559702 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.virt.hardware [None req-2cf05463-f7b9-4d33-b42f-55b6edd26699 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98179) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Feb 17 04:38:07.570733 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-2cf05463-f7b9-4d33-b42f-55b6edd26699 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:07.571256 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-2cf05463-f7b9-4d33-b42f-55b6edd26699 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:07.572801 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-2cf05463-f7b9-4d33-b42f-55b6edd26699 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:07.573481 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-2cf05463-f7b9-4d33-b42f-55b6edd26699 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:07.600163 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.quota [None req-2cf05463-f7b9-4d33-b42f-55b6edd26699 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Getting quotas for project a2c8716a46f54187902492f8ce162f58. Resources: {'ram', 'cores', 'instances'} {{(pid=98179) _get_quotas /opt/stack/nova/nova/quota.py:388}} Feb 17 04:38:07.605056 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.quota [None req-2cf05463-f7b9-4d33-b42f-55b6edd26699 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Getting quotas for user 2deb449189ba427a9b8fcb0e21f22566 and project a2c8716a46f54187902492f8ce162f58. Resources: {'ram', 'cores', 'instances'} {{(pid=98179) _get_quotas /opt/stack/nova/nova/quota.py:380}} Feb 17 04:38:07.618377 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-2cf05463-f7b9-4d33-b42f-55b6edd26699 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Going to run 1 instances... {{(pid=98179) _provision_instances /opt/stack/nova/nova/compute/api.py:1264}} Feb 17 04:38:07.621764 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-2cf05463-f7b9-4d33-b42f-55b6edd26699 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: d62b250c-c52b-4bd8-b6e0-b46ada9eee6f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b005ed36-a85a-4c46-ba22-9fa8c5ec62e5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98179) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1666}} Feb 17 04:38:07.677486 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-2cf05463-f7b9-4d33-b42f-55b6edd26699 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.909937 Feb 17 04:38:07.678416 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 668/1256] 10.222.0.78 () {60 vars in 1137 bytes} [Wed Feb 17 04:38:06 2021] POST /compute/v2.1/servers => generated 400 bytes in 912 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Feb 17 04:38:07.689180 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-dec88616-474e-4b3f-b9cf-70321e238553 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:38:07.690297 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-dec88616-474e-4b3f-b9cf-70321e238553 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: d62b250c-c52b-4bd8-b6e0-b46ada9eee6f] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:38:07.771615 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-dec88616-474e-4b3f-b9cf-70321e238553 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2deb449189ba427a9b8fcb0e21f22566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2c8716a46f54187902492f8ce162f58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:38:07.781090 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-dec88616-474e-4b3f-b9cf-70321e238553 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "GET /compute/v2.1/servers/d62b250c-c52b-4bd8-b6e0-b46ada9eee6f" status: 200 len: 1237 microversion: 2.1 time: 0.096127 Feb 17 04:38:07.782007 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 669/1257] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:38:07 2021] GET /compute/v2.1/servers/d62b250c-c52b-4bd8-b6e0-b46ada9eee6f => generated 1237 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:38:08.269895 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-c96bd83c-8fc7-41e6-b28e-4b1544c151f9 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:38:08.279899 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-c96bd83c-8fc7-41e6-b28e-4b1544c151f9 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:38:08.281578 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-c96bd83c-8fc7-41e6-b28e-4b1544c151f9 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:38:08.282869 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-c96bd83c-8fc7-41e6-b28e-4b1544c151f9 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "GET /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9" status: 200 len: 1808 microversion: 2.20 time: 0.744119 Feb 17 04:38:08.283580 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 589/1258] 10.222.0.78 () {60 vars in 1267 bytes} [Wed Feb 17 04:38:07 2021] GET /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9 => generated 1808 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:38:08.801342 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-cb62bc48-8adf-462b-9264-fb29876dd755 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:38:08.802019 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-cb62bc48-8adf-462b-9264-fb29876dd755 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: d62b250c-c52b-4bd8-b6e0-b46ada9eee6f] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:38:08.811182 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-cb62bc48-8adf-462b-9264-fb29876dd755 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:08.811946 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-cb62bc48-8adf-462b-9264-fb29876dd755 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:08.812794 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-cb62bc48-8adf-462b-9264-fb29876dd755 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:08.813281 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-cb62bc48-8adf-462b-9264-fb29876dd755 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:08.965220 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-cb62bc48-8adf-462b-9264-fb29876dd755 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2deb449189ba427a9b8fcb0e21f22566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2c8716a46f54187902492f8ce162f58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:38:08.976780 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-cb62bc48-8adf-462b-9264-fb29876dd755 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "GET /compute/v2.1/servers/d62b250c-c52b-4bd8-b6e0-b46ada9eee6f" status: 200 len: 1289 microversion: 2.1 time: 0.179865 Feb 17 04:38:08.977590 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 670/1259] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:38:08 2021] GET /compute/v2.1/servers/d62b250c-c52b-4bd8-b6e0-b46ada9eee6f => generated 1289 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:38:09.303468 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-b9a035f1-11a8-4c9d-85e7-6e01bec6df5e tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:38:09.304973 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-b9a035f1-11a8-4c9d-85e7-6e01bec6df5e tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:38:09.315192 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-b9a035f1-11a8-4c9d-85e7-6e01bec6df5e tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:09.315748 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-b9a035f1-11a8-4c9d-85e7-6e01bec6df5e tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:09.317035 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-b9a035f1-11a8-4c9d-85e7-6e01bec6df5e tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:09.317779 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-b9a035f1-11a8-4c9d-85e7-6e01bec6df5e tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:09.905742 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-b9a035f1-11a8-4c9d-85e7-6e01bec6df5e tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:38:09.916552 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-b9a035f1-11a8-4c9d-85e7-6e01bec6df5e tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:38:09.918150 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-b9a035f1-11a8-4c9d-85e7-6e01bec6df5e tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:38:09.919377 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-b9a035f1-11a8-4c9d-85e7-6e01bec6df5e tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "GET /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9" status: 200 len: 1808 microversion: 2.20 time: 0.621104 Feb 17 04:38:09.919981 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 590/1260] 10.222.0.78 () {60 vars in 1267 bytes} [Wed Feb 17 04:38:09 2021] GET /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9 => generated 1808 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:38:09.995990 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-18f286d5-dbd9-4b86-b53d-5eafb44d48bd tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:38:09.996673 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-18f286d5-dbd9-4b86-b53d-5eafb44d48bd tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: d62b250c-c52b-4bd8-b6e0-b46ada9eee6f] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:38:10.004970 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-18f286d5-dbd9-4b86-b53d-5eafb44d48bd tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:10.005487 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-18f286d5-dbd9-4b86-b53d-5eafb44d48bd tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:10.006349 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-18f286d5-dbd9-4b86-b53d-5eafb44d48bd tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:10.006846 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-18f286d5-dbd9-4b86-b53d-5eafb44d48bd tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:10.145670 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-18f286d5-dbd9-4b86-b53d-5eafb44d48bd tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2deb449189ba427a9b8fcb0e21f22566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2c8716a46f54187902492f8ce162f58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:38:10.154650 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-18f286d5-dbd9-4b86-b53d-5eafb44d48bd tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "GET /compute/v2.1/servers/d62b250c-c52b-4bd8-b6e0-b46ada9eee6f" status: 200 len: 1295 microversion: 2.1 time: 0.162922 Feb 17 04:38:10.155282 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 671/1261] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:38:09 2021] GET /compute/v2.1/servers/d62b250c-c52b-4bd8-b6e0-b46ada9eee6f => generated 1295 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:38:10.942035 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-9b64095d-7271-487e-acc6-d945e548a145 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:38:10.942716 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-9b64095d-7271-487e-acc6-d945e548a145 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:38:10.950758 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-9b64095d-7271-487e-acc6-d945e548a145 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:10.951505 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-9b64095d-7271-487e-acc6-d945e548a145 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:10.952355 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-9b64095d-7271-487e-acc6-d945e548a145 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:10.952849 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-9b64095d-7271-487e-acc6-d945e548a145 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:11.177823 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-bc5efdff-cf5d-4888-b181-a5aaf752ac61 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:38:11.179082 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-bc5efdff-cf5d-4888-b181-a5aaf752ac61 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: d62b250c-c52b-4bd8-b6e0-b46ada9eee6f] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:38:11.186907 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-bc5efdff-cf5d-4888-b181-a5aaf752ac61 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:11.187471 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-bc5efdff-cf5d-4888-b181-a5aaf752ac61 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:11.188321 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-bc5efdff-cf5d-4888-b181-a5aaf752ac61 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:11.189484 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-bc5efdff-cf5d-4888-b181-a5aaf752ac61 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:11.318818 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-bc5efdff-cf5d-4888-b181-a5aaf752ac61 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2deb449189ba427a9b8fcb0e21f22566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2c8716a46f54187902492f8ce162f58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:38:11.327664 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-bc5efdff-cf5d-4888-b181-a5aaf752ac61 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "GET /compute/v2.1/servers/d62b250c-c52b-4bd8-b6e0-b46ada9eee6f" status: 200 len: 1295 microversion: 2.1 time: 0.154447 Feb 17 04:38:11.328620 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 672/1262] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:38:11 2021] GET /compute/v2.1/servers/d62b250c-c52b-4bd8-b6e0-b46ada9eee6f => generated 1295 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:38:11.586139 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-9b64095d-7271-487e-acc6-d945e548a145 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:38:11.597121 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-9b64095d-7271-487e-acc6-d945e548a145 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:38:11.598805 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-9b64095d-7271-487e-acc6-d945e548a145 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:38:11.600157 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-9b64095d-7271-487e-acc6-d945e548a145 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "GET /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9" status: 200 len: 1795 microversion: 2.20 time: 0.663974 Feb 17 04:38:11.600752 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 591/1263] 10.222.0.78 () {60 vars in 1267 bytes} [Wed Feb 17 04:38:10 2021] GET /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9 => generated 1795 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:38:12.346587 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-0dedd242-0b35-4a49-a012-1609e4977009 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:38:12.349016 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-0dedd242-0b35-4a49-a012-1609e4977009 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: d62b250c-c52b-4bd8-b6e0-b46ada9eee6f] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:38:12.359812 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-0dedd242-0b35-4a49-a012-1609e4977009 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:12.361284 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-0dedd242-0b35-4a49-a012-1609e4977009 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:12.362384 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-0dedd242-0b35-4a49-a012-1609e4977009 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:12.363157 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-0dedd242-0b35-4a49-a012-1609e4977009 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:12.806846 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-0dedd242-0b35-4a49-a012-1609e4977009 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2deb449189ba427a9b8fcb0e21f22566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2c8716a46f54187902492f8ce162f58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:38:12.818387 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-0dedd242-0b35-4a49-a012-1609e4977009 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "GET /compute/v2.1/servers/d62b250c-c52b-4bd8-b6e0-b46ada9eee6f" status: 200 len: 1361 microversion: 2.1 time: 0.476272 Feb 17 04:38:12.829964 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 673/1264] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:38:12 2021] GET /compute/v2.1/servers/d62b250c-c52b-4bd8-b6e0-b46ada9eee6f => generated 1361 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:38:13.820166 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [req-79803087-1689-4274-8f6c-99d5eaf1f20c req-13aa14fa-250a-4d2e-9309-cedb02374177 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d62b250c-c52b-4bd8-b6e0-b46ada9eee6f", "tag": "72a7c07e-7741-4138-b15c-7f46d1c74f7a"}]} {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:38:13.821965 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:38:13.821965 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: warnings.warn(msg) Feb 17 04:38:13.834622 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [req-79803087-1689-4274-8f6c-99d5eaf1f20c req-13aa14fa-250a-4d2e-9309-cedb02374177 service nova] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:13.835182 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [req-79803087-1689-4274-8f6c-99d5eaf1f20c req-13aa14fa-250a-4d2e-9309-cedb02374177 service nova] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:13.839160 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-cf9ccd7d-80ec-4579-b5f1-7cf6ff534d59 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:38:13.839956 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-cf9ccd7d-80ec-4579-b5f1-7cf6ff534d59 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: d62b250c-c52b-4bd8-b6e0-b46ada9eee6f] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:38:13.863277 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.compute.server_external_events [req-79803087-1689-4274-8f6c-99d5eaf1f20c req-13aa14fa-250a-4d2e-9309-cedb02374177 service nova] Creating event network-changed:72a7c07e-7741-4138-b15c-7f46d1c74f7a for instance d62b250c-c52b-4bd8-b6e0-b46ada9eee6f on hv-cinder-75998 Feb 17 04:38:13.863904 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-cf9ccd7d-80ec-4579-b5f1-7cf6ff534d59 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:13.864630 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-cf9ccd7d-80ec-4579-b5f1-7cf6ff534d59 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:13.865701 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-cf9ccd7d-80ec-4579-b5f1-7cf6ff534d59 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:13.866670 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-cf9ccd7d-80ec-4579-b5f1-7cf6ff534d59 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:13.870615 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [req-79803087-1689-4274-8f6c-99d5eaf1f20c req-13aa14fa-250a-4d2e-9309-cedb02374177 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059962 Feb 17 04:38:13.871747 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 592/1265] 10.222.0.78 () {64 vars in 1308 bytes} [Wed Feb 17 04:38:13 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:38:14.327356 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-cf9ccd7d-80ec-4579-b5f1-7cf6ff534d59 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2deb449189ba427a9b8fcb0e21f22566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2c8716a46f54187902492f8ce162f58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:38:14.336989 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-cf9ccd7d-80ec-4579-b5f1-7cf6ff534d59 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "GET /compute/v2.1/servers/d62b250c-c52b-4bd8-b6e0-b46ada9eee6f" status: 200 len: 1361 microversion: 2.1 time: 0.502849 Feb 17 04:38:14.337811 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 674/1266] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:38:13 2021] GET /compute/v2.1/servers/d62b250c-c52b-4bd8-b6e0-b46ada9eee6f => generated 1361 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:38:15.356834 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-c2cb951e-9197-47b4-b4a3-8e3f4e18f3dc tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:38:15.358715 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-c2cb951e-9197-47b4-b4a3-8e3f4e18f3dc tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: d62b250c-c52b-4bd8-b6e0-b46ada9eee6f] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:38:15.368185 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-c2cb951e-9197-47b4-b4a3-8e3f4e18f3dc tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:15.369086 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-c2cb951e-9197-47b4-b4a3-8e3f4e18f3dc tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:15.370165 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-c2cb951e-9197-47b4-b4a3-8e3f4e18f3dc tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:15.370869 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-c2cb951e-9197-47b4-b4a3-8e3f4e18f3dc tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:15.646653 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-c2cb951e-9197-47b4-b4a3-8e3f4e18f3dc tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2deb449189ba427a9b8fcb0e21f22566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2c8716a46f54187902492f8ce162f58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:38:15.656279 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-c2cb951e-9197-47b4-b4a3-8e3f4e18f3dc tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "GET /compute/v2.1/servers/d62b250c-c52b-4bd8-b6e0-b46ada9eee6f" status: 200 len: 1361 microversion: 2.1 time: 0.303701 Feb 17 04:38:15.656915 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 593/1267] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:38:15 2021] GET /compute/v2.1/servers/d62b250c-c52b-4bd8-b6e0-b46ada9eee6f => generated 1361 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:38:16.674272 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-6bba4ecc-190a-482c-8727-3d8aea2ad44e tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:38:16.675000 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-6bba4ecc-190a-482c-8727-3d8aea2ad44e tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: d62b250c-c52b-4bd8-b6e0-b46ada9eee6f] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:38:16.682991 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-6bba4ecc-190a-482c-8727-3d8aea2ad44e tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:16.683506 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-6bba4ecc-190a-482c-8727-3d8aea2ad44e tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:16.684385 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-6bba4ecc-190a-482c-8727-3d8aea2ad44e tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:16.684883 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-6bba4ecc-190a-482c-8727-3d8aea2ad44e tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:16.982429 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-6bba4ecc-190a-482c-8727-3d8aea2ad44e tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2deb449189ba427a9b8fcb0e21f22566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2c8716a46f54187902492f8ce162f58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:38:16.992157 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-6bba4ecc-190a-482c-8727-3d8aea2ad44e tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "GET /compute/v2.1/servers/d62b250c-c52b-4bd8-b6e0-b46ada9eee6f" status: 200 len: 1361 microversion: 2.1 time: 0.321896 Feb 17 04:38:16.992747 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 675/1268] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:38:16 2021] GET /compute/v2.1/servers/d62b250c-c52b-4bd8-b6e0-b46ada9eee6f => generated 1361 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:38:18.010537 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-4e50cea4-8bac-4e26-8e18-1a75e0bacb02 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:38:18.011235 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-4e50cea4-8bac-4e26-8e18-1a75e0bacb02 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: d62b250c-c52b-4bd8-b6e0-b46ada9eee6f] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:38:18.019750 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-4e50cea4-8bac-4e26-8e18-1a75e0bacb02 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:18.020256 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-4e50cea4-8bac-4e26-8e18-1a75e0bacb02 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:18.021090 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-4e50cea4-8bac-4e26-8e18-1a75e0bacb02 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:18.021581 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-4e50cea4-8bac-4e26-8e18-1a75e0bacb02 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:18.237744 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-4e50cea4-8bac-4e26-8e18-1a75e0bacb02 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2deb449189ba427a9b8fcb0e21f22566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2c8716a46f54187902492f8ce162f58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:38:18.246893 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-4e50cea4-8bac-4e26-8e18-1a75e0bacb02 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "GET /compute/v2.1/servers/d62b250c-c52b-4bd8-b6e0-b46ada9eee6f" status: 200 len: 1361 microversion: 2.1 time: 0.240178 Feb 17 04:38:18.247638 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 594/1269] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:38:18 2021] GET /compute/v2.1/servers/d62b250c-c52b-4bd8-b6e0-b46ada9eee6f => generated 1361 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:38:19.267001 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-b18d2655-9d83-4541-b994-62d9c89c9527 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:38:19.268260 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-b18d2655-9d83-4541-b994-62d9c89c9527 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: d62b250c-c52b-4bd8-b6e0-b46ada9eee6f] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:38:19.276240 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-b18d2655-9d83-4541-b994-62d9c89c9527 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:19.276747 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-b18d2655-9d83-4541-b994-62d9c89c9527 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:19.277583 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-b18d2655-9d83-4541-b994-62d9c89c9527 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:19.278074 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-b18d2655-9d83-4541-b994-62d9c89c9527 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:19.492326 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-b18d2655-9d83-4541-b994-62d9c89c9527 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2deb449189ba427a9b8fcb0e21f22566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2c8716a46f54187902492f8ce162f58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:38:19.501377 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-b18d2655-9d83-4541-b994-62d9c89c9527 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "GET /compute/v2.1/servers/d62b250c-c52b-4bd8-b6e0-b46ada9eee6f" status: 200 len: 1361 microversion: 2.1 time: 0.238820 Feb 17 04:38:19.501989 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 676/1270] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:38:19 2021] GET /compute/v2.1/servers/d62b250c-c52b-4bd8-b6e0-b46ada9eee6f => generated 1361 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:38:20.520738 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-98d2206a-f753-470e-a6f2-49f8f22d022c tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:38:20.521410 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-98d2206a-f753-470e-a6f2-49f8f22d022c tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: d62b250c-c52b-4bd8-b6e0-b46ada9eee6f] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:38:20.529176 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-98d2206a-f753-470e-a6f2-49f8f22d022c tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:20.529673 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-98d2206a-f753-470e-a6f2-49f8f22d022c tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:20.530501 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-98d2206a-f753-470e-a6f2-49f8f22d022c tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:20.530989 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-98d2206a-f753-470e-a6f2-49f8f22d022c tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:20.753835 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-98d2206a-f753-470e-a6f2-49f8f22d022c tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2deb449189ba427a9b8fcb0e21f22566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2c8716a46f54187902492f8ce162f58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:38:20.762886 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-98d2206a-f753-470e-a6f2-49f8f22d022c tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "GET /compute/v2.1/servers/d62b250c-c52b-4bd8-b6e0-b46ada9eee6f" status: 200 len: 1361 microversion: 2.1 time: 0.246794 Feb 17 04:38:20.763545 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 595/1271] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:38:20 2021] GET /compute/v2.1/servers/d62b250c-c52b-4bd8-b6e0-b46ada9eee6f => generated 1361 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:38:20.810831 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [req-858d2132-bd88-44be-81a5-a372958be58c req-4ca7ddcc-cfb8-4cda-88eb-b06e1ffe1739 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d62b250c-c52b-4bd8-b6e0-b46ada9eee6f", "name": "network-vif-plugged", "status": "completed", "tag": "72a7c07e-7741-4138-b15c-7f46d1c74f7a"}]} {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:38:20.812717 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:38:20.812717 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: warnings.warn(msg) Feb 17 04:38:20.821937 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [req-858d2132-bd88-44be-81a5-a372958be58c req-4ca7ddcc-cfb8-4cda-88eb-b06e1ffe1739 service nova] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:20.822449 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [req-858d2132-bd88-44be-81a5-a372958be58c req-4ca7ddcc-cfb8-4cda-88eb-b06e1ffe1739 service nova] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:20.840617 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.compute.server_external_events [req-858d2132-bd88-44be-81a5-a372958be58c req-4ca7ddcc-cfb8-4cda-88eb-b06e1ffe1739 service nova] Creating event network-vif-plugged:72a7c07e-7741-4138-b15c-7f46d1c74f7a for instance d62b250c-c52b-4bd8-b6e0-b46ada9eee6f on hv-cinder-75998 Feb 17 04:38:20.846486 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [req-858d2132-bd88-44be-81a5-a372958be58c req-4ca7ddcc-cfb8-4cda-88eb-b06e1ffe1739 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039723 Feb 17 04:38:20.847166 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 677/1272] 10.222.0.78 () {64 vars in 1308 bytes} [Wed Feb 17 04:38:20 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:38:21.781985 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-1216f14b-2649-46a8-b5f4-3888f3321063 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:38:21.783121 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-1216f14b-2649-46a8-b5f4-3888f3321063 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: d62b250c-c52b-4bd8-b6e0-b46ada9eee6f] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:38:21.790714 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-1216f14b-2649-46a8-b5f4-3888f3321063 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:21.791250 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-1216f14b-2649-46a8-b5f4-3888f3321063 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:21.792085 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-1216f14b-2649-46a8-b5f4-3888f3321063 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:21.792575 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-1216f14b-2649-46a8-b5f4-3888f3321063 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:22.008263 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-1216f14b-2649-46a8-b5f4-3888f3321063 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2deb449189ba427a9b8fcb0e21f22566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2c8716a46f54187902492f8ce162f58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:38:22.017398 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-1216f14b-2649-46a8-b5f4-3888f3321063 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "GET /compute/v2.1/servers/d62b250c-c52b-4bd8-b6e0-b46ada9eee6f" status: 200 len: 1361 microversion: 2.1 time: 0.239496 Feb 17 04:38:22.018127 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 596/1273] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:38:21 2021] GET /compute/v2.1/servers/d62b250c-c52b-4bd8-b6e0-b46ada9eee6f => generated 1361 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:38:23.036782 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-0a624c95-9441-4861-84a0-d0c5aa5cdf76 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:38:23.037665 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-0a624c95-9441-4861-84a0-d0c5aa5cdf76 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: d62b250c-c52b-4bd8-b6e0-b46ada9eee6f] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:38:23.045744 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-0a624c95-9441-4861-84a0-d0c5aa5cdf76 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:23.046249 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-0a624c95-9441-4861-84a0-d0c5aa5cdf76 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:23.047091 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-0a624c95-9441-4861-84a0-d0c5aa5cdf76 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:23.047624 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-0a624c95-9441-4861-84a0-d0c5aa5cdf76 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:23.501251 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-0a624c95-9441-4861-84a0-d0c5aa5cdf76 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2deb449189ba427a9b8fcb0e21f22566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2c8716a46f54187902492f8ce162f58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:38:23.510010 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-0a624c95-9441-4861-84a0-d0c5aa5cdf76 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "GET /compute/v2.1/servers/d62b250c-c52b-4bd8-b6e0-b46ada9eee6f" status: 200 len: 1547 microversion: 2.1 time: 0.478032 Feb 17 04:38:23.510622 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 678/1274] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:38:23 2021] GET /compute/v2.1/servers/d62b250c-c52b-4bd8-b6e0-b46ada9eee6f => generated 1547 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:38:23.527590 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-3591d4e2-5faa-4a34-b956-8c7b4053a686 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:38:23.528115 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-3591d4e2-5faa-4a34-b956-8c7b4053a686 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: d62b250c-c52b-4bd8-b6e0-b46ada9eee6f] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:38:23.536825 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-3591d4e2-5faa-4a34-b956-8c7b4053a686 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:23.537357 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-3591d4e2-5faa-4a34-b956-8c7b4053a686 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:23.538160 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-3591d4e2-5faa-4a34-b956-8c7b4053a686 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:23.538647 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-3591d4e2-5faa-4a34-b956-8c7b4053a686 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:23.700530 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-3591d4e2-5faa-4a34-b956-8c7b4053a686 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "GET /compute/v2.1/servers/d62b250c-c52b-4bd8-b6e0-b46ada9eee6f/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.176878 Feb 17 04:38:23.701181 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 597/1275] 10.222.0.78 () {58 vars in 1265 bytes} [Wed Feb 17 04:38:23 2021] GET /compute/v2.1/servers/d62b250c-c52b-4bd8-b6e0-b46ada9eee6f/os-interface => generated 285 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:38:25.512279 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-b7a0e8f3-85cc-4122-b3b6-76ed5843dacd tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:38:25.513351 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-b7a0e8f3-85cc-4122-b3b6-76ed5843dacd tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: d62b250c-c52b-4bd8-b6e0-b46ada9eee6f] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:38:25.515732 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [req-07abb812-c7d0-48ef-a0e1-10e121d0a0cb req-85479686-5fd3-447c-a032-b8946fae275b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d62b250c-c52b-4bd8-b6e0-b46ada9eee6f", "tag": "72a7c07e-7741-4138-b15c-7f46d1c74f7a"}]} {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:38:25.517555 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:38:25.517555 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: warnings.warn(msg) Feb 17 04:38:25.521877 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-b7a0e8f3-85cc-4122-b3b6-76ed5843dacd tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:25.522376 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-b7a0e8f3-85cc-4122-b3b6-76ed5843dacd tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:25.523358 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-b7a0e8f3-85cc-4122-b3b6-76ed5843dacd tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:25.523757 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-b7a0e8f3-85cc-4122-b3b6-76ed5843dacd tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:25.527859 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [req-07abb812-c7d0-48ef-a0e1-10e121d0a0cb req-85479686-5fd3-447c-a032-b8946fae275b service nova] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:25.528604 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [req-07abb812-c7d0-48ef-a0e1-10e121d0a0cb req-85479686-5fd3-447c-a032-b8946fae275b service nova] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:25.546611 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.compute.server_external_events [req-07abb812-c7d0-48ef-a0e1-10e121d0a0cb req-85479686-5fd3-447c-a032-b8946fae275b service nova] Creating event network-changed:72a7c07e-7741-4138-b15c-7f46d1c74f7a for instance d62b250c-c52b-4bd8-b6e0-b46ada9eee6f on hv-cinder-75998 Feb 17 04:38:25.552532 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [req-07abb812-c7d0-48ef-a0e1-10e121d0a0cb req-85479686-5fd3-447c-a032-b8946fae275b service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041131 Feb 17 04:38:25.553194 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 598/1276] 10.222.0.78 () {64 vars in 1308 bytes} [Wed Feb 17 04:38:25 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:38:25.661865 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-b7a0e8f3-85cc-4122-b3b6-76ed5843dacd tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "POST /compute/v2.1/servers/d62b250c-c52b-4bd8-b6e0-b46ada9eee6f/action" status: 200 len: 14 microversion: 2.1 time: 0.153373 Feb 17 04:38:25.665871 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 679/1277] 10.222.0.78 () {60 vars in 1268 bytes} [Wed Feb 17 04:38:25 2021] POST /compute/v2.1/servers/d62b250c-c52b-4bd8-b6e0-b46ada9eee6f/action => generated 14 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 17 04:38:26.674849 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-5619d97a-fbda-4c2e-b06e-45a6b149b663 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:38:26.676019 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-5619d97a-fbda-4c2e-b06e-45a6b149b663 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: d62b250c-c52b-4bd8-b6e0-b46ada9eee6f] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:38:26.684636 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-5619d97a-fbda-4c2e-b06e-45a6b149b663 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:26.685236 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-5619d97a-fbda-4c2e-b06e-45a6b149b663 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:26.686192 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-5619d97a-fbda-4c2e-b06e-45a6b149b663 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:26.686764 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-5619d97a-fbda-4c2e-b06e-45a6b149b663 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:26.974072 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-5619d97a-fbda-4c2e-b06e-45a6b149b663 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "POST /compute/v2.1/servers/d62b250c-c52b-4bd8-b6e0-b46ada9eee6f/action" status: 200 len: 14 microversion: 2.1 time: 0.303758 Feb 17 04:38:26.977712 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 599/1278] 10.222.0.78 () {60 vars in 1268 bytes} [Wed Feb 17 04:38:26 2021] POST /compute/v2.1/servers/d62b250c-c52b-4bd8-b6e0-b46ada9eee6f/action => generated 14 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 17 04:38:27.986770 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-f461aa9e-4be4-491d-8756-e4e808b0a96a tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:38:27.987998 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-f461aa9e-4be4-491d-8756-e4e808b0a96a tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: d62b250c-c52b-4bd8-b6e0-b46ada9eee6f] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:38:27.996787 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-f461aa9e-4be4-491d-8756-e4e808b0a96a tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:27.997293 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-f461aa9e-4be4-491d-8756-e4e808b0a96a tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:27.998159 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-f461aa9e-4be4-491d-8756-e4e808b0a96a tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:27.998639 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-f461aa9e-4be4-491d-8756-e4e808b0a96a tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:28.140143 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-f461aa9e-4be4-491d-8756-e4e808b0a96a tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "POST /compute/v2.1/servers/d62b250c-c52b-4bd8-b6e0-b46ada9eee6f/action" status: 200 len: 14 microversion: 2.1 time: 0.157874 Feb 17 04:38:28.140783 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 680/1279] 10.222.0.78 () {60 vars in 1268 bytes} [Wed Feb 17 04:38:27 2021] POST /compute/v2.1/servers/d62b250c-c52b-4bd8-b6e0-b46ada9eee6f/action => generated 14 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 17 04:38:29.152606 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-68a5eb78-0473-446f-846c-07e2da532b3b tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:38:29.153851 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-68a5eb78-0473-446f-846c-07e2da532b3b tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: d62b250c-c52b-4bd8-b6e0-b46ada9eee6f] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:38:29.162725 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-68a5eb78-0473-446f-846c-07e2da532b3b tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:29.163272 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-68a5eb78-0473-446f-846c-07e2da532b3b tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:29.164129 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-68a5eb78-0473-446f-846c-07e2da532b3b tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:29.164627 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-68a5eb78-0473-446f-846c-07e2da532b3b tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:29.307498 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-68a5eb78-0473-446f-846c-07e2da532b3b tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "POST /compute/v2.1/servers/d62b250c-c52b-4bd8-b6e0-b46ada9eee6f/action" status: 200 len: 14 microversion: 2.1 time: 0.159250 Feb 17 04:38:29.308204 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 600/1280] 10.222.0.78 () {60 vars in 1268 bytes} [Wed Feb 17 04:38:29 2021] POST /compute/v2.1/servers/d62b250c-c52b-4bd8-b6e0-b46ada9eee6f/action => generated 14 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 17 04:38:30.320087 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-7cb2aedc-acce-486a-9cc4-1ffa8b1bb2d3 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:38:30.321218 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-7cb2aedc-acce-486a-9cc4-1ffa8b1bb2d3 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: d62b250c-c52b-4bd8-b6e0-b46ada9eee6f] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:38:30.329863 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-7cb2aedc-acce-486a-9cc4-1ffa8b1bb2d3 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:30.330408 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-7cb2aedc-acce-486a-9cc4-1ffa8b1bb2d3 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:30.331302 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-7cb2aedc-acce-486a-9cc4-1ffa8b1bb2d3 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:30.331798 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-7cb2aedc-acce-486a-9cc4-1ffa8b1bb2d3 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:30.453599 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-7cb2aedc-acce-486a-9cc4-1ffa8b1bb2d3 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "POST /compute/v2.1/servers/d62b250c-c52b-4bd8-b6e0-b46ada9eee6f/action" status: 200 len: 14 microversion: 2.1 time: 0.137920 Feb 17 04:38:30.454265 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 681/1281] 10.222.0.78 () {60 vars in 1268 bytes} [Wed Feb 17 04:38:30 2021] POST /compute/v2.1/servers/d62b250c-c52b-4bd8-b6e0-b46ada9eee6f/action => generated 14 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 17 04:38:31.466250 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-babb3fef-bb6e-402e-824f-d577a0725d19 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:38:31.467413 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-babb3fef-bb6e-402e-824f-d577a0725d19 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: d62b250c-c52b-4bd8-b6e0-b46ada9eee6f] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:38:31.477138 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-babb3fef-bb6e-402e-824f-d577a0725d19 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:31.477650 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-babb3fef-bb6e-402e-824f-d577a0725d19 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:31.478487 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-babb3fef-bb6e-402e-824f-d577a0725d19 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:31.478984 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-babb3fef-bb6e-402e-824f-d577a0725d19 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:31.627165 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-babb3fef-bb6e-402e-824f-d577a0725d19 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "POST /compute/v2.1/servers/d62b250c-c52b-4bd8-b6e0-b46ada9eee6f/action" status: 200 len: 14 microversion: 2.1 time: 0.164792 Feb 17 04:38:31.627921 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 601/1282] 10.222.0.78 () {60 vars in 1268 bytes} [Wed Feb 17 04:38:31 2021] POST /compute/v2.1/servers/d62b250c-c52b-4bd8-b6e0-b46ada9eee6f/action => generated 14 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 17 04:38:32.639062 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-f47595f0-bbb0-44f8-8eb0-bd55afacd1f0 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:38:32.640211 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-f47595f0-bbb0-44f8-8eb0-bd55afacd1f0 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: d62b250c-c52b-4bd8-b6e0-b46ada9eee6f] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:38:32.648866 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-f47595f0-bbb0-44f8-8eb0-bd55afacd1f0 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:32.649380 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-f47595f0-bbb0-44f8-8eb0-bd55afacd1f0 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:32.650221 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-f47595f0-bbb0-44f8-8eb0-bd55afacd1f0 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:32.650719 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-f47595f0-bbb0-44f8-8eb0-bd55afacd1f0 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:32.788299 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-f47595f0-bbb0-44f8-8eb0-bd55afacd1f0 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "POST /compute/v2.1/servers/d62b250c-c52b-4bd8-b6e0-b46ada9eee6f/action" status: 200 len: 14 microversion: 2.1 time: 0.153618 Feb 17 04:38:32.788976 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 682/1283] 10.222.0.78 () {60 vars in 1268 bytes} [Wed Feb 17 04:38:32 2021] POST /compute/v2.1/servers/d62b250c-c52b-4bd8-b6e0-b46ada9eee6f/action => generated 14 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 17 04:38:33.801363 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-f8376a06-1e9c-4e37-b421-ef327326791b tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:38:33.802533 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-f8376a06-1e9c-4e37-b421-ef327326791b tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: d62b250c-c52b-4bd8-b6e0-b46ada9eee6f] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:38:33.811155 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-f8376a06-1e9c-4e37-b421-ef327326791b tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:33.811664 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-f8376a06-1e9c-4e37-b421-ef327326791b tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:33.812492 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-f8376a06-1e9c-4e37-b421-ef327326791b tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:33.812978 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-f8376a06-1e9c-4e37-b421-ef327326791b tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:33.941364 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-f8376a06-1e9c-4e37-b421-ef327326791b tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "POST /compute/v2.1/servers/d62b250c-c52b-4bd8-b6e0-b46ada9eee6f/action" status: 200 len: 14 microversion: 2.1 time: 0.144548 Feb 17 04:38:33.942054 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 602/1284] 10.222.0.78 () {60 vars in 1268 bytes} [Wed Feb 17 04:38:33 2021] POST /compute/v2.1/servers/d62b250c-c52b-4bd8-b6e0-b46ada9eee6f/action => generated 14 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 17 04:38:34.953974 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-b0da9c92-c19c-41c7-816d-2e9820ddace8 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:38:34.955770 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-b0da9c92-c19c-41c7-816d-2e9820ddace8 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: d62b250c-c52b-4bd8-b6e0-b46ada9eee6f] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:38:34.964398 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-b0da9c92-c19c-41c7-816d-2e9820ddace8 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:34.964901 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-b0da9c92-c19c-41c7-816d-2e9820ddace8 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:34.965734 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-b0da9c92-c19c-41c7-816d-2e9820ddace8 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:34.966222 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-b0da9c92-c19c-41c7-816d-2e9820ddace8 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:35.122817 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-b0da9c92-c19c-41c7-816d-2e9820ddace8 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "POST /compute/v2.1/servers/d62b250c-c52b-4bd8-b6e0-b46ada9eee6f/action" status: 200 len: 14 microversion: 2.1 time: 0.173265 Feb 17 04:38:35.123723 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 683/1285] 10.222.0.78 () {60 vars in 1268 bytes} [Wed Feb 17 04:38:34 2021] POST /compute/v2.1/servers/d62b250c-c52b-4bd8-b6e0-b46ada9eee6f/action => generated 14 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 17 04:38:36.135279 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-04e09c30-a455-410f-b442-211db5a80790 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:38:36.138086 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-04e09c30-a455-410f-b442-211db5a80790 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: d62b250c-c52b-4bd8-b6e0-b46ada9eee6f] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:38:36.146969 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-04e09c30-a455-410f-b442-211db5a80790 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:36.147513 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-04e09c30-a455-410f-b442-211db5a80790 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:36.148372 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-04e09c30-a455-410f-b442-211db5a80790 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:36.148873 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-04e09c30-a455-410f-b442-211db5a80790 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:36.294497 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-04e09c30-a455-410f-b442-211db5a80790 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "POST /compute/v2.1/servers/d62b250c-c52b-4bd8-b6e0-b46ada9eee6f/action" status: 200 len: 14 microversion: 2.1 time: 0.163586 Feb 17 04:38:36.295247 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 603/1286] 10.222.0.78 () {60 vars in 1268 bytes} [Wed Feb 17 04:38:36 2021] POST /compute/v2.1/servers/d62b250c-c52b-4bd8-b6e0-b46ada9eee6f/action => generated 14 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 17 04:38:37.306909 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-73fa846f-6e5f-413c-804b-5e47208816b1 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:38:37.308120 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-73fa846f-6e5f-413c-804b-5e47208816b1 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: d62b250c-c52b-4bd8-b6e0-b46ada9eee6f] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:38:37.316974 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-73fa846f-6e5f-413c-804b-5e47208816b1 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:37.317492 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-73fa846f-6e5f-413c-804b-5e47208816b1 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:37.318328 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-73fa846f-6e5f-413c-804b-5e47208816b1 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:37.318819 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-73fa846f-6e5f-413c-804b-5e47208816b1 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:37.471792 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-73fa846f-6e5f-413c-804b-5e47208816b1 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "POST /compute/v2.1/servers/d62b250c-c52b-4bd8-b6e0-b46ada9eee6f/action" status: 200 len: 10658 microversion: 2.1 time: 0.168099 Feb 17 04:38:37.472493 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 684/1287] 10.222.0.78 () {60 vars in 1268 bytes} [Wed Feb 17 04:38:37 2021] POST /compute/v2.1/servers/d62b250c-c52b-4bd8-b6e0-b46ada9eee6f/action => generated 10658 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 04:38:38.484857 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-51e71d54-dec0-4006-8f5f-8e3819e70f14 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:38:38.486558 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-51e71d54-dec0-4006-8f5f-8e3819e70f14 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: d62b250c-c52b-4bd8-b6e0-b46ada9eee6f] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:38:38.495330 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-51e71d54-dec0-4006-8f5f-8e3819e70f14 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:38.495850 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-51e71d54-dec0-4006-8f5f-8e3819e70f14 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:38.496694 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-51e71d54-dec0-4006-8f5f-8e3819e70f14 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:38.497193 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-51e71d54-dec0-4006-8f5f-8e3819e70f14 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:38.639461 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-51e71d54-dec0-4006-8f5f-8e3819e70f14 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "POST /compute/v2.1/servers/d62b250c-c52b-4bd8-b6e0-b46ada9eee6f/action" status: 200 len: 17055 microversion: 2.1 time: 0.159098 Feb 17 04:38:38.640163 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 604/1288] 10.222.0.78 () {60 vars in 1268 bytes} [Wed Feb 17 04:38:38 2021] POST /compute/v2.1/servers/d62b250c-c52b-4bd8-b6e0-b46ada9eee6f/action => generated 17055 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 04:38:39.653449 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-55ef58f1-84db-4f16-87bd-091b929d16a7 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:38:39.654577 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-55ef58f1-84db-4f16-87bd-091b929d16a7 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: d62b250c-c52b-4bd8-b6e0-b46ada9eee6f] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:38:39.663424 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-55ef58f1-84db-4f16-87bd-091b929d16a7 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:39.663931 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-55ef58f1-84db-4f16-87bd-091b929d16a7 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:39.664762 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-55ef58f1-84db-4f16-87bd-091b929d16a7 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:39.665249 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-55ef58f1-84db-4f16-87bd-091b929d16a7 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:39.818603 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-55ef58f1-84db-4f16-87bd-091b929d16a7 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "POST /compute/v2.1/servers/d62b250c-c52b-4bd8-b6e0-b46ada9eee6f/action" status: 200 len: 18356 microversion: 2.1 time: 0.169441 Feb 17 04:38:39.819335 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 685/1289] 10.222.0.78 () {60 vars in 1268 bytes} [Wed Feb 17 04:38:39 2021] POST /compute/v2.1/servers/d62b250c-c52b-4bd8-b6e0-b46ada9eee6f/action => generated 18356 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 04:38:40.990103 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-b3a3f471-f2cc-4d00-9e86-cbf724027a15 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:38:40.991357 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-b3a3f471-f2cc-4d00-9e86-cbf724027a15 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: d62b250c-c52b-4bd8-b6e0-b46ada9eee6f] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:38:40.999631 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-b3a3f471-f2cc-4d00-9e86-cbf724027a15 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:41.000146 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-b3a3f471-f2cc-4d00-9e86-cbf724027a15 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:41.000989 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-b3a3f471-f2cc-4d00-9e86-cbf724027a15 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:41.001553 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-b3a3f471-f2cc-4d00-9e86-cbf724027a15 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:41.147845 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-b3a3f471-f2cc-4d00-9e86-cbf724027a15 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "POST /compute/v2.1/servers/d62b250c-c52b-4bd8-b6e0-b46ada9eee6f/action" status: 200 len: 21165 microversion: 2.1 time: 0.321066 Feb 17 04:38:41.148463 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 605/1290] 10.222.0.78 () {60 vars in 1268 bytes} [Wed Feb 17 04:38:40 2021] POST /compute/v2.1/servers/d62b250c-c52b-4bd8-b6e0-b46ada9eee6f/action => generated 21165 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 04:38:42.162027 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-c961c06a-6e2c-4c6c-8fe8-a0d43576922b tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:38:42.163206 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-c961c06a-6e2c-4c6c-8fe8-a0d43576922b tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: d62b250c-c52b-4bd8-b6e0-b46ada9eee6f] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:38:42.172039 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-c961c06a-6e2c-4c6c-8fe8-a0d43576922b tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:42.172550 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-c961c06a-6e2c-4c6c-8fe8-a0d43576922b tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:42.174571 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-c961c06a-6e2c-4c6c-8fe8-a0d43576922b tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:42.175098 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-c961c06a-6e2c-4c6c-8fe8-a0d43576922b tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:42.324816 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-c961c06a-6e2c-4c6c-8fe8-a0d43576922b tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "POST /compute/v2.1/servers/d62b250c-c52b-4bd8-b6e0-b46ada9eee6f/action" status: 200 len: 23045 microversion: 2.1 time: 0.168061 Feb 17 04:38:42.325847 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 686/1291] 10.222.0.78 () {60 vars in 1268 bytes} [Wed Feb 17 04:38:42 2021] POST /compute/v2.1/servers/d62b250c-c52b-4bd8-b6e0-b46ada9eee6f/action => generated 23045 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 04:38:43.338099 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-759628c6-7cad-435e-b077-9994254fc822 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:38:43.339193 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-759628c6-7cad-435e-b077-9994254fc822 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: d62b250c-c52b-4bd8-b6e0-b46ada9eee6f] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:38:43.348646 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-759628c6-7cad-435e-b077-9994254fc822 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:43.349156 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-759628c6-7cad-435e-b077-9994254fc822 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:43.350003 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-759628c6-7cad-435e-b077-9994254fc822 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:43.350500 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-759628c6-7cad-435e-b077-9994254fc822 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:43.498708 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-759628c6-7cad-435e-b077-9994254fc822 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "POST /compute/v2.1/servers/d62b250c-c52b-4bd8-b6e0-b46ada9eee6f/action" status: 200 len: 23803 microversion: 2.1 time: 0.165075 Feb 17 04:38:43.499420 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 606/1292] 10.222.0.78 () {60 vars in 1268 bytes} [Wed Feb 17 04:38:43 2021] POST /compute/v2.1/servers/d62b250c-c52b-4bd8-b6e0-b46ada9eee6f/action => generated 23803 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 04:38:44.511919 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-a6c41b05-ba36-4c24-a0a6-5984234210fc tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:38:44.513060 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-a6c41b05-ba36-4c24-a0a6-5984234210fc tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: d62b250c-c52b-4bd8-b6e0-b46ada9eee6f] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:38:44.522885 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-a6c41b05-ba36-4c24-a0a6-5984234210fc tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:44.523452 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-a6c41b05-ba36-4c24-a0a6-5984234210fc tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:44.524289 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-a6c41b05-ba36-4c24-a0a6-5984234210fc tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:44.524786 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-a6c41b05-ba36-4c24-a0a6-5984234210fc tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:44.669067 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-a6c41b05-ba36-4c24-a0a6-5984234210fc tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "POST /compute/v2.1/servers/d62b250c-c52b-4bd8-b6e0-b46ada9eee6f/action" status: 200 len: 25271 microversion: 2.1 time: 0.161587 Feb 17 04:38:44.670027 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 687/1293] 10.222.0.78 () {60 vars in 1268 bytes} [Wed Feb 17 04:38:44 2021] POST /compute/v2.1/servers/d62b250c-c52b-4bd8-b6e0-b46ada9eee6f/action => generated 25271 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 04:38:45.681650 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-38dd4c86-3e1c-4c9d-9a3b-cc02783ad72d tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:38:45.682798 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-38dd4c86-3e1c-4c9d-9a3b-cc02783ad72d tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: d62b250c-c52b-4bd8-b6e0-b46ada9eee6f] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:38:45.691848 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-38dd4c86-3e1c-4c9d-9a3b-cc02783ad72d tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:45.692363 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-38dd4c86-3e1c-4c9d-9a3b-cc02783ad72d tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:45.693208 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-38dd4c86-3e1c-4c9d-9a3b-cc02783ad72d tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:45.693709 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-38dd4c86-3e1c-4c9d-9a3b-cc02783ad72d tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:45.863014 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-38dd4c86-3e1c-4c9d-9a3b-cc02783ad72d tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "POST /compute/v2.1/servers/d62b250c-c52b-4bd8-b6e0-b46ada9eee6f/action" status: 200 len: 26720 microversion: 2.1 time: 0.185476 Feb 17 04:38:45.863995 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 607/1294] 10.222.0.78 () {60 vars in 1268 bytes} [Wed Feb 17 04:38:45 2021] POST /compute/v2.1/servers/d62b250c-c52b-4bd8-b6e0-b46ada9eee6f/action => generated 26720 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 04:38:46.876488 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-f1cc1ca8-6b3a-42b1-8e5e-bc6b030ec745 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:38:46.877697 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-f1cc1ca8-6b3a-42b1-8e5e-bc6b030ec745 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: d62b250c-c52b-4bd8-b6e0-b46ada9eee6f] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:38:46.886338 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-f1cc1ca8-6b3a-42b1-8e5e-bc6b030ec745 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:46.886855 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-f1cc1ca8-6b3a-42b1-8e5e-bc6b030ec745 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:46.887807 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-f1cc1ca8-6b3a-42b1-8e5e-bc6b030ec745 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:46.888307 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-f1cc1ca8-6b3a-42b1-8e5e-bc6b030ec745 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:47.049409 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-f1cc1ca8-6b3a-42b1-8e5e-bc6b030ec745 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "POST /compute/v2.1/servers/d62b250c-c52b-4bd8-b6e0-b46ada9eee6f/action" status: 200 len: 27582 microversion: 2.1 time: 0.177539 Feb 17 04:38:47.050119 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 688/1295] 10.222.0.78 () {60 vars in 1268 bytes} [Wed Feb 17 04:38:46 2021] POST /compute/v2.1/servers/d62b250c-c52b-4bd8-b6e0-b46ada9eee6f/action => generated 27582 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 04:38:48.062654 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-4ed3304b-7006-4ac9-9d88-90f1470b7a3f tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:38:48.063910 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-4ed3304b-7006-4ac9-9d88-90f1470b7a3f tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: d62b250c-c52b-4bd8-b6e0-b46ada9eee6f] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:38:48.072657 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-4ed3304b-7006-4ac9-9d88-90f1470b7a3f tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:48.073166 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-4ed3304b-7006-4ac9-9d88-90f1470b7a3f tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:48.073996 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-4ed3304b-7006-4ac9-9d88-90f1470b7a3f tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:48.074484 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-4ed3304b-7006-4ac9-9d88-90f1470b7a3f tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:48.228892 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-4ed3304b-7006-4ac9-9d88-90f1470b7a3f tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "POST /compute/v2.1/servers/d62b250c-c52b-4bd8-b6e0-b46ada9eee6f/action" status: 200 len: 27882 microversion: 2.1 time: 0.170567 Feb 17 04:38:48.229602 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 608/1296] 10.222.0.78 () {60 vars in 1268 bytes} [Wed Feb 17 04:38:48 2021] POST /compute/v2.1/servers/d62b250c-c52b-4bd8-b6e0-b46ada9eee6f/action => generated 27882 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 04:38:49.242989 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-2d315fab-5a7d-4c29-8428-5eaa454655f4 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:38:49.244166 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-2d315fab-5a7d-4c29-8428-5eaa454655f4 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: d62b250c-c52b-4bd8-b6e0-b46ada9eee6f] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:38:49.253385 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-2d315fab-5a7d-4c29-8428-5eaa454655f4 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:49.253890 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-2d315fab-5a7d-4c29-8428-5eaa454655f4 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:49.254735 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-2d315fab-5a7d-4c29-8428-5eaa454655f4 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:49.255252 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-2d315fab-5a7d-4c29-8428-5eaa454655f4 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:49.404060 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-2d315fab-5a7d-4c29-8428-5eaa454655f4 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "POST /compute/v2.1/servers/d62b250c-c52b-4bd8-b6e0-b46ada9eee6f/action" status: 200 len: 28200 microversion: 2.1 time: 0.165231 Feb 17 04:38:49.404685 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 689/1297] 10.222.0.78 () {60 vars in 1268 bytes} [Wed Feb 17 04:38:49 2021] POST /compute/v2.1/servers/d62b250c-c52b-4bd8-b6e0-b46ada9eee6f/action => generated 28200 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 04:38:50.417545 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-abce960a-7af8-4d47-a5e6-a88f0011b783 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:38:50.418665 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-abce960a-7af8-4d47-a5e6-a88f0011b783 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: d62b250c-c52b-4bd8-b6e0-b46ada9eee6f] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:38:50.428233 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-abce960a-7af8-4d47-a5e6-a88f0011b783 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:50.428740 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-abce960a-7af8-4d47-a5e6-a88f0011b783 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:50.429573 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-abce960a-7af8-4d47-a5e6-a88f0011b783 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:50.430110 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-abce960a-7af8-4d47-a5e6-a88f0011b783 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:50.575340 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-abce960a-7af8-4d47-a5e6-a88f0011b783 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "POST /compute/v2.1/servers/d62b250c-c52b-4bd8-b6e0-b46ada9eee6f/action" status: 200 len: 28242 microversion: 2.1 time: 0.161995 Feb 17 04:38:50.576319 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 609/1298] 10.222.0.78 () {60 vars in 1268 bytes} [Wed Feb 17 04:38:50 2021] POST /compute/v2.1/servers/d62b250c-c52b-4bd8-b6e0-b46ada9eee6f/action => generated 28242 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 04:38:51.291626 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-73a78f39-5d6d-4c2a-b929-094c1e3f8491 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:38:51.292303 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-73a78f39-5d6d-4c2a-b929-094c1e3f8491 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] [instance: 62a16d76-4309-472d-9c9e-6e86b36a653c] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:38:51.302080 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-73a78f39-5d6d-4c2a-b929-094c1e3f8491 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:51.302593 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-73a78f39-5d6d-4c2a-b929-094c1e3f8491 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:51.303500 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-73a78f39-5d6d-4c2a-b929-094c1e3f8491 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:51.303996 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-73a78f39-5d6d-4c2a-b929-094c1e3f8491 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:51.366718 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.objects.instance [None req-73a78f39-5d6d-4c2a-b929-094c1e3f8491 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Lazy-loading 'flavor' on Instance uuid 62a16d76-4309-472d-9c9e-6e86b36a653c {{(pid=98179) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Feb 17 04:38:51.516236 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-73a78f39-5d6d-4c2a-b929-094c1e3f8491 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] 10.222.0.78 "POST /compute/v2.1/servers/62a16d76-4309-472d-9c9e-6e86b36a653c/action" status: 202 len: 0 microversion: 2.1 time: 0.229005 Feb 17 04:38:51.516925 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 690/1299] 10.222.0.78 () {60 vars in 1268 bytes} [Wed Feb 17 04:38:51 2021] POST /compute/v2.1/servers/62a16d76-4309-472d-9c9e-6e86b36a653c/action => generated 0 bytes in 231 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:38:51.526451 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-967574db-daa7-4023-8bcd-458629f99efa tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:38:51.527282 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-967574db-daa7-4023-8bcd-458629f99efa tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] [instance: 62a16d76-4309-472d-9c9e-6e86b36a653c] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:38:51.535986 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-967574db-daa7-4023-8bcd-458629f99efa tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:51.536761 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-967574db-daa7-4023-8bcd-458629f99efa tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:51.537617 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-967574db-daa7-4023-8bcd-458629f99efa tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:51.538118 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-967574db-daa7-4023-8bcd-458629f99efa tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:51.588857 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-881ddf18-e3b3-47b6-a77e-482d0d35f55b tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:38:51.590030 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-881ddf18-e3b3-47b6-a77e-482d0d35f55b tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: d62b250c-c52b-4bd8-b6e0-b46ada9eee6f] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:38:51.598700 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-881ddf18-e3b3-47b6-a77e-482d0d35f55b tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:51.599233 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-881ddf18-e3b3-47b6-a77e-482d0d35f55b tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:51.600069 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-881ddf18-e3b3-47b6-a77e-482d0d35f55b tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:51.600602 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-881ddf18-e3b3-47b6-a77e-482d0d35f55b tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:51.743046 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-881ddf18-e3b3-47b6-a77e-482d0d35f55b tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "POST /compute/v2.1/servers/d62b250c-c52b-4bd8-b6e0-b46ada9eee6f/action" status: 200 len: 28242 microversion: 2.1 time: 0.158514 Feb 17 04:38:51.747327 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 691/1300] 10.222.0.78 () {60 vars in 1268 bytes} [Wed Feb 17 04:38:51 2021] POST /compute/v2.1/servers/d62b250c-c52b-4bd8-b6e0-b46ada9eee6f/action => generated 28242 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 17 04:38:51.807319 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-967574db-daa7-4023-8bcd-458629f99efa tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb8b6c44468c498f9dc0d3a8776433d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79050d22ac3d4c7eb85cd6a19be9ef10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:38:51.817139 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-967574db-daa7-4023-8bcd-458629f99efa tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] 10.222.0.78 "GET /compute/v2.1/servers/62a16d76-4309-472d-9c9e-6e86b36a653c" status: 200 len: 1572 microversion: 2.1 time: 0.295173 Feb 17 04:38:51.817745 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 610/1301] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:38:51 2021] GET /compute/v2.1/servers/62a16d76-4309-472d-9c9e-6e86b36a653c => generated 1572 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:38:52.756839 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-412d3a46-256d-4e1a-84e2-0423a6d65a25 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:38:52.757986 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-412d3a46-256d-4e1a-84e2-0423a6d65a25 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: d62b250c-c52b-4bd8-b6e0-b46ada9eee6f] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:38:52.766680 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-412d3a46-256d-4e1a-84e2-0423a6d65a25 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:52.767830 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-412d3a46-256d-4e1a-84e2-0423a6d65a25 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:52.768677 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-412d3a46-256d-4e1a-84e2-0423a6d65a25 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:52.769179 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-412d3a46-256d-4e1a-84e2-0423a6d65a25 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:52.836781 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-7465096a-28e2-4993-bcd5-89fe21b5c746 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:38:52.837582 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-7465096a-28e2-4993-bcd5-89fe21b5c746 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] [instance: 62a16d76-4309-472d-9c9e-6e86b36a653c] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:38:52.846158 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-7465096a-28e2-4993-bcd5-89fe21b5c746 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:52.846657 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-7465096a-28e2-4993-bcd5-89fe21b5c746 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:52.847519 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-7465096a-28e2-4993-bcd5-89fe21b5c746 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:52.848014 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-7465096a-28e2-4993-bcd5-89fe21b5c746 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:52.911573 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-412d3a46-256d-4e1a-84e2-0423a6d65a25 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "POST /compute/v2.1/servers/d62b250c-c52b-4bd8-b6e0-b46ada9eee6f/action" status: 200 len: 28242 microversion: 2.1 time: 0.158951 Feb 17 04:38:52.912308 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 692/1302] 10.222.0.78 () {60 vars in 1268 bytes} [Wed Feb 17 04:38:52 2021] POST /compute/v2.1/servers/d62b250c-c52b-4bd8-b6e0-b46ada9eee6f/action => generated 28242 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 04:38:53.060445 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-7465096a-28e2-4993-bcd5-89fe21b5c746 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb8b6c44468c498f9dc0d3a8776433d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79050d22ac3d4c7eb85cd6a19be9ef10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:38:53.070216 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-7465096a-28e2-4993-bcd5-89fe21b5c746 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] 10.222.0.78 "GET /compute/v2.1/servers/62a16d76-4309-472d-9c9e-6e86b36a653c" status: 200 len: 1572 microversion: 2.1 time: 0.237512 Feb 17 04:38:53.070819 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 611/1303] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:38:52 2021] GET /compute/v2.1/servers/62a16d76-4309-472d-9c9e-6e86b36a653c => generated 1572 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:38:53.925406 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-ca1ef690-3ae4-4276-a71f-d3757a0b17c8 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:38:53.926517 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-ca1ef690-3ae4-4276-a71f-d3757a0b17c8 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: d62b250c-c52b-4bd8-b6e0-b46ada9eee6f] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:38:53.935215 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-ca1ef690-3ae4-4276-a71f-d3757a0b17c8 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:53.935735 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-ca1ef690-3ae4-4276-a71f-d3757a0b17c8 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:53.936580 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-ca1ef690-3ae4-4276-a71f-d3757a0b17c8 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:53.937076 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-ca1ef690-3ae4-4276-a71f-d3757a0b17c8 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:54.076008 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-ca1ef690-3ae4-4276-a71f-d3757a0b17c8 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "POST /compute/v2.1/servers/d62b250c-c52b-4bd8-b6e0-b46ada9eee6f/action" status: 200 len: 28242 microversion: 2.1 time: 0.155233 Feb 17 04:38:54.077026 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 693/1304] 10.222.0.78 () {60 vars in 1268 bytes} [Wed Feb 17 04:38:53 2021] POST /compute/v2.1/servers/d62b250c-c52b-4bd8-b6e0-b46ada9eee6f/action => generated 28242 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 04:38:54.088714 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-6b50d57c-de33-4843-99e5-d1443fb58dc9 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:38:54.089415 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-6b50d57c-de33-4843-99e5-d1443fb58dc9 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] [instance: 62a16d76-4309-472d-9c9e-6e86b36a653c] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:38:54.098071 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-6b50d57c-de33-4843-99e5-d1443fb58dc9 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:54.098566 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-6b50d57c-de33-4843-99e5-d1443fb58dc9 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:54.099484 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-6b50d57c-de33-4843-99e5-d1443fb58dc9 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:54.099971 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-6b50d57c-de33-4843-99e5-d1443fb58dc9 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:54.313289 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-6b50d57c-de33-4843-99e5-d1443fb58dc9 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb8b6c44468c498f9dc0d3a8776433d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79050d22ac3d4c7eb85cd6a19be9ef10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:38:54.323206 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-6b50d57c-de33-4843-99e5-d1443fb58dc9 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] 10.222.0.78 "GET /compute/v2.1/servers/62a16d76-4309-472d-9c9e-6e86b36a653c" status: 200 len: 1572 microversion: 2.1 time: 0.238398 Feb 17 04:38:54.323817 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 612/1305] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:38:54 2021] GET /compute/v2.1/servers/62a16d76-4309-472d-9c9e-6e86b36a653c => generated 1572 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:38:55.089868 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-de6c76cb-f9ca-4bdc-b6bd-0d8314ce8fbb tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:38:55.091017 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-de6c76cb-f9ca-4bdc-b6bd-0d8314ce8fbb tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: d62b250c-c52b-4bd8-b6e0-b46ada9eee6f] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:38:55.100264 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-de6c76cb-f9ca-4bdc-b6bd-0d8314ce8fbb tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:55.100772 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-de6c76cb-f9ca-4bdc-b6bd-0d8314ce8fbb tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:55.101625 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-de6c76cb-f9ca-4bdc-b6bd-0d8314ce8fbb tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:55.102126 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-de6c76cb-f9ca-4bdc-b6bd-0d8314ce8fbb tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:55.234867 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-de6c76cb-f9ca-4bdc-b6bd-0d8314ce8fbb tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "POST /compute/v2.1/servers/d62b250c-c52b-4bd8-b6e0-b46ada9eee6f/action" status: 200 len: 28242 microversion: 2.1 time: 0.149305 Feb 17 04:38:55.236344 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 694/1306] 10.222.0.78 () {60 vars in 1268 bytes} [Wed Feb 17 04:38:55 2021] POST /compute/v2.1/servers/d62b250c-c52b-4bd8-b6e0-b46ada9eee6f/action => generated 28242 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 04:38:55.341641 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-afa91c62-69c7-44dc-a1da-384d5d756202 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:38:55.342299 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-afa91c62-69c7-44dc-a1da-384d5d756202 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] [instance: 62a16d76-4309-472d-9c9e-6e86b36a653c] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:38:55.351300 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-afa91c62-69c7-44dc-a1da-384d5d756202 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:55.351813 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-afa91c62-69c7-44dc-a1da-384d5d756202 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:55.352665 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-afa91c62-69c7-44dc-a1da-384d5d756202 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:55.353151 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-afa91c62-69c7-44dc-a1da-384d5d756202 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:55.561575 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-afa91c62-69c7-44dc-a1da-384d5d756202 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb8b6c44468c498f9dc0d3a8776433d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79050d22ac3d4c7eb85cd6a19be9ef10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:38:55.571070 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-afa91c62-69c7-44dc-a1da-384d5d756202 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] 10.222.0.78 "GET /compute/v2.1/servers/62a16d76-4309-472d-9c9e-6e86b36a653c" status: 200 len: 1572 microversion: 2.1 time: 0.233423 Feb 17 04:38:55.571676 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 613/1307] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:38:55 2021] GET /compute/v2.1/servers/62a16d76-4309-472d-9c9e-6e86b36a653c => generated 1572 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:38:56.248915 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-d32f12c6-d18f-4b75-a0fc-1edc1ca3f5a1 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:38:56.250045 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-d32f12c6-d18f-4b75-a0fc-1edc1ca3f5a1 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: d62b250c-c52b-4bd8-b6e0-b46ada9eee6f] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:38:56.259325 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-d32f12c6-d18f-4b75-a0fc-1edc1ca3f5a1 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:56.259836 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-d32f12c6-d18f-4b75-a0fc-1edc1ca3f5a1 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:56.260671 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-d32f12c6-d18f-4b75-a0fc-1edc1ca3f5a1 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:56.261166 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-d32f12c6-d18f-4b75-a0fc-1edc1ca3f5a1 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:56.382588 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-d32f12c6-d18f-4b75-a0fc-1edc1ca3f5a1 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "POST /compute/v2.1/servers/d62b250c-c52b-4bd8-b6e0-b46ada9eee6f/action" status: 200 len: 28242 microversion: 2.1 time: 0.137909 Feb 17 04:38:56.383334 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 695/1308] 10.222.0.78 () {60 vars in 1268 bytes} [Wed Feb 17 04:38:56 2021] POST /compute/v2.1/servers/d62b250c-c52b-4bd8-b6e0-b46ada9eee6f/action => generated 28242 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 04:38:56.589612 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-2c8abbcc-c19c-47e3-a8c4-3df80b222a1e tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:38:56.590367 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-2c8abbcc-c19c-47e3-a8c4-3df80b222a1e tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] [instance: 62a16d76-4309-472d-9c9e-6e86b36a653c] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:38:56.598435 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-2c8abbcc-c19c-47e3-a8c4-3df80b222a1e tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:56.598935 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-2c8abbcc-c19c-47e3-a8c4-3df80b222a1e tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:56.599792 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-2c8abbcc-c19c-47e3-a8c4-3df80b222a1e tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:56.600281 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-2c8abbcc-c19c-47e3-a8c4-3df80b222a1e tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:56.817453 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-2c8abbcc-c19c-47e3-a8c4-3df80b222a1e tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb8b6c44468c498f9dc0d3a8776433d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79050d22ac3d4c7eb85cd6a19be9ef10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:38:56.826416 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-2c8abbcc-c19c-47e3-a8c4-3df80b222a1e tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] 10.222.0.78 "GET /compute/v2.1/servers/62a16d76-4309-472d-9c9e-6e86b36a653c" status: 200 len: 1572 microversion: 2.1 time: 0.240852 Feb 17 04:38:56.827014 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 614/1309] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:38:56 2021] GET /compute/v2.1/servers/62a16d76-4309-472d-9c9e-6e86b36a653c => generated 1572 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:38:57.396148 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-bf525b02-115d-46d8-b9da-cf9a8094a549 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:38:57.397202 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-bf525b02-115d-46d8-b9da-cf9a8094a549 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: d62b250c-c52b-4bd8-b6e0-b46ada9eee6f] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:38:57.405819 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-bf525b02-115d-46d8-b9da-cf9a8094a549 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:57.406329 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-bf525b02-115d-46d8-b9da-cf9a8094a549 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:57.407194 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-bf525b02-115d-46d8-b9da-cf9a8094a549 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:57.408353 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-bf525b02-115d-46d8-b9da-cf9a8094a549 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:57.554261 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-bf525b02-115d-46d8-b9da-cf9a8094a549 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "POST /compute/v2.1/servers/d62b250c-c52b-4bd8-b6e0-b46ada9eee6f/action" status: 200 len: 28242 microversion: 2.1 time: 0.162714 Feb 17 04:38:57.555269 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 696/1310] 10.222.0.78 () {60 vars in 1268 bytes} [Wed Feb 17 04:38:57 2021] POST /compute/v2.1/servers/d62b250c-c52b-4bd8-b6e0-b46ada9eee6f/action => generated 28242 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 04:38:57.845769 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-ca03dcb6-3623-4093-80e0-0c96e41141de tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:38:57.846449 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-ca03dcb6-3623-4093-80e0-0c96e41141de tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] [instance: 62a16d76-4309-472d-9c9e-6e86b36a653c] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:38:57.854400 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-ca03dcb6-3623-4093-80e0-0c96e41141de tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:57.854890 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-ca03dcb6-3623-4093-80e0-0c96e41141de tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:57.855763 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-ca03dcb6-3623-4093-80e0-0c96e41141de tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:57.856264 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-ca03dcb6-3623-4093-80e0-0c96e41141de tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:58.293646 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-ca03dcb6-3623-4093-80e0-0c96e41141de tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb8b6c44468c498f9dc0d3a8776433d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79050d22ac3d4c7eb85cd6a19be9ef10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:38:58.303231 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-ca03dcb6-3623-4093-80e0-0c96e41141de tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] 10.222.0.78 "GET /compute/v2.1/servers/62a16d76-4309-472d-9c9e-6e86b36a653c" status: 200 len: 1572 microversion: 2.1 time: 0.462114 Feb 17 04:38:58.303835 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 615/1311] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:38:57 2021] GET /compute/v2.1/servers/62a16d76-4309-472d-9c9e-6e86b36a653c => generated 1572 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:38:58.568235 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-93b5f322-4ddf-4c28-93f4-911c05316b3a tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:38:58.569361 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-93b5f322-4ddf-4c28-93f4-911c05316b3a tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: d62b250c-c52b-4bd8-b6e0-b46ada9eee6f] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:38:58.578152 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-93b5f322-4ddf-4c28-93f4-911c05316b3a tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:58.578657 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-93b5f322-4ddf-4c28-93f4-911c05316b3a tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:58.579656 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-93b5f322-4ddf-4c28-93f4-911c05316b3a tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:58.580159 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-93b5f322-4ddf-4c28-93f4-911c05316b3a tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:58.722731 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-93b5f322-4ddf-4c28-93f4-911c05316b3a tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "POST /compute/v2.1/servers/d62b250c-c52b-4bd8-b6e0-b46ada9eee6f/action" status: 200 len: 28242 microversion: 2.1 time: 0.159595 Feb 17 04:38:58.723458 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 697/1312] 10.222.0.78 () {60 vars in 1268 bytes} [Wed Feb 17 04:38:58 2021] POST /compute/v2.1/servers/d62b250c-c52b-4bd8-b6e0-b46ada9eee6f/action => generated 28242 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 04:38:59.322539 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-4a2e02e4-5b54-42db-afbe-0780ecfba077 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:38:59.323328 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-4a2e02e4-5b54-42db-afbe-0780ecfba077 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] [instance: 62a16d76-4309-472d-9c9e-6e86b36a653c] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:38:59.331979 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-4a2e02e4-5b54-42db-afbe-0780ecfba077 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:59.332496 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-4a2e02e4-5b54-42db-afbe-0780ecfba077 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:59.333393 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-4a2e02e4-5b54-42db-afbe-0780ecfba077 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:59.333844 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-4a2e02e4-5b54-42db-afbe-0780ecfba077 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:59.549817 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-4a2e02e4-5b54-42db-afbe-0780ecfba077 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb8b6c44468c498f9dc0d3a8776433d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79050d22ac3d4c7eb85cd6a19be9ef10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:38:59.558744 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-4a2e02e4-5b54-42db-afbe-0780ecfba077 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] 10.222.0.78 "GET /compute/v2.1/servers/62a16d76-4309-472d-9c9e-6e86b36a653c" status: 200 len: 1572 microversion: 2.1 time: 0.240339 Feb 17 04:38:59.559410 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 616/1313] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:38:59 2021] GET /compute/v2.1/servers/62a16d76-4309-472d-9c9e-6e86b36a653c => generated 1572 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:38:59.736360 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-e7ccce35-d23f-4ead-adae-c16fc6a0e646 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:38:59.737557 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-e7ccce35-d23f-4ead-adae-c16fc6a0e646 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: d62b250c-c52b-4bd8-b6e0-b46ada9eee6f] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:38:59.746088 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-e7ccce35-d23f-4ead-adae-c16fc6a0e646 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:59.746595 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-e7ccce35-d23f-4ead-adae-c16fc6a0e646 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:59.747450 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-e7ccce35-d23f-4ead-adae-c16fc6a0e646 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:59.747941 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-e7ccce35-d23f-4ead-adae-c16fc6a0e646 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:59.901832 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-e7ccce35-d23f-4ead-adae-c16fc6a0e646 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "POST /compute/v2.1/servers/d62b250c-c52b-4bd8-b6e0-b46ada9eee6f/action" status: 200 len: 28242 microversion: 2.1 time: 0.170788 Feb 17 04:38:59.902643 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 698/1314] 10.222.0.78 () {60 vars in 1268 bytes} [Wed Feb 17 04:38:59 2021] POST /compute/v2.1/servers/d62b250c-c52b-4bd8-b6e0-b46ada9eee6f/action => generated 28242 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 04:39:00.577991 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-bf89bf1f-8391-49f0-bf96-cc9645ea6f7b tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:39:00.578662 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-bf89bf1f-8391-49f0-bf96-cc9645ea6f7b tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] [instance: 62a16d76-4309-472d-9c9e-6e86b36a653c] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:00.586715 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-bf89bf1f-8391-49f0-bf96-cc9645ea6f7b tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:00.587261 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-bf89bf1f-8391-49f0-bf96-cc9645ea6f7b tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:00.588091 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-bf89bf1f-8391-49f0-bf96-cc9645ea6f7b tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:00.588579 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-bf89bf1f-8391-49f0-bf96-cc9645ea6f7b tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:00.803361 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-bf89bf1f-8391-49f0-bf96-cc9645ea6f7b tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb8b6c44468c498f9dc0d3a8776433d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79050d22ac3d4c7eb85cd6a19be9ef10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:00.812214 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-bf89bf1f-8391-49f0-bf96-cc9645ea6f7b tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] 10.222.0.78 "GET /compute/v2.1/servers/62a16d76-4309-472d-9c9e-6e86b36a653c" status: 200 len: 1572 microversion: 2.1 time: 0.238288 Feb 17 04:39:00.812810 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 617/1315] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:39:00 2021] GET /compute/v2.1/servers/62a16d76-4309-472d-9c9e-6e86b36a653c => generated 1572 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:39:00.915882 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-160f462d-c853-40db-9ece-009eb00741a3 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:39:00.916993 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-160f462d-c853-40db-9ece-009eb00741a3 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: d62b250c-c52b-4bd8-b6e0-b46ada9eee6f] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:00.926763 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-160f462d-c853-40db-9ece-009eb00741a3 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:00.927305 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-160f462d-c853-40db-9ece-009eb00741a3 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:00.928145 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-160f462d-c853-40db-9ece-009eb00741a3 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:00.928644 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-160f462d-c853-40db-9ece-009eb00741a3 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:01.084534 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-160f462d-c853-40db-9ece-009eb00741a3 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "POST /compute/v2.1/servers/d62b250c-c52b-4bd8-b6e0-b46ada9eee6f/action" status: 200 len: 28242 microversion: 2.1 time: 0.172950 Feb 17 04:39:01.085221 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 699/1316] 10.222.0.78 () {60 vars in 1268 bytes} [Wed Feb 17 04:39:00 2021] POST /compute/v2.1/servers/d62b250c-c52b-4bd8-b6e0-b46ada9eee6f/action => generated 28242 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 04:39:01.830521 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-82e171e9-8fa7-4730-b20f-f84ff985af83 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:39:01.831255 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-82e171e9-8fa7-4730-b20f-f84ff985af83 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] [instance: 62a16d76-4309-472d-9c9e-6e86b36a653c] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:01.839154 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-82e171e9-8fa7-4730-b20f-f84ff985af83 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:01.839671 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-82e171e9-8fa7-4730-b20f-f84ff985af83 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:01.840519 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-82e171e9-8fa7-4730-b20f-f84ff985af83 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:01.841018 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-82e171e9-8fa7-4730-b20f-f84ff985af83 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:02.098207 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-0e1c4670-7b86-4ae1-802c-1a9129c28417 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:39:02.099491 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-0e1c4670-7b86-4ae1-802c-1a9129c28417 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: d62b250c-c52b-4bd8-b6e0-b46ada9eee6f] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:02.108354 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-0e1c4670-7b86-4ae1-802c-1a9129c28417 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:02.108859 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-0e1c4670-7b86-4ae1-802c-1a9129c28417 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:02.109691 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-0e1c4670-7b86-4ae1-802c-1a9129c28417 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:02.110179 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-0e1c4670-7b86-4ae1-802c-1a9129c28417 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:02.226027 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-82e171e9-8fa7-4730-b20f-f84ff985af83 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb8b6c44468c498f9dc0d3a8776433d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79050d22ac3d4c7eb85cd6a19be9ef10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:02.235447 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-82e171e9-8fa7-4730-b20f-f84ff985af83 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] 10.222.0.78 "GET /compute/v2.1/servers/62a16d76-4309-472d-9c9e-6e86b36a653c" status: 200 len: 1572 microversion: 2.1 time: 0.409113 Feb 17 04:39:02.236806 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 618/1317] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:39:01 2021] GET /compute/v2.1/servers/62a16d76-4309-472d-9c9e-6e86b36a653c => generated 1572 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:39:02.246304 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-0e1c4670-7b86-4ae1-802c-1a9129c28417 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "POST /compute/v2.1/servers/d62b250c-c52b-4bd8-b6e0-b46ada9eee6f/action" status: 200 len: 28242 microversion: 2.1 time: 0.152913 Feb 17 04:39:02.252943 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 700/1318] 10.222.0.78 () {60 vars in 1268 bytes} [Wed Feb 17 04:39:02 2021] POST /compute/v2.1/servers/d62b250c-c52b-4bd8-b6e0-b46ada9eee6f/action => generated 28242 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 17 04:39:03.255282 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-3671e2d9-a838-4b06-95ea-fd442532d118 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:39:03.255966 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-3671e2d9-a838-4b06-95ea-fd442532d118 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] [instance: 62a16d76-4309-472d-9c9e-6e86b36a653c] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:03.259736 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-cebd6b84-ea5f-491c-8892-8b6fbfd5e091 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:39:03.260866 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-cebd6b84-ea5f-491c-8892-8b6fbfd5e091 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: d62b250c-c52b-4bd8-b6e0-b46ada9eee6f] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:03.263951 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-3671e2d9-a838-4b06-95ea-fd442532d118 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:03.264469 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-3671e2d9-a838-4b06-95ea-fd442532d118 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:03.265322 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-3671e2d9-a838-4b06-95ea-fd442532d118 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:03.265830 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-3671e2d9-a838-4b06-95ea-fd442532d118 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:03.270188 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-cebd6b84-ea5f-491c-8892-8b6fbfd5e091 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:03.270693 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-cebd6b84-ea5f-491c-8892-8b6fbfd5e091 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:03.271551 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-cebd6b84-ea5f-491c-8892-8b6fbfd5e091 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:03.272040 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-cebd6b84-ea5f-491c-8892-8b6fbfd5e091 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:03.462430 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-cebd6b84-ea5f-491c-8892-8b6fbfd5e091 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "POST /compute/v2.1/servers/d62b250c-c52b-4bd8-b6e0-b46ada9eee6f/action" status: 200 len: 28242 microversion: 2.1 time: 0.206988 Feb 17 04:39:03.466700 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 701/1319] 10.222.0.78 () {60 vars in 1268 bytes} [Wed Feb 17 04:39:03 2021] POST /compute/v2.1/servers/d62b250c-c52b-4bd8-b6e0-b46ada9eee6f/action => generated 28242 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 04:39:03.477401 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-3671e2d9-a838-4b06-95ea-fd442532d118 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb8b6c44468c498f9dc0d3a8776433d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79050d22ac3d4c7eb85cd6a19be9ef10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:03.487088 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-3671e2d9-a838-4b06-95ea-fd442532d118 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] 10.222.0.78 "GET /compute/v2.1/servers/62a16d76-4309-472d-9c9e-6e86b36a653c" status: 200 len: 1572 microversion: 2.1 time: 0.236577 Feb 17 04:39:03.487654 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 619/1320] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:39:03 2021] GET /compute/v2.1/servers/62a16d76-4309-472d-9c9e-6e86b36a653c => generated 1572 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:39:04.475883 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-e7738ee3-face-45b3-abfb-4300e565196c tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:39:04.477085 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-e7738ee3-face-45b3-abfb-4300e565196c tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: d62b250c-c52b-4bd8-b6e0-b46ada9eee6f] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:04.486036 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-e7738ee3-face-45b3-abfb-4300e565196c tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:04.486566 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-e7738ee3-face-45b3-abfb-4300e565196c tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:04.487441 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-e7738ee3-face-45b3-abfb-4300e565196c tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:04.487941 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-e7738ee3-face-45b3-abfb-4300e565196c tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:04.505265 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-e28ba920-cef1-4f01-bcda-2b83d54e75ed tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:39:04.505934 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-e28ba920-cef1-4f01-bcda-2b83d54e75ed tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] [instance: 62a16d76-4309-472d-9c9e-6e86b36a653c] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:04.513759 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-e28ba920-cef1-4f01-bcda-2b83d54e75ed tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:04.514261 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-e28ba920-cef1-4f01-bcda-2b83d54e75ed tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:04.515138 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-e28ba920-cef1-4f01-bcda-2b83d54e75ed tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:04.515632 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-e28ba920-cef1-4f01-bcda-2b83d54e75ed tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:04.671490 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-e7738ee3-face-45b3-abfb-4300e565196c tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "POST /compute/v2.1/servers/d62b250c-c52b-4bd8-b6e0-b46ada9eee6f/action" status: 200 len: 28242 microversion: 2.1 time: 0.200620 Feb 17 04:39:04.672449 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 702/1321] 10.222.0.78 () {60 vars in 1268 bytes} [Wed Feb 17 04:39:04 2021] POST /compute/v2.1/servers/d62b250c-c52b-4bd8-b6e0-b46ada9eee6f/action => generated 28242 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 04:39:04.729474 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-e28ba920-cef1-4f01-bcda-2b83d54e75ed tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb8b6c44468c498f9dc0d3a8776433d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79050d22ac3d4c7eb85cd6a19be9ef10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:04.739226 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-e28ba920-cef1-4f01-bcda-2b83d54e75ed tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] 10.222.0.78 "GET /compute/v2.1/servers/62a16d76-4309-472d-9c9e-6e86b36a653c" status: 200 len: 1572 microversion: 2.1 time: 0.237994 Feb 17 04:39:04.739858 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 620/1322] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:39:04 2021] GET /compute/v2.1/servers/62a16d76-4309-472d-9c9e-6e86b36a653c => generated 1572 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:39:05.684310 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-e03a53d5-f3d7-40e0-a673-b202b56f70c4 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:39:05.685435 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-e03a53d5-f3d7-40e0-a673-b202b56f70c4 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: d62b250c-c52b-4bd8-b6e0-b46ada9eee6f] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:05.694070 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-e03a53d5-f3d7-40e0-a673-b202b56f70c4 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:05.694725 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-e03a53d5-f3d7-40e0-a673-b202b56f70c4 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:05.695398 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-e03a53d5-f3d7-40e0-a673-b202b56f70c4 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:05.695889 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-e03a53d5-f3d7-40e0-a673-b202b56f70c4 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:05.758513 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-9ebc19cf-c12d-44a4-b783-7b036ac7fe4b tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:39:05.759269 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-9ebc19cf-c12d-44a4-b783-7b036ac7fe4b tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] [instance: 62a16d76-4309-472d-9c9e-6e86b36a653c] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:05.768082 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-9ebc19cf-c12d-44a4-b783-7b036ac7fe4b tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:05.768588 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-9ebc19cf-c12d-44a4-b783-7b036ac7fe4b tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:05.769450 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-9ebc19cf-c12d-44a4-b783-7b036ac7fe4b tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:05.769952 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-9ebc19cf-c12d-44a4-b783-7b036ac7fe4b tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:05.869032 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-e03a53d5-f3d7-40e0-a673-b202b56f70c4 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "POST /compute/v2.1/servers/d62b250c-c52b-4bd8-b6e0-b46ada9eee6f/action" status: 200 len: 28532 microversion: 2.1 time: 0.188986 Feb 17 04:39:05.869915 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 703/1323] 10.222.0.78 () {60 vars in 1268 bytes} [Wed Feb 17 04:39:05 2021] POST /compute/v2.1/servers/d62b250c-c52b-4bd8-b6e0-b46ada9eee6f/action => generated 28532 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 04:39:05.989873 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-9ebc19cf-c12d-44a4-b783-7b036ac7fe4b tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb8b6c44468c498f9dc0d3a8776433d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79050d22ac3d4c7eb85cd6a19be9ef10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:05.998843 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-9ebc19cf-c12d-44a4-b783-7b036ac7fe4b tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] 10.222.0.78 "GET /compute/v2.1/servers/62a16d76-4309-472d-9c9e-6e86b36a653c" status: 200 len: 1572 microversion: 2.1 time: 0.244938 Feb 17 04:39:05.999479 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 621/1324] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:39:05 2021] GET /compute/v2.1/servers/62a16d76-4309-472d-9c9e-6e86b36a653c => generated 1572 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:39:06.309406 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [req-3cdf9914-a0a0-4d71-9aad-aebe4ec176d4 req-6850d240-03b2-4149-974f-f4af5bf0ab4d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62a16d76-4309-472d-9c9e-6e86b36a653c", "name": "network-vif-unplugged", "status": "completed", "tag": "5ba59ff1-b19b-4ba6-9ef2-07dccd6b3a55"}]} {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:39:06.311480 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:39:06.311480 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: warnings.warn(msg) Feb 17 04:39:06.322197 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [req-3cdf9914-a0a0-4d71-9aad-aebe4ec176d4 req-6850d240-03b2-4149-974f-f4af5bf0ab4d service nova] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:06.322701 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [req-3cdf9914-a0a0-4d71-9aad-aebe4ec176d4 req-6850d240-03b2-4149-974f-f4af5bf0ab4d service nova] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:06.340170 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.compute.server_external_events [req-3cdf9914-a0a0-4d71-9aad-aebe4ec176d4 req-6850d240-03b2-4149-974f-f4af5bf0ab4d service nova] Creating event network-vif-unplugged:5ba59ff1-b19b-4ba6-9ef2-07dccd6b3a55 for instance 62a16d76-4309-472d-9c9e-6e86b36a653c on hv-cinder-75998 Feb 17 04:39:06.345800 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [req-3cdf9914-a0a0-4d71-9aad-aebe4ec176d4 req-6850d240-03b2-4149-974f-f4af5bf0ab4d service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.042507 Feb 17 04:39:06.346846 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 704/1325] 10.222.0.78 () {64 vars in 1308 bytes} [Wed Feb 17 04:39:06 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:39:06.881985 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-f6992a0e-a862-459f-bf26-fb151b56f11b tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:39:06.883066 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-f6992a0e-a862-459f-bf26-fb151b56f11b tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: d62b250c-c52b-4bd8-b6e0-b46ada9eee6f] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:06.891087 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-f6992a0e-a862-459f-bf26-fb151b56f11b tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:06.891608 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-f6992a0e-a862-459f-bf26-fb151b56f11b tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:06.892462 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-f6992a0e-a862-459f-bf26-fb151b56f11b tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:06.892959 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-f6992a0e-a862-459f-bf26-fb151b56f11b tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:07.019589 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-48aba6e5-d592-43af-b85f-49f2d0298812 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:39:07.020372 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-48aba6e5-d592-43af-b85f-49f2d0298812 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] [instance: 62a16d76-4309-472d-9c9e-6e86b36a653c] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:07.028623 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-48aba6e5-d592-43af-b85f-49f2d0298812 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:07.029149 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-48aba6e5-d592-43af-b85f-49f2d0298812 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:07.029997 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-48aba6e5-d592-43af-b85f-49f2d0298812 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:07.030493 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-48aba6e5-d592-43af-b85f-49f2d0298812 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:07.034032 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-f6992a0e-a862-459f-bf26-fb151b56f11b tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "POST /compute/v2.1/servers/d62b250c-c52b-4bd8-b6e0-b46ada9eee6f/action" status: 200 len: 28672 microversion: 2.1 time: 0.155852 Feb 17 04:39:07.038214 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 622/1326] 10.222.0.78 () {60 vars in 1268 bytes} [Wed Feb 17 04:39:06 2021] POST /compute/v2.1/servers/d62b250c-c52b-4bd8-b6e0-b46ada9eee6f/action => generated 28672 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 04:39:07.246217 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-48aba6e5-d592-43af-b85f-49f2d0298812 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb8b6c44468c498f9dc0d3a8776433d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79050d22ac3d4c7eb85cd6a19be9ef10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:07.255825 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-48aba6e5-d592-43af-b85f-49f2d0298812 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] 10.222.0.78 "GET /compute/v2.1/servers/62a16d76-4309-472d-9c9e-6e86b36a653c" status: 200 len: 1513 microversion: 2.1 time: 0.241099 Feb 17 04:39:07.256434 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 705/1327] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:39:07 2021] GET /compute/v2.1/servers/62a16d76-4309-472d-9c9e-6e86b36a653c => generated 1513 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:39:07.274220 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-87780ac8-1ab4-47e3-b50b-99820871d3d7 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:39:07.274950 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-87780ac8-1ab4-47e3-b50b-99820871d3d7 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] [instance: 62a16d76-4309-472d-9c9e-6e86b36a653c] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:07.283554 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-87780ac8-1ab4-47e3-b50b-99820871d3d7 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:07.284055 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-87780ac8-1ab4-47e3-b50b-99820871d3d7 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:07.284887 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-87780ac8-1ab4-47e3-b50b-99820871d3d7 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:07.285386 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-87780ac8-1ab4-47e3-b50b-99820871d3d7 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:07.436601 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-87780ac8-1ab4-47e3-b50b-99820871d3d7 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] 10.222.0.78 "POST /compute/v2.1/servers/62a16d76-4309-472d-9c9e-6e86b36a653c/action" status: 202 len: 0 microversion: 2.1 time: 0.166666 Feb 17 04:39:07.437237 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 623/1328] 10.222.0.78 () {60 vars in 1268 bytes} [Wed Feb 17 04:39:07 2021] POST /compute/v2.1/servers/62a16d76-4309-472d-9c9e-6e86b36a653c/action => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:39:07.446256 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-b997a262-7712-4697-a149-352f38ea7870 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:39:07.446937 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-b997a262-7712-4697-a149-352f38ea7870 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] [instance: 62a16d76-4309-472d-9c9e-6e86b36a653c] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:07.455234 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-b997a262-7712-4697-a149-352f38ea7870 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:07.455749 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-b997a262-7712-4697-a149-352f38ea7870 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:07.456603 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-b997a262-7712-4697-a149-352f38ea7870 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:07.457098 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-b997a262-7712-4697-a149-352f38ea7870 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:07.674137 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-b997a262-7712-4697-a149-352f38ea7870 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb8b6c44468c498f9dc0d3a8776433d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79050d22ac3d4c7eb85cd6a19be9ef10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:07.683348 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-b997a262-7712-4697-a149-352f38ea7870 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] 10.222.0.78 "GET /compute/v2.1/servers/62a16d76-4309-472d-9c9e-6e86b36a653c" status: 200 len: 1521 microversion: 2.1 time: 0.240983 Feb 17 04:39:07.684123 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 706/1329] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:39:07 2021] GET /compute/v2.1/servers/62a16d76-4309-472d-9c9e-6e86b36a653c => generated 1521 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:39:08.046135 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-f6ce5297-d713-4bdc-8e95-73470130aee8 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:39:08.047195 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-f6ce5297-d713-4bdc-8e95-73470130aee8 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: d62b250c-c52b-4bd8-b6e0-b46ada9eee6f] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:08.055199 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-f6ce5297-d713-4bdc-8e95-73470130aee8 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:08.055708 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-f6ce5297-d713-4bdc-8e95-73470130aee8 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:08.056544 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-f6ce5297-d713-4bdc-8e95-73470130aee8 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:08.057036 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-f6ce5297-d713-4bdc-8e95-73470130aee8 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:08.227649 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-f6ce5297-d713-4bdc-8e95-73470130aee8 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "POST /compute/v2.1/servers/d62b250c-c52b-4bd8-b6e0-b46ada9eee6f/action" status: 200 len: 28699 microversion: 2.1 time: 0.185201 Feb 17 04:39:08.231935 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 624/1330] 10.222.0.78 () {60 vars in 1268 bytes} [Wed Feb 17 04:39:08 2021] POST /compute/v2.1/servers/d62b250c-c52b-4bd8-b6e0-b46ada9eee6f/action => generated 28699 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 04:39:08.702449 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-29ff1ed4-c963-4d13-8765-11440d121aba tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:39:08.703174 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-29ff1ed4-c963-4d13-8765-11440d121aba tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] [instance: 62a16d76-4309-472d-9c9e-6e86b36a653c] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:08.711322 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-29ff1ed4-c963-4d13-8765-11440d121aba tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:08.711826 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-29ff1ed4-c963-4d13-8765-11440d121aba tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:08.712648 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-29ff1ed4-c963-4d13-8765-11440d121aba tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:08.713141 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-29ff1ed4-c963-4d13-8765-11440d121aba tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:08.930746 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-29ff1ed4-c963-4d13-8765-11440d121aba tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb8b6c44468c498f9dc0d3a8776433d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79050d22ac3d4c7eb85cd6a19be9ef10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:08.940514 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-29ff1ed4-c963-4d13-8765-11440d121aba tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] 10.222.0.78 "GET /compute/v2.1/servers/62a16d76-4309-472d-9c9e-6e86b36a653c" status: 200 len: 1523 microversion: 2.1 time: 0.242018 Feb 17 04:39:08.941127 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 707/1331] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:39:08 2021] GET /compute/v2.1/servers/62a16d76-4309-472d-9c9e-6e86b36a653c => generated 1523 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:39:09.241516 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-08a548f6-bb35-40c7-bb33-08b10432b7c6 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:39:09.242713 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-08a548f6-bb35-40c7-bb33-08b10432b7c6 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: d62b250c-c52b-4bd8-b6e0-b46ada9eee6f] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:09.251109 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-08a548f6-bb35-40c7-bb33-08b10432b7c6 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:09.251853 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-08a548f6-bb35-40c7-bb33-08b10432b7c6 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:09.252687 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-08a548f6-bb35-40c7-bb33-08b10432b7c6 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:09.253219 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-08a548f6-bb35-40c7-bb33-08b10432b7c6 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:09.382874 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-08a548f6-bb35-40c7-bb33-08b10432b7c6 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "POST /compute/v2.1/servers/d62b250c-c52b-4bd8-b6e0-b46ada9eee6f/action" status: 200 len: 28699 microversion: 2.1 time: 0.145566 Feb 17 04:39:09.383852 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 625/1332] 10.222.0.78 () {60 vars in 1268 bytes} [Wed Feb 17 04:39:09 2021] POST /compute/v2.1/servers/d62b250c-c52b-4bd8-b6e0-b46ada9eee6f/action => generated 28699 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 04:39:09.960319 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-32fdbb6a-dbee-472b-b11e-0973ecee8a11 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:39:09.961131 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-32fdbb6a-dbee-472b-b11e-0973ecee8a11 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] [instance: 62a16d76-4309-472d-9c9e-6e86b36a653c] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:09.969355 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-32fdbb6a-dbee-472b-b11e-0973ecee8a11 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:09.969904 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-32fdbb6a-dbee-472b-b11e-0973ecee8a11 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:09.971298 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-32fdbb6a-dbee-472b-b11e-0973ecee8a11 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:09.971787 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-32fdbb6a-dbee-472b-b11e-0973ecee8a11 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:10.206046 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-32fdbb6a-dbee-472b-b11e-0973ecee8a11 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb8b6c44468c498f9dc0d3a8776433d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79050d22ac3d4c7eb85cd6a19be9ef10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:10.216099 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-32fdbb6a-dbee-472b-b11e-0973ecee8a11 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] 10.222.0.78 "GET /compute/v2.1/servers/62a16d76-4309-472d-9c9e-6e86b36a653c" status: 200 len: 1523 microversion: 2.1 time: 0.259737 Feb 17 04:39:10.216723 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 708/1333] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:39:09 2021] GET /compute/v2.1/servers/62a16d76-4309-472d-9c9e-6e86b36a653c => generated 1523 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:39:10.397084 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-6e0f767f-59fb-45fb-809e-80fe8989a466 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:39:10.398190 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-6e0f767f-59fb-45fb-809e-80fe8989a466 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: d62b250c-c52b-4bd8-b6e0-b46ada9eee6f] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:10.406816 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-6e0f767f-59fb-45fb-809e-80fe8989a466 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:10.409659 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-6e0f767f-59fb-45fb-809e-80fe8989a466 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:10.409659 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-6e0f767f-59fb-45fb-809e-80fe8989a466 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:10.409902 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-6e0f767f-59fb-45fb-809e-80fe8989a466 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:10.582655 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-6e0f767f-59fb-45fb-809e-80fe8989a466 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "POST /compute/v2.1/servers/d62b250c-c52b-4bd8-b6e0-b46ada9eee6f/action" status: 200 len: 28699 microversion: 2.1 time: 0.190797 Feb 17 04:39:10.583593 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 626/1334] 10.222.0.78 () {60 vars in 1268 bytes} [Wed Feb 17 04:39:10 2021] POST /compute/v2.1/servers/d62b250c-c52b-4bd8-b6e0-b46ada9eee6f/action => generated 28699 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 04:39:11.236866 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-2545b401-a1b1-44c0-b941-eaa72d377551 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:39:11.237548 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-2545b401-a1b1-44c0-b941-eaa72d377551 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] [instance: 62a16d76-4309-472d-9c9e-6e86b36a653c] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:11.245527 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-2545b401-a1b1-44c0-b941-eaa72d377551 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:11.246042 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-2545b401-a1b1-44c0-b941-eaa72d377551 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:11.246878 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-2545b401-a1b1-44c0-b941-eaa72d377551 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:11.247397 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-2545b401-a1b1-44c0-b941-eaa72d377551 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:11.459605 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-2545b401-a1b1-44c0-b941-eaa72d377551 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb8b6c44468c498f9dc0d3a8776433d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79050d22ac3d4c7eb85cd6a19be9ef10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:11.468452 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-2545b401-a1b1-44c0-b941-eaa72d377551 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] 10.222.0.78 "GET /compute/v2.1/servers/62a16d76-4309-472d-9c9e-6e86b36a653c" status: 200 len: 1579 microversion: 2.1 time: 0.236935 Feb 17 04:39:11.469034 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 709/1335] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:39:11 2021] GET /compute/v2.1/servers/62a16d76-4309-472d-9c9e-6e86b36a653c => generated 1579 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:39:11.596381 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-7c7ba714-c292-485f-bf21-cf5a730568e6 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:39:11.597528 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-7c7ba714-c292-485f-bf21-cf5a730568e6 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: d62b250c-c52b-4bd8-b6e0-b46ada9eee6f] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:11.606135 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-7c7ba714-c292-485f-bf21-cf5a730568e6 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:11.606653 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-7c7ba714-c292-485f-bf21-cf5a730568e6 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:11.607535 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-7c7ba714-c292-485f-bf21-cf5a730568e6 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:11.608301 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-7c7ba714-c292-485f-bf21-cf5a730568e6 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:11.746283 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-7c7ba714-c292-485f-bf21-cf5a730568e6 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "POST /compute/v2.1/servers/d62b250c-c52b-4bd8-b6e0-b46ada9eee6f/action" status: 200 len: 28699 microversion: 2.1 time: 0.154972 Feb 17 04:39:11.747008 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 627/1336] 10.222.0.78 () {60 vars in 1268 bytes} [Wed Feb 17 04:39:11 2021] POST /compute/v2.1/servers/d62b250c-c52b-4bd8-b6e0-b46ada9eee6f/action => generated 28699 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 04:39:12.488054 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-ef9d9019-922f-4ffb-ac12-85373f31317c tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:39:12.490752 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-ef9d9019-922f-4ffb-ac12-85373f31317c tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] [instance: 62a16d76-4309-472d-9c9e-6e86b36a653c] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:12.500837 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-ef9d9019-922f-4ffb-ac12-85373f31317c tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:12.502013 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-ef9d9019-922f-4ffb-ac12-85373f31317c tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:12.502863 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-ef9d9019-922f-4ffb-ac12-85373f31317c tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:12.503387 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-ef9d9019-922f-4ffb-ac12-85373f31317c tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:12.715771 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-ef9d9019-922f-4ffb-ac12-85373f31317c tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb8b6c44468c498f9dc0d3a8776433d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79050d22ac3d4c7eb85cd6a19be9ef10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:12.724895 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-ef9d9019-922f-4ffb-ac12-85373f31317c tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] 10.222.0.78 "GET /compute/v2.1/servers/62a16d76-4309-472d-9c9e-6e86b36a653c" status: 200 len: 1579 microversion: 2.1 time: 0.242100 Feb 17 04:39:12.725504 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 710/1337] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:39:12 2021] GET /compute/v2.1/servers/62a16d76-4309-472d-9c9e-6e86b36a653c => generated 1579 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:39:12.759413 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-02c29f57-a9bb-4601-bf4d-d0a2414cc928 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:39:12.760492 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-02c29f57-a9bb-4601-bf4d-d0a2414cc928 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: d62b250c-c52b-4bd8-b6e0-b46ada9eee6f] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:12.769426 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-02c29f57-a9bb-4601-bf4d-d0a2414cc928 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:12.769940 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-02c29f57-a9bb-4601-bf4d-d0a2414cc928 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:12.770780 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-02c29f57-a9bb-4601-bf4d-d0a2414cc928 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:12.771306 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-02c29f57-a9bb-4601-bf4d-d0a2414cc928 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:12.900119 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-02c29f57-a9bb-4601-bf4d-d0a2414cc928 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "POST /compute/v2.1/servers/d62b250c-c52b-4bd8-b6e0-b46ada9eee6f/action" status: 200 len: 28699 microversion: 2.1 time: 0.145019 Feb 17 04:39:12.900827 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 628/1338] 10.222.0.78 () {60 vars in 1268 bytes} [Wed Feb 17 04:39:12 2021] POST /compute/v2.1/servers/d62b250c-c52b-4bd8-b6e0-b46ada9eee6f/action => generated 28699 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 04:39:13.744024 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-6fe55181-5622-43c3-bd75-96470b7bdcbe tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:39:13.744708 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-6fe55181-5622-43c3-bd75-96470b7bdcbe tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] [instance: 62a16d76-4309-472d-9c9e-6e86b36a653c] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:13.752788 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-6fe55181-5622-43c3-bd75-96470b7bdcbe tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:13.753295 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-6fe55181-5622-43c3-bd75-96470b7bdcbe tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:13.754138 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-6fe55181-5622-43c3-bd75-96470b7bdcbe tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:13.754636 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-6fe55181-5622-43c3-bd75-96470b7bdcbe tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:13.913484 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-bf53fd4b-64ab-42d1-afa1-83a95acc5205 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:39:13.914630 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-bf53fd4b-64ab-42d1-afa1-83a95acc5205 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: d62b250c-c52b-4bd8-b6e0-b46ada9eee6f] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:13.923369 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-bf53fd4b-64ab-42d1-afa1-83a95acc5205 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:13.923881 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-bf53fd4b-64ab-42d1-afa1-83a95acc5205 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:13.924724 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-bf53fd4b-64ab-42d1-afa1-83a95acc5205 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:13.925218 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-bf53fd4b-64ab-42d1-afa1-83a95acc5205 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:13.965733 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-6fe55181-5622-43c3-bd75-96470b7bdcbe tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb8b6c44468c498f9dc0d3a8776433d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79050d22ac3d4c7eb85cd6a19be9ef10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:13.976073 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-6fe55181-5622-43c3-bd75-96470b7bdcbe tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] 10.222.0.78 "GET /compute/v2.1/servers/62a16d76-4309-472d-9c9e-6e86b36a653c" status: 200 len: 1579 microversion: 2.1 time: 0.236033 Feb 17 04:39:13.976679 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 711/1339] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:39:13 2021] GET /compute/v2.1/servers/62a16d76-4309-472d-9c9e-6e86b36a653c => generated 1579 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:39:14.078084 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-bf53fd4b-64ab-42d1-afa1-83a95acc5205 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "POST /compute/v2.1/servers/d62b250c-c52b-4bd8-b6e0-b46ada9eee6f/action" status: 200 len: 28699 microversion: 2.1 time: 0.168982 Feb 17 04:39:14.078705 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 629/1340] 10.222.0.78 () {60 vars in 1268 bytes} [Wed Feb 17 04:39:13 2021] POST /compute/v2.1/servers/d62b250c-c52b-4bd8-b6e0-b46ada9eee6f/action => generated 28699 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 17 04:39:14.234222 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-237aa6ad-c032-4e19-b29b-9f1782c05e64 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:39:14.234767 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-237aa6ad-c032-4e19-b29b-9f1782c05e64 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:14.243297 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-237aa6ad-c032-4e19-b29b-9f1782c05e64 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:14.243800 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-237aa6ad-c032-4e19-b29b-9f1782c05e64 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:14.244634 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-237aa6ad-c032-4e19-b29b-9f1782c05e64 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:14.245133 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-237aa6ad-c032-4e19-b29b-9f1782c05e64 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:14.316168 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-237aa6ad-c032-4e19-b29b-9f1782c05e64 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "GET /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9/os-volume_attachments/1cad403e-6a9a-4743-92d3-bf815e78c519" status: 200 len: 194 microversion: 2.20 time: 0.086301 Feb 17 04:39:14.317028 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 712/1341] 10.222.0.78 () {60 vars in 1444 bytes} [Wed Feb 17 04:39:14 2021] GET /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9/os-volume_attachments/1cad403e-6a9a-4743-92d3-bf815e78c519 => generated 194 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 04:39:14.430844 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-a93467d6-071a-4711-b83f-e8e37a88c685 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:39:14.431553 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-a93467d6-071a-4711-b83f-e8e37a88c685 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:14.440951 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-a93467d6-071a-4711-b83f-e8e37a88c685 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:14.441443 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-a93467d6-071a-4711-b83f-e8e37a88c685 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:14.442280 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-a93467d6-071a-4711-b83f-e8e37a88c685 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:14.442778 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-a93467d6-071a-4711-b83f-e8e37a88c685 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:14.617606 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.objects.instance [None req-a93467d6-071a-4711-b83f-e8e37a88c685 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lazy-loading 'services' on Instance uuid 8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9 {{(pid=98178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Feb 17 04:39:14.758564 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-a93467d6-071a-4711-b83f-e8e37a88c685 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "DELETE /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9/os-volume_attachments/1cad403e-6a9a-4743-92d3-bf815e78c519" status: 202 len: 0 microversion: 2.20 time: 0.332038 Feb 17 04:39:14.759293 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 630/1342] 10.222.0.78 () {60 vars in 1447 bytes} [Wed Feb 17 04:39:14 2021] DELETE /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9/os-volume_attachments/1cad403e-6a9a-4743-92d3-bf815e78c519 => generated 0 bytes in 334 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Feb 17 04:39:14.996606 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-8be7de54-4bf4-4ae8-921c-2d6dd0f8c27f tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:39:14.997278 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-8be7de54-4bf4-4ae8-921c-2d6dd0f8c27f tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] [instance: 62a16d76-4309-472d-9c9e-6e86b36a653c] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:15.005485 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-8be7de54-4bf4-4ae8-921c-2d6dd0f8c27f tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:15.005987 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-8be7de54-4bf4-4ae8-921c-2d6dd0f8c27f tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:15.006815 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-8be7de54-4bf4-4ae8-921c-2d6dd0f8c27f tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:15.007330 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-8be7de54-4bf4-4ae8-921c-2d6dd0f8c27f tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:15.092055 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-09eee78c-2297-4f38-add5-762e195c8ae3 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:39:15.093514 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-09eee78c-2297-4f38-add5-762e195c8ae3 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: d62b250c-c52b-4bd8-b6e0-b46ada9eee6f] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:15.102465 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-09eee78c-2297-4f38-add5-762e195c8ae3 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:15.102976 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-09eee78c-2297-4f38-add5-762e195c8ae3 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:15.103851 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-09eee78c-2297-4f38-add5-762e195c8ae3 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:15.104352 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-09eee78c-2297-4f38-add5-762e195c8ae3 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:15.225680 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-8be7de54-4bf4-4ae8-921c-2d6dd0f8c27f tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb8b6c44468c498f9dc0d3a8776433d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79050d22ac3d4c7eb85cd6a19be9ef10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:15.234804 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-8be7de54-4bf4-4ae8-921c-2d6dd0f8c27f tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] 10.222.0.78 "GET /compute/v2.1/servers/62a16d76-4309-472d-9c9e-6e86b36a653c" status: 200 len: 1579 microversion: 2.1 time: 0.242316 Feb 17 04:39:15.235469 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 713/1343] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:39:14 2021] GET /compute/v2.1/servers/62a16d76-4309-472d-9c9e-6e86b36a653c => generated 1579 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:39:15.264402 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-09eee78c-2297-4f38-add5-762e195c8ae3 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "POST /compute/v2.1/servers/d62b250c-c52b-4bd8-b6e0-b46ada9eee6f/action" status: 200 len: 28699 microversion: 2.1 time: 0.176749 Feb 17 04:39:15.265063 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 631/1344] 10.222.0.78 () {60 vars in 1268 bytes} [Wed Feb 17 04:39:15 2021] POST /compute/v2.1/servers/d62b250c-c52b-4bd8-b6e0-b46ada9eee6f/action => generated 28699 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 17 04:39:15.980666 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-d016a6d2-5f9a-4787-a985-53730b702acc tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:39:15.981281 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-d016a6d2-5f9a-4787-a985-53730b702acc tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:15.990862 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-d016a6d2-5f9a-4787-a985-53730b702acc tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:15.991406 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-d016a6d2-5f9a-4787-a985-53730b702acc tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:15.992302 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-d016a6d2-5f9a-4787-a985-53730b702acc tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:15.992798 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-d016a6d2-5f9a-4787-a985-53730b702acc tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:16.059681 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-d016a6d2-5f9a-4787-a985-53730b702acc tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9] Going to try to terminate instance {{(pid=98179) delete /opt/stack/nova/nova/compute/api.py:2540}} Feb 17 04:39:16.175442 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-d016a6d2-5f9a-4787-a985-53730b702acc tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "DELETE /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9" status: 204 len: 0 microversion: 2.20 time: 0.198400 Feb 17 04:39:16.176013 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 714/1345] 10.222.0.78 () {60 vars in 1270 bytes} [Wed Feb 17 04:39:15 2021] DELETE /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Feb 17 04:39:16.185833 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-e86b7728-76bf-494b-8f8e-a709d3b47712 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:39:16.186613 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-e86b7728-76bf-494b-8f8e-a709d3b47712 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:16.196167 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-e86b7728-76bf-494b-8f8e-a709d3b47712 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:16.196679 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-e86b7728-76bf-494b-8f8e-a709d3b47712 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:16.197523 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-e86b7728-76bf-494b-8f8e-a709d3b47712 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:16.198028 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-e86b7728-76bf-494b-8f8e-a709d3b47712 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:16.253924 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-8f09d0fd-6b76-4fda-8b3f-2c33e0605d03 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:39:16.254679 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-8f09d0fd-6b76-4fda-8b3f-2c33e0605d03 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] [instance: 62a16d76-4309-472d-9c9e-6e86b36a653c] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:16.262447 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-8f09d0fd-6b76-4fda-8b3f-2c33e0605d03 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:16.262961 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-8f09d0fd-6b76-4fda-8b3f-2c33e0605d03 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:16.263856 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-8f09d0fd-6b76-4fda-8b3f-2c33e0605d03 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:16.264349 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-8f09d0fd-6b76-4fda-8b3f-2c33e0605d03 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:16.419497 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-e86b7728-76bf-494b-8f8e-a709d3b47712 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:16.429172 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-e86b7728-76bf-494b-8f8e-a709d3b47712 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:16.430521 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-e86b7728-76bf-494b-8f8e-a709d3b47712 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:16.431744 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-e86b7728-76bf-494b-8f8e-a709d3b47712 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "GET /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9" status: 200 len: 1723 microversion: 2.20 time: 0.250619 Feb 17 04:39:16.432345 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 632/1346] 10.222.0.78 () {60 vars in 1267 bytes} [Wed Feb 17 04:39:16 2021] GET /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9 => generated 1723 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:39:16.437051 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-79755e13-63c1-4b01-bacf-dbad4d352754 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:39:16.438202 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-79755e13-63c1-4b01-bacf-dbad4d352754 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: d62b250c-c52b-4bd8-b6e0-b46ada9eee6f] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:16.446220 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-79755e13-63c1-4b01-bacf-dbad4d352754 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:16.446738 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-79755e13-63c1-4b01-bacf-dbad4d352754 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:16.447674 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-79755e13-63c1-4b01-bacf-dbad4d352754 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:16.448171 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-79755e13-63c1-4b01-bacf-dbad4d352754 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:16.496409 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-8f09d0fd-6b76-4fda-8b3f-2c33e0605d03 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb8b6c44468c498f9dc0d3a8776433d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79050d22ac3d4c7eb85cd6a19be9ef10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:16.506182 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-8f09d0fd-6b76-4fda-8b3f-2c33e0605d03 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] 10.222.0.78 "GET /compute/v2.1/servers/62a16d76-4309-472d-9c9e-6e86b36a653c" status: 200 len: 1579 microversion: 2.1 time: 0.256947 Feb 17 04:39:16.506799 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 715/1347] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:39:16 2021] GET /compute/v2.1/servers/62a16d76-4309-472d-9c9e-6e86b36a653c => generated 1579 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:39:16.594486 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-79755e13-63c1-4b01-bacf-dbad4d352754 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "POST /compute/v2.1/servers/d62b250c-c52b-4bd8-b6e0-b46ada9eee6f/action" status: 200 len: 28699 microversion: 2.1 time: 0.160772 Feb 17 04:39:16.595448 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 633/1348] 10.222.0.78 () {60 vars in 1268 bytes} [Wed Feb 17 04:39:16 2021] POST /compute/v2.1/servers/d62b250c-c52b-4bd8-b6e0-b46ada9eee6f/action => generated 28699 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 04:39:17.452191 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-a12ed62d-e570-430b-a1fd-9fb3de7c8958 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:39:17.452786 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-a12ed62d-e570-430b-a1fd-9fb3de7c8958 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:17.460721 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-a12ed62d-e570-430b-a1fd-9fb3de7c8958 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:17.461222 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-a12ed62d-e570-430b-a1fd-9fb3de7c8958 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:17.462045 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-a12ed62d-e570-430b-a1fd-9fb3de7c8958 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:17.462529 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-a12ed62d-e570-430b-a1fd-9fb3de7c8958 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:17.525303 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-0a872f5c-9ed9-4bfc-94dc-54d4b37ec73f tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:39:17.526129 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-0a872f5c-9ed9-4bfc-94dc-54d4b37ec73f tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] [instance: 62a16d76-4309-472d-9c9e-6e86b36a653c] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:17.536048 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-0a872f5c-9ed9-4bfc-94dc-54d4b37ec73f tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:17.536559 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-0a872f5c-9ed9-4bfc-94dc-54d4b37ec73f tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:17.537457 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-0a872f5c-9ed9-4bfc-94dc-54d4b37ec73f tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:17.537955 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-0a872f5c-9ed9-4bfc-94dc-54d4b37ec73f tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:17.677259 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-a12ed62d-e570-430b-a1fd-9fb3de7c8958 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:17.687221 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-a12ed62d-e570-430b-a1fd-9fb3de7c8958 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:17.688918 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-a12ed62d-e570-430b-a1fd-9fb3de7c8958 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:17.690112 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-a12ed62d-e570-430b-a1fd-9fb3de7c8958 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "GET /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9" status: 200 len: 1723 microversion: 2.20 time: 0.242191 Feb 17 04:39:17.690707 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 716/1349] 10.222.0.78 () {60 vars in 1267 bytes} [Wed Feb 17 04:39:17 2021] GET /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9 => generated 1723 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:39:17.702100 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-3661073a-c1b9-4263-8f38-c33f8fd875fd tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:39:17.702100 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-3661073a-c1b9-4263-8f38-c33f8fd875fd tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: d62b250c-c52b-4bd8-b6e0-b46ada9eee6f] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:17.704385 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-3661073a-c1b9-4263-8f38-c33f8fd875fd tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:17.704931 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-3661073a-c1b9-4263-8f38-c33f8fd875fd tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:17.705764 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-3661073a-c1b9-4263-8f38-c33f8fd875fd tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:17.706236 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-3661073a-c1b9-4263-8f38-c33f8fd875fd tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:17.757167 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-0a872f5c-9ed9-4bfc-94dc-54d4b37ec73f tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb8b6c44468c498f9dc0d3a8776433d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79050d22ac3d4c7eb85cd6a19be9ef10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:17.766094 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-0a872f5c-9ed9-4bfc-94dc-54d4b37ec73f tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] 10.222.0.78 "GET /compute/v2.1/servers/62a16d76-4309-472d-9c9e-6e86b36a653c" status: 200 len: 1579 microversion: 2.1 time: 0.245395 Feb 17 04:39:17.767416 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 634/1350] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:39:17 2021] GET /compute/v2.1/servers/62a16d76-4309-472d-9c9e-6e86b36a653c => generated 1579 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:39:17.927263 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-3661073a-c1b9-4263-8f38-c33f8fd875fd tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "POST /compute/v2.1/servers/d62b250c-c52b-4bd8-b6e0-b46ada9eee6f/action" status: 200 len: 28699 microversion: 2.1 time: 0.235107 Feb 17 04:39:17.927971 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 717/1351] 10.222.0.78 () {60 vars in 1268 bytes} [Wed Feb 17 04:39:17 2021] POST /compute/v2.1/servers/d62b250c-c52b-4bd8-b6e0-b46ada9eee6f/action => generated 28699 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 04:39:18.710288 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-c2321376-5544-426f-8346-b22cc4cc983d tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:39:18.710891 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-c2321376-5544-426f-8346-b22cc4cc983d tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:18.719419 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-c2321376-5544-426f-8346-b22cc4cc983d tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:18.719936 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-c2321376-5544-426f-8346-b22cc4cc983d tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:18.720782 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-c2321376-5544-426f-8346-b22cc4cc983d tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:18.721280 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-c2321376-5544-426f-8346-b22cc4cc983d tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:18.785983 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-f5499ed7-fe0f-41e0-8bdb-f3580a8f1053 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:39:18.786767 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-f5499ed7-fe0f-41e0-8bdb-f3580a8f1053 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] [instance: 62a16d76-4309-472d-9c9e-6e86b36a653c] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:18.796150 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-f5499ed7-fe0f-41e0-8bdb-f3580a8f1053 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:18.796664 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-f5499ed7-fe0f-41e0-8bdb-f3580a8f1053 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:18.797535 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-f5499ed7-fe0f-41e0-8bdb-f3580a8f1053 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:18.798529 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-f5499ed7-fe0f-41e0-8bdb-f3580a8f1053 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:19.019625 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-f5499ed7-fe0f-41e0-8bdb-f3580a8f1053 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb8b6c44468c498f9dc0d3a8776433d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79050d22ac3d4c7eb85cd6a19be9ef10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:19.028721 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-f5499ed7-fe0f-41e0-8bdb-f3580a8f1053 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] 10.222.0.78 "GET /compute/v2.1/servers/62a16d76-4309-472d-9c9e-6e86b36a653c" status: 200 len: 1579 microversion: 2.1 time: 0.247448 Feb 17 04:39:19.029417 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 718/1352] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:39:18 2021] GET /compute/v2.1/servers/62a16d76-4309-472d-9c9e-6e86b36a653c => generated 1579 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:39:19.034694 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-79b49d33-89fa-4c9a-9908-203d76ccde09 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:39:19.035839 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-79b49d33-89fa-4c9a-9908-203d76ccde09 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: d62b250c-c52b-4bd8-b6e0-b46ada9eee6f] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:19.043558 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-79b49d33-89fa-4c9a-9908-203d76ccde09 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:19.044067 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-79b49d33-89fa-4c9a-9908-203d76ccde09 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:19.044906 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-79b49d33-89fa-4c9a-9908-203d76ccde09 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:19.045399 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-79b49d33-89fa-4c9a-9908-203d76ccde09 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:19.140506 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-c2321376-5544-426f-8346-b22cc4cc983d tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:19.150561 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-c2321376-5544-426f-8346-b22cc4cc983d tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:19.152355 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-c2321376-5544-426f-8346-b22cc4cc983d tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:19.153563 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-c2321376-5544-426f-8346-b22cc4cc983d tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "GET /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9" status: 200 len: 1723 microversion: 2.20 time: 0.447455 Feb 17 04:39:19.154273 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 635/1353] 10.222.0.78 () {60 vars in 1267 bytes} [Wed Feb 17 04:39:18 2021] GET /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9 => generated 1723 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:39:19.193737 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-79b49d33-89fa-4c9a-9908-203d76ccde09 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "POST /compute/v2.1/servers/d62b250c-c52b-4bd8-b6e0-b46ada9eee6f/action" status: 200 len: 28699 microversion: 2.1 time: 0.162850 Feb 17 04:39:19.194442 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 719/1354] 10.222.0.78 () {60 vars in 1268 bytes} [Wed Feb 17 04:39:19 2021] POST /compute/v2.1/servers/d62b250c-c52b-4bd8-b6e0-b46ada9eee6f/action => generated 28699 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 04:39:20.048367 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-448cced6-ec0e-4c76-815e-7af0bd808fb5 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:39:20.049002 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-448cced6-ec0e-4c76-815e-7af0bd808fb5 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] [instance: 62a16d76-4309-472d-9c9e-6e86b36a653c] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:20.056888 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-448cced6-ec0e-4c76-815e-7af0bd808fb5 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:20.057392 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-448cced6-ec0e-4c76-815e-7af0bd808fb5 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:20.058238 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-448cced6-ec0e-4c76-815e-7af0bd808fb5 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:20.058731 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-448cced6-ec0e-4c76-815e-7af0bd808fb5 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:20.175739 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-f09ba343-c2ae-406b-a341-72ca4fab147f tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:39:20.176562 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-f09ba343-c2ae-406b-a341-72ca4fab147f tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:20.185343 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-f09ba343-c2ae-406b-a341-72ca4fab147f tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:20.185891 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-f09ba343-c2ae-406b-a341-72ca4fab147f tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:20.186737 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-f09ba343-c2ae-406b-a341-72ca4fab147f tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:20.187263 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-f09ba343-c2ae-406b-a341-72ca4fab147f tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:20.318854 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-f09ba343-c2ae-406b-a341-72ca4fab147f tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:20.328566 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-f09ba343-c2ae-406b-a341-72ca4fab147f tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:20.331175 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-f09ba343-c2ae-406b-a341-72ca4fab147f tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:20.332442 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-f09ba343-c2ae-406b-a341-72ca4fab147f tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "GET /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9" status: 200 len: 1655 microversion: 2.20 time: 0.162163 Feb 17 04:39:20.333042 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 720/1355] 10.222.0.78 () {60 vars in 1267 bytes} [Wed Feb 17 04:39:20 2021] GET /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9 => generated 1655 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 17 04:39:20.343701 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-56067112-4904-4b90-859a-3b03365c070e tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:39:20.345402 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-56067112-4904-4b90-859a-3b03365c070e tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: d62b250c-c52b-4bd8-b6e0-b46ada9eee6f] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:20.353608 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-56067112-4904-4b90-859a-3b03365c070e tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:20.354118 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-56067112-4904-4b90-859a-3b03365c070e tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:20.354971 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-56067112-4904-4b90-859a-3b03365c070e tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:20.355550 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-56067112-4904-4b90-859a-3b03365c070e tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:20.490702 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-448cced6-ec0e-4c76-815e-7af0bd808fb5 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb8b6c44468c498f9dc0d3a8776433d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79050d22ac3d4c7eb85cd6a19be9ef10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:20.493859 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-56067112-4904-4b90-859a-3b03365c070e tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "POST /compute/v2.1/servers/d62b250c-c52b-4bd8-b6e0-b46ada9eee6f/action" status: 200 len: 28699 microversion: 2.1 time: 0.159286 Feb 17 04:39:20.495473 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 721/1356] 10.222.0.78 () {60 vars in 1268 bytes} [Wed Feb 17 04:39:20 2021] POST /compute/v2.1/servers/d62b250c-c52b-4bd8-b6e0-b46ada9eee6f/action => generated 28699 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 04:39:20.500222 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-448cced6-ec0e-4c76-815e-7af0bd808fb5 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] 10.222.0.78 "GET /compute/v2.1/servers/62a16d76-4309-472d-9c9e-6e86b36a653c" status: 200 len: 1579 microversion: 2.1 time: 0.456479 Feb 17 04:39:20.500858 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 636/1357] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:39:20 2021] GET /compute/v2.1/servers/62a16d76-4309-472d-9c9e-6e86b36a653c => generated 1579 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:39:20.846310 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [req-fc744861-5de2-4ec1-9c7d-b576524f7926 req-50648255-49cb-4678-b00d-790f3a894f8c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9", "name": "network-vif-deleted", "tag": "05ddcb41-fa3f-4fa9-a81d-e152e7b80f04"}]} {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:39:20.848088 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:39:20.848088 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: warnings.warn(msg) Feb 17 04:39:20.857239 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [req-fc744861-5de2-4ec1-9c7d-b576524f7926 req-50648255-49cb-4678-b00d-790f3a894f8c service nova] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:20.858014 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [req-fc744861-5de2-4ec1-9c7d-b576524f7926 req-50648255-49cb-4678-b00d-790f3a894f8c service nova] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:20.877372 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.compute.server_external_events [req-fc744861-5de2-4ec1-9c7d-b576524f7926 req-50648255-49cb-4678-b00d-790f3a894f8c service nova] Creating event network-vif-deleted:05ddcb41-fa3f-4fa9-a81d-e152e7b80f04 for instance 8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9 on hv-cinder-75998 Feb 17 04:39:20.882477 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [req-fc744861-5de2-4ec1-9c7d-b576524f7926 req-50648255-49cb-4678-b00d-790f3a894f8c service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110895 Feb 17 04:39:20.883181 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 722/1358] 10.222.0.78 () {64 vars in 1308 bytes} [Wed Feb 17 04:39:20 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:39:21.353472 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-32554092-60a2-4a23-874a-61a040f18603 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:39:21.354212 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-32554092-60a2-4a23-874a-61a040f18603 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:21.369316 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [req-8e239655-0adf-4094-9179-4c69a7d6a967 req-60b4859e-633f-4620-8325-2cd9c218fcb6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62a16d76-4309-472d-9c9e-6e86b36a653c", "name": "network-vif-plugged", "status": "completed", "tag": "5ba59ff1-b19b-4ba6-9ef2-07dccd6b3a55"}]} {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:39:21.371000 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:39:21.371000 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: warnings.warn(msg) Feb 17 04:39:21.372836 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-32554092-60a2-4a23-874a-61a040f18603 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:21.373534 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-32554092-60a2-4a23-874a-61a040f18603 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:21.374424 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-32554092-60a2-4a23-874a-61a040f18603 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:21.374927 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-32554092-60a2-4a23-874a-61a040f18603 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:21.382391 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [req-8e239655-0adf-4094-9179-4c69a7d6a967 req-60b4859e-633f-4620-8325-2cd9c218fcb6 service nova] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:21.382901 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [req-8e239655-0adf-4094-9179-4c69a7d6a967 req-60b4859e-633f-4620-8325-2cd9c218fcb6 service nova] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:21.402424 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.compute.server_external_events [req-8e239655-0adf-4094-9179-4c69a7d6a967 req-60b4859e-633f-4620-8325-2cd9c218fcb6 service nova] Creating event network-vif-plugged:5ba59ff1-b19b-4ba6-9ef2-07dccd6b3a55 for instance 62a16d76-4309-472d-9c9e-6e86b36a653c on hv-cinder-75998 Feb 17 04:39:21.408374 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [req-8e239655-0adf-4094-9179-4c69a7d6a967 req-60b4859e-633f-4620-8325-2cd9c218fcb6 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045294 Feb 17 04:39:21.409278 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 723/1359] 10.222.0.78 () {64 vars in 1308 bytes} [Wed Feb 17 04:39:21 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 17 04:39:21.479517 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-32554092-60a2-4a23-874a-61a040f18603 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:21.480269 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-32554092-60a2-4a23-874a-61a040f18603 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:21.480952 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.objects.instance [None req-32554092-60a2-4a23-874a-61a040f18603 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lazy-loading 'fault' on Instance uuid 8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9 {{(pid=98178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Feb 17 04:39:21.507543 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-bba2c5fa-07da-4706-acda-30db1cc5bfde tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:39:21.508695 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-bba2c5fa-07da-4706-acda-30db1cc5bfde tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: d62b250c-c52b-4bd8-b6e0-b46ada9eee6f] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:21.518562 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-bba2c5fa-07da-4706-acda-30db1cc5bfde tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:21.519092 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-bba2c5fa-07da-4706-acda-30db1cc5bfde tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:21.519947 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-bba2c5fa-07da-4706-acda-30db1cc5bfde tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:21.520592 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-bba2c5fa-07da-4706-acda-30db1cc5bfde tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:21.569896 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-32554092-60a2-4a23-874a-61a040f18603 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:21.581248 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-32554092-60a2-4a23-874a-61a040f18603 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:21.582836 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-32554092-60a2-4a23-874a-61a040f18603 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:21.584078 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-32554092-60a2-4a23-874a-61a040f18603 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "GET /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9" status: 200 len: 1371 microversion: 2.20 time: 0.235775 Feb 17 04:39:21.595384 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 637/1360] 10.222.0.78 () {60 vars in 1267 bytes} [Wed Feb 17 04:39:21 2021] GET /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9 => generated 1371 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:39:21.595384 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-24a09d04-3ac4-4c03-b03d-bbb710c56d5c tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:39:21.595384 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-24a09d04-3ac4-4c03-b03d-bbb710c56d5c tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] [instance: 62a16d76-4309-472d-9c9e-6e86b36a653c] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:21.601740 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-24a09d04-3ac4-4c03-b03d-bbb710c56d5c tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:21.602253 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-24a09d04-3ac4-4c03-b03d-bbb710c56d5c tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:21.603138 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-24a09d04-3ac4-4c03-b03d-bbb710c56d5c tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:21.603639 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-24a09d04-3ac4-4c03-b03d-bbb710c56d5c tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:21.659115 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-bba2c5fa-07da-4706-acda-30db1cc5bfde tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "POST /compute/v2.1/servers/d62b250c-c52b-4bd8-b6e0-b46ada9eee6f/action" status: 200 len: 28699 microversion: 2.1 time: 0.155904 Feb 17 04:39:21.660781 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 724/1361] 10.222.0.78 () {60 vars in 1268 bytes} [Wed Feb 17 04:39:21 2021] POST /compute/v2.1/servers/d62b250c-c52b-4bd8-b6e0-b46ada9eee6f/action => generated 28699 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 17 04:39:21.931589 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-24a09d04-3ac4-4c03-b03d-bbb710c56d5c tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb8b6c44468c498f9dc0d3a8776433d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79050d22ac3d4c7eb85cd6a19be9ef10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:21.941596 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-24a09d04-3ac4-4c03-b03d-bbb710c56d5c tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] 10.222.0.78 "GET /compute/v2.1/servers/62a16d76-4309-472d-9c9e-6e86b36a653c" status: 200 len: 1579 microversion: 2.1 time: 0.355608 Feb 17 04:39:21.942396 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 638/1362] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:39:21 2021] GET /compute/v2.1/servers/62a16d76-4309-472d-9c9e-6e86b36a653c => generated 1579 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:39:22.605851 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-a3288345-5a45-44ae-9c86-eda0a920a8e1 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:39:22.606540 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-a3288345-5a45-44ae-9c86-eda0a920a8e1 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:22.616458 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-a3288345-5a45-44ae-9c86-eda0a920a8e1 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:22.616969 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-a3288345-5a45-44ae-9c86-eda0a920a8e1 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:22.617813 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-a3288345-5a45-44ae-9c86-eda0a920a8e1 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:22.618353 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-a3288345-5a45-44ae-9c86-eda0a920a8e1 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:22.671750 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-2cce4a61-75f4-40b0-93be-9ac7c757ab46 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:39:22.673811 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-2cce4a61-75f4-40b0-93be-9ac7c757ab46 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: d62b250c-c52b-4bd8-b6e0-b46ada9eee6f] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:22.674684 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.wsgi [None req-a3288345-5a45-44ae-9c86-eda0a920a8e1 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] HTTP exception thrown: Instance 8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9 could not be found. Feb 17 04:39:22.675410 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-a3288345-5a45-44ae-9c86-eda0a920a8e1 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Returning 404 to user: Instance 8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9 could not be found. {{(pid=98179) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 17 04:39:22.676328 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-a3288345-5a45-44ae-9c86-eda0a920a8e1 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "GET /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9" status: 404 len: 111 microversion: 2.20 time: 0.075202 Feb 17 04:39:22.681495 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 725/1363] 10.222.0.78 () {60 vars in 1267 bytes} [Wed Feb 17 04:39:22 2021] GET /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Feb 17 04:39:22.681745 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-2cce4a61-75f4-40b0-93be-9ac7c757ab46 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:22.682239 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-2cce4a61-75f4-40b0-93be-9ac7c757ab46 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:22.683127 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-2cce4a61-75f4-40b0-93be-9ac7c757ab46 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:22.683633 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-2cce4a61-75f4-40b0-93be-9ac7c757ab46 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:22.686492 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-43564a02-0258-4bbe-8ade-4a89e378d064 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Calling method '.version_select at 0x7f57c88f19d8>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:39:22.704581 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-43564a02-0258-4bbe-8ade-4a89e378d064 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2038219863" status: 204 len: 0 microversion: 2.20 time: 0.021990 Feb 17 04:39:22.705414 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 726/1364] 10.222.0.78 () {60 vars in 1252 bytes} [Wed Feb 17 04:39:22 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2038219863 => generated 0 bytes in 23 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Feb 17 04:39:22.850387 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-2cce4a61-75f4-40b0-93be-9ac7c757ab46 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "POST /compute/v2.1/servers/d62b250c-c52b-4bd8-b6e0-b46ada9eee6f/action" status: 200 len: 28699 microversion: 2.1 time: 0.182576 Feb 17 04:39:22.852066 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 639/1365] 10.222.0.78 () {60 vars in 1268 bytes} [Wed Feb 17 04:39:22 2021] POST /compute/v2.1/servers/d62b250c-c52b-4bd8-b6e0-b46ada9eee6f/action => generated 28699 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 04:39:22.960459 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-80ebd417-f0c9-4d72-8460-b397fc9e6971 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:39:22.961294 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-80ebd417-f0c9-4d72-8460-b397fc9e6971 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] [instance: 62a16d76-4309-472d-9c9e-6e86b36a653c] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:22.969385 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-80ebd417-f0c9-4d72-8460-b397fc9e6971 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:22.970230 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-80ebd417-f0c9-4d72-8460-b397fc9e6971 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:22.970907 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-80ebd417-f0c9-4d72-8460-b397fc9e6971 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:22.971457 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-80ebd417-f0c9-4d72-8460-b397fc9e6971 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:23.196258 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-80ebd417-f0c9-4d72-8460-b397fc9e6971 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb8b6c44468c498f9dc0d3a8776433d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79050d22ac3d4c7eb85cd6a19be9ef10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:23.206547 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-80ebd417-f0c9-4d72-8460-b397fc9e6971 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] 10.222.0.78 "GET /compute/v2.1/servers/62a16d76-4309-472d-9c9e-6e86b36a653c" status: 200 len: 1579 microversion: 2.1 time: 0.250125 Feb 17 04:39:23.207170 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 727/1366] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:39:22 2021] GET /compute/v2.1/servers/62a16d76-4309-472d-9c9e-6e86b36a653c => generated 1579 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:39:23.863252 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-52359ef1-4304-4192-9402-246de9daed10 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:39:23.864402 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-52359ef1-4304-4192-9402-246de9daed10 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: d62b250c-c52b-4bd8-b6e0-b46ada9eee6f] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:23.873270 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-52359ef1-4304-4192-9402-246de9daed10 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:23.874285 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-52359ef1-4304-4192-9402-246de9daed10 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:23.874694 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-52359ef1-4304-4192-9402-246de9daed10 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:23.875221 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-52359ef1-4304-4192-9402-246de9daed10 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:23.928363 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-3504beec-ab7d-421a-ac18-da30e7eff178 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Action: 'create', calling method: .version_select at 0x7f57c94197b8>, body: {"keypair": {"name": "tempest-keypair-1077625448"}} {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:39:23.956010 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.quota [None req-3504beec-ab7d-421a-ac18-da30e7eff178 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Getting quotas for project 0bdc99fc094d4c3fb38cad060f2dc825. Resources: {'key_pairs'} {{(pid=98179) _get_quotas /opt/stack/nova/nova/quota.py:388}} Feb 17 04:39:23.960120 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.quota [None req-3504beec-ab7d-421a-ac18-da30e7eff178 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Getting quotas for user c1ae36a432a24019803fac4d68061a24 and project 0bdc99fc094d4c3fb38cad060f2dc825. Resources: {'key_pairs'} {{(pid=98179) _get_quotas /opt/stack/nova/nova/quota.py:380}} Feb 17 04:39:24.000952 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-52359ef1-4304-4192-9402-246de9daed10 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "POST /compute/v2.1/servers/d62b250c-c52b-4bd8-b6e0-b46ada9eee6f/action" status: 200 len: 28699 microversion: 2.1 time: 0.141984 Feb 17 04:39:24.001826 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 640/1367] 10.222.0.78 () {60 vars in 1268 bytes} [Wed Feb 17 04:39:23 2021] POST /compute/v2.1/servers/d62b250c-c52b-4bd8-b6e0-b46ada9eee6f/action => generated 28699 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 04:39:24.120544 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.quota [None req-3504beec-ab7d-421a-ac18-da30e7eff178 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Getting quotas for project 0bdc99fc094d4c3fb38cad060f2dc825. Resources: {'key_pairs'} {{(pid=98179) _get_quotas /opt/stack/nova/nova/quota.py:388}} Feb 17 04:39:24.124596 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.quota [None req-3504beec-ab7d-421a-ac18-da30e7eff178 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Getting quotas for user c1ae36a432a24019803fac4d68061a24 and project 0bdc99fc094d4c3fb38cad060f2dc825. Resources: {'key_pairs'} {{(pid=98179) _get_quotas /opt/stack/nova/nova/quota.py:380}} Feb 17 04:39:24.139187 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-3504beec-ab7d-421a-ac18-da30e7eff178 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 201 len: 2320 microversion: 2.20 time: 0.214807 Feb 17 04:39:24.140026 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 728/1368] 10.222.0.78 () {62 vars in 1189 bytes} [Wed Feb 17 04:39:23 2021] POST /compute/v2.1/os-keypairs => generated 2320 bytes in 216 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Feb 17 04:39:24.226545 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-a6f3e53a-65d3-422a-836b-8fd522840ff6 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:39:24.227390 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-a6f3e53a-65d3-422a-836b-8fd522840ff6 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] [instance: 62a16d76-4309-472d-9c9e-6e86b36a653c] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:24.237001 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-a6f3e53a-65d3-422a-836b-8fd522840ff6 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:24.237514 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-a6f3e53a-65d3-422a-836b-8fd522840ff6 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:24.238368 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-a6f3e53a-65d3-422a-836b-8fd522840ff6 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:24.238869 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-a6f3e53a-65d3-422a-836b-8fd522840ff6 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:24.501674 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-a6f3e53a-65d3-422a-836b-8fd522840ff6 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb8b6c44468c498f9dc0d3a8776433d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79050d22ac3d4c7eb85cd6a19be9ef10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:24.512080 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-a6f3e53a-65d3-422a-836b-8fd522840ff6 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] 10.222.0.78 "GET /compute/v2.1/servers/62a16d76-4309-472d-9c9e-6e86b36a653c" status: 200 len: 1566 microversion: 2.1 time: 0.289956 Feb 17 04:39:24.512707 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 641/1369] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:39:24 2021] GET /compute/v2.1/servers/62a16d76-4309-472d-9c9e-6e86b36a653c => generated 1566 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:39:25.014029 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-f71d9be8-21ef-41e8-bb18-37f54e881dc0 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:39:25.015239 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-f71d9be8-21ef-41e8-bb18-37f54e881dc0 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: d62b250c-c52b-4bd8-b6e0-b46ada9eee6f] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:25.023436 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-f71d9be8-21ef-41e8-bb18-37f54e881dc0 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:25.023955 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-f71d9be8-21ef-41e8-bb18-37f54e881dc0 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:25.024817 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-f71d9be8-21ef-41e8-bb18-37f54e881dc0 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:25.025319 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-f71d9be8-21ef-41e8-bb18-37f54e881dc0 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:25.158500 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-f71d9be8-21ef-41e8-bb18-37f54e881dc0 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "POST /compute/v2.1/servers/d62b250c-c52b-4bd8-b6e0-b46ada9eee6f/action" status: 200 len: 28699 microversion: 2.1 time: 0.148420 Feb 17 04:39:25.160370 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 729/1370] 10.222.0.78 () {60 vars in 1268 bytes} [Wed Feb 17 04:39:25 2021] POST /compute/v2.1/servers/d62b250c-c52b-4bd8-b6e0-b46ada9eee6f/action => generated 28699 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 04:39:26.171719 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-9fe2b232-73ea-43bd-86f6-f73ddb5bfeef tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:39:26.172974 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-9fe2b232-73ea-43bd-86f6-f73ddb5bfeef tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: d62b250c-c52b-4bd8-b6e0-b46ada9eee6f] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:26.184007 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-9fe2b232-73ea-43bd-86f6-f73ddb5bfeef tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:26.184291 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-9fe2b232-73ea-43bd-86f6-f73ddb5bfeef tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:26.185294 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-9fe2b232-73ea-43bd-86f6-f73ddb5bfeef tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:26.185897 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-9fe2b232-73ea-43bd-86f6-f73ddb5bfeef tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:26.324699 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-9fe2b232-73ea-43bd-86f6-f73ddb5bfeef tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "POST /compute/v2.1/servers/d62b250c-c52b-4bd8-b6e0-b46ada9eee6f/action" status: 200 len: 28699 microversion: 2.1 time: 0.156859 Feb 17 04:39:26.325586 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 642/1371] 10.222.0.78 () {60 vars in 1268 bytes} [Wed Feb 17 04:39:26 2021] POST /compute/v2.1/servers/d62b250c-c52b-4bd8-b6e0-b46ada9eee6f/action => generated 28699 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 04:39:26.695496 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-a1be6eb6-209f-458f-80f1-08039657d12d tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-614375635", "imageRef": "b005ed36-a85a-4c46-ba22-9fa8c5ec62e5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f55343ed-6cd4-4a05-83fb-6b9ff396686a"}], "security_groups": [{"name": "tempest-securitygroup--2039329161"}], "key_name": "tempest-keypair-1077625448", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:39:26.813176 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.network.neutron [None req-a1be6eb6-209f-458f-80f1-08039657d12d tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] validate_networks() for [('f55343ed-6cd4-4a05-83fb-6b9ff396686a', None, None, None)] {{(pid=98179) validate_networks /opt/stack/nova/nova/network/neutron.py:2345}} Feb 17 04:39:27.338457 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-5d86eaac-4469-4644-841a-e151d4023569 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:39:27.339826 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-5d86eaac-4469-4644-841a-e151d4023569 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: d62b250c-c52b-4bd8-b6e0-b46ada9eee6f] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:27.348663 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-5d86eaac-4469-4644-841a-e151d4023569 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:27.349179 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-5d86eaac-4469-4644-841a-e151d4023569 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:27.350032 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-5d86eaac-4469-4644-841a-e151d4023569 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:27.350529 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-5d86eaac-4469-4644-841a-e151d4023569 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:27.410494 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.virt.hardware [None req-a1be6eb6-209f-458f-80f1-08039657d12d tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Flavor limits 0:0:0 {{(pid=98179) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 17 04:39:27.411019 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.virt.hardware [None req-a1be6eb6-209f-458f-80f1-08039657d12d tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Image limits 0:0:0 {{(pid=98179) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Feb 17 04:39:27.411689 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.virt.hardware [None req-a1be6eb6-209f-458f-80f1-08039657d12d tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Flavor pref 0:0:0 {{(pid=98179) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 17 04:39:27.412322 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.virt.hardware [None req-a1be6eb6-209f-458f-80f1-08039657d12d tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Image pref 0:0:0 {{(pid=98179) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Feb 17 04:39:27.412956 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.virt.hardware [None req-a1be6eb6-209f-458f-80f1-08039657d12d tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98179) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Feb 17 04:39:27.422486 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-a1be6eb6-209f-458f-80f1-08039657d12d tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:27.423635 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-a1be6eb6-209f-458f-80f1-08039657d12d tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:27.424514 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-a1be6eb6-209f-458f-80f1-08039657d12d tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:27.425010 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-a1be6eb6-209f-458f-80f1-08039657d12d tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:27.444516 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.quota [None req-a1be6eb6-209f-458f-80f1-08039657d12d tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Getting quotas for project 0bdc99fc094d4c3fb38cad060f2dc825. Resources: {'ram', 'cores', 'instances'} {{(pid=98179) _get_quotas /opt/stack/nova/nova/quota.py:388}} Feb 17 04:39:27.448769 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.quota [None req-a1be6eb6-209f-458f-80f1-08039657d12d tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Getting quotas for user c1ae36a432a24019803fac4d68061a24 and project 0bdc99fc094d4c3fb38cad060f2dc825. Resources: {'ram', 'cores', 'instances'} {{(pid=98179) _get_quotas /opt/stack/nova/nova/quota.py:380}} Feb 17 04:39:27.461230 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-a1be6eb6-209f-458f-80f1-08039657d12d tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Going to run 1 instances... {{(pid=98179) _provision_instances /opt/stack/nova/nova/compute/api.py:1264}} Feb 17 04:39:27.463964 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-a1be6eb6-209f-458f-80f1-08039657d12d tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 5e68206c-24dc-4ec9-b907-bf233d27d550] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b005ed36-a85a-4c46-ba22-9fa8c5ec62e5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98179) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1666}} Feb 17 04:39:27.479560 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-5d86eaac-4469-4644-841a-e151d4023569 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "POST /compute/v2.1/servers/d62b250c-c52b-4bd8-b6e0-b46ada9eee6f/action" status: 200 len: 28699 microversion: 2.1 time: 0.145495 Feb 17 04:39:27.480514 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 643/1372] 10.222.0.78 () {60 vars in 1268 bytes} [Wed Feb 17 04:39:27 2021] POST /compute/v2.1/servers/d62b250c-c52b-4bd8-b6e0-b46ada9eee6f/action => generated 28699 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 04:39:27.516529 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-a1be6eb6-209f-458f-80f1-08039657d12d tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.878379 Feb 17 04:39:27.517231 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 730/1373] 10.222.0.78 () {62 vars in 1178 bytes} [Wed Feb 17 04:39:26 2021] POST /compute/v2.1/servers => generated 402 bytes in 880 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Feb 17 04:39:27.528852 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-472d8d75-88ad-490e-8a23-92124cf183e4 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:39:27.529726 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-472d8d75-88ad-490e-8a23-92124cf183e4 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 5e68206c-24dc-4ec9-b907-bf233d27d550] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:27.628259 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-472d8d75-88ad-490e-8a23-92124cf183e4 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:27.637010 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-472d8d75-88ad-490e-8a23-92124cf183e4 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:27.638749 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-472d8d75-88ad-490e-8a23-92124cf183e4 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:27.639950 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-472d8d75-88ad-490e-8a23-92124cf183e4 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "GET /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550" status: 200 len: 1281 microversion: 2.20 time: 0.115669 Feb 17 04:39:27.640544 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 644/1374] 10.222.0.78 () {60 vars in 1267 bytes} [Wed Feb 17 04:39:27 2021] GET /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550 => generated 1281 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:39:28.493164 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-20a2f525-dc12-46ce-a104-2c51b3a6fe8b tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:39:28.494336 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-20a2f525-dc12-46ce-a104-2c51b3a6fe8b tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: d62b250c-c52b-4bd8-b6e0-b46ada9eee6f] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:28.503933 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-20a2f525-dc12-46ce-a104-2c51b3a6fe8b tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:28.504446 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-20a2f525-dc12-46ce-a104-2c51b3a6fe8b tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:28.505287 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-20a2f525-dc12-46ce-a104-2c51b3a6fe8b tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:28.505784 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-20a2f525-dc12-46ce-a104-2c51b3a6fe8b tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:28.660344 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-4ae73c4f-b8b7-4c03-8310-5078f941e2da tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:39:28.661051 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-4ae73c4f-b8b7-4c03-8310-5078f941e2da tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 5e68206c-24dc-4ec9-b907-bf233d27d550] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:28.670378 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-4ae73c4f-b8b7-4c03-8310-5078f941e2da tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:28.670892 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-4ae73c4f-b8b7-4c03-8310-5078f941e2da tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:28.671770 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-4ae73c4f-b8b7-4c03-8310-5078f941e2da tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:28.672272 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-4ae73c4f-b8b7-4c03-8310-5078f941e2da tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:28.687237 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-20a2f525-dc12-46ce-a104-2c51b3a6fe8b tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "POST /compute/v2.1/servers/d62b250c-c52b-4bd8-b6e0-b46ada9eee6f/action" status: 200 len: 28699 microversion: 2.1 time: 0.198288 Feb 17 04:39:28.687994 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 731/1375] 10.222.0.78 () {60 vars in 1268 bytes} [Wed Feb 17 04:39:28 2021] POST /compute/v2.1/servers/d62b250c-c52b-4bd8-b6e0-b46ada9eee6f/action => generated 28699 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 04:39:28.888927 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-4ae73c4f-b8b7-4c03-8310-5078f941e2da tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:28.899465 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-4ae73c4f-b8b7-4c03-8310-5078f941e2da tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:28.901843 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-4ae73c4f-b8b7-4c03-8310-5078f941e2da tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:28.903407 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-4ae73c4f-b8b7-4c03-8310-5078f941e2da tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "GET /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550" status: 200 len: 1341 microversion: 2.20 time: 0.247503 Feb 17 04:39:28.904090 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 645/1376] 10.222.0.78 () {60 vars in 1267 bytes} [Wed Feb 17 04:39:28 2021] GET /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550 => generated 1341 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 17 04:39:29.701360 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-f9462672-76aa-4c20-9284-c5a6e21c0810 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:39:29.702537 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-f9462672-76aa-4c20-9284-c5a6e21c0810 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: d62b250c-c52b-4bd8-b6e0-b46ada9eee6f] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:29.712032 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-f9462672-76aa-4c20-9284-c5a6e21c0810 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:29.712537 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-f9462672-76aa-4c20-9284-c5a6e21c0810 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:29.713375 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-f9462672-76aa-4c20-9284-c5a6e21c0810 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:29.713866 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-f9462672-76aa-4c20-9284-c5a6e21c0810 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:29.863570 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-f9462672-76aa-4c20-9284-c5a6e21c0810 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "POST /compute/v2.1/servers/d62b250c-c52b-4bd8-b6e0-b46ada9eee6f/action" status: 200 len: 28699 microversion: 2.1 time: 0.166587 Feb 17 04:39:29.867721 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 732/1377] 10.222.0.78 () {60 vars in 1268 bytes} [Wed Feb 17 04:39:29 2021] POST /compute/v2.1/servers/d62b250c-c52b-4bd8-b6e0-b46ada9eee6f/action => generated 28699 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 17 04:39:29.923926 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-ab440939-7113-4c13-a18d-e351b3a8d39a tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:39:29.924597 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-ab440939-7113-4c13-a18d-e351b3a8d39a tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 5e68206c-24dc-4ec9-b907-bf233d27d550] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:29.932625 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-ab440939-7113-4c13-a18d-e351b3a8d39a tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:29.933139 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-ab440939-7113-4c13-a18d-e351b3a8d39a tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:29.933996 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-ab440939-7113-4c13-a18d-e351b3a8d39a tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:29.934494 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-ab440939-7113-4c13-a18d-e351b3a8d39a tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:30.069220 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-ab440939-7113-4c13-a18d-e351b3a8d39a tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:30.078666 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-ab440939-7113-4c13-a18d-e351b3a8d39a tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:30.080747 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-ab440939-7113-4c13-a18d-e351b3a8d39a tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:30.081935 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-ab440939-7113-4c13-a18d-e351b3a8d39a tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "GET /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550" status: 200 len: 1339 microversion: 2.20 time: 0.162606 Feb 17 04:39:30.093573 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 646/1378] 10.222.0.78 () {60 vars in 1267 bytes} [Wed Feb 17 04:39:29 2021] GET /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550 => generated 1339 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:39:30.876662 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-04f350c5-f345-4c53-be67-27789d576fbc tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:39:30.877811 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-04f350c5-f345-4c53-be67-27789d576fbc tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: d62b250c-c52b-4bd8-b6e0-b46ada9eee6f] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:30.886457 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-04f350c5-f345-4c53-be67-27789d576fbc tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:30.886980 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-04f350c5-f345-4c53-be67-27789d576fbc tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:30.887856 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-04f350c5-f345-4c53-be67-27789d576fbc tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:30.888361 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-04f350c5-f345-4c53-be67-27789d576fbc tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:31.011983 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-04f350c5-f345-4c53-be67-27789d576fbc tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "POST /compute/v2.1/servers/d62b250c-c52b-4bd8-b6e0-b46ada9eee6f/action" status: 200 len: 28699 microversion: 2.1 time: 0.140225 Feb 17 04:39:31.016853 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 733/1379] 10.222.0.78 () {60 vars in 1268 bytes} [Wed Feb 17 04:39:30 2021] POST /compute/v2.1/servers/d62b250c-c52b-4bd8-b6e0-b46ada9eee6f/action => generated 28699 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 04:39:31.101967 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-1c7b7927-055e-4aea-88c2-33d02f7e0599 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:39:31.102869 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-1c7b7927-055e-4aea-88c2-33d02f7e0599 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 5e68206c-24dc-4ec9-b907-bf233d27d550] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:31.112956 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-1c7b7927-055e-4aea-88c2-33d02f7e0599 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:31.113468 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-1c7b7927-055e-4aea-88c2-33d02f7e0599 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:31.114323 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-1c7b7927-055e-4aea-88c2-33d02f7e0599 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:31.114815 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-1c7b7927-055e-4aea-88c2-33d02f7e0599 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:31.774102 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-1c7b7927-055e-4aea-88c2-33d02f7e0599 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:31.784071 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-1c7b7927-055e-4aea-88c2-33d02f7e0599 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:31.785676 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-1c7b7927-055e-4aea-88c2-33d02f7e0599 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:31.786827 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-1c7b7927-055e-4aea-88c2-33d02f7e0599 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "GET /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550" status: 200 len: 1407 microversion: 2.20 time: 0.689084 Feb 17 04:39:31.787462 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 647/1380] 10.222.0.78 () {60 vars in 1267 bytes} [Wed Feb 17 04:39:31 2021] GET /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550 => generated 1407 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:39:32.025983 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-0efe5b12-6a23-48bd-9c12-d7099cbf7fc4 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:39:32.027073 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-0efe5b12-6a23-48bd-9c12-d7099cbf7fc4 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: d62b250c-c52b-4bd8-b6e0-b46ada9eee6f] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:32.037617 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-0efe5b12-6a23-48bd-9c12-d7099cbf7fc4 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:32.038113 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-0efe5b12-6a23-48bd-9c12-d7099cbf7fc4 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:32.039277 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-0efe5b12-6a23-48bd-9c12-d7099cbf7fc4 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:32.039777 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-0efe5b12-6a23-48bd-9c12-d7099cbf7fc4 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:32.320433 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-0efe5b12-6a23-48bd-9c12-d7099cbf7fc4 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "POST /compute/v2.1/servers/d62b250c-c52b-4bd8-b6e0-b46ada9eee6f/action" status: 200 len: 28699 microversion: 2.1 time: 0.298790 Feb 17 04:39:32.321187 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 734/1381] 10.222.0.78 () {60 vars in 1268 bytes} [Wed Feb 17 04:39:32 2021] POST /compute/v2.1/servers/d62b250c-c52b-4bd8-b6e0-b46ada9eee6f/action => generated 28699 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 04:39:32.806126 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-c86946e4-7701-4e78-9f7d-ce9835831a18 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:39:32.806983 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-c86946e4-7701-4e78-9f7d-ce9835831a18 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 5e68206c-24dc-4ec9-b907-bf233d27d550] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:32.816880 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-c86946e4-7701-4e78-9f7d-ce9835831a18 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:32.817400 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-c86946e4-7701-4e78-9f7d-ce9835831a18 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:32.818264 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-c86946e4-7701-4e78-9f7d-ce9835831a18 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:32.818780 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-c86946e4-7701-4e78-9f7d-ce9835831a18 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:32.848718 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [req-e8b6cecd-91ff-4dd8-9dc8-caf91f0c69ab req-922ce2d6-4381-4785-aa1b-6ca37534d22e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5e68206c-24dc-4ec9-b907-bf233d27d550", "tag": "11791c9e-fcaf-4d11-8104-b4270f0591a6"}]} {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:39:32.850617 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:39:32.850617 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: warnings.warn(msg) Feb 17 04:39:32.863550 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [req-e8b6cecd-91ff-4dd8-9dc8-caf91f0c69ab req-922ce2d6-4381-4785-aa1b-6ca37534d22e service nova] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:32.864164 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [req-e8b6cecd-91ff-4dd8-9dc8-caf91f0c69ab req-922ce2d6-4381-4785-aa1b-6ca37534d22e service nova] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:32.884934 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.compute.server_external_events [req-e8b6cecd-91ff-4dd8-9dc8-caf91f0c69ab req-922ce2d6-4381-4785-aa1b-6ca37534d22e service nova] Creating event network-changed:11791c9e-fcaf-4d11-8104-b4270f0591a6 for instance 5e68206c-24dc-4ec9-b907-bf233d27d550 on hv-cinder-75998 Feb 17 04:39:32.890210 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [req-e8b6cecd-91ff-4dd8-9dc8-caf91f0c69ab req-922ce2d6-4381-4785-aa1b-6ca37534d22e service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047726 Feb 17 04:39:32.890875 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 735/1382] 10.222.0.78 () {64 vars in 1308 bytes} [Wed Feb 17 04:39:32 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 17 04:39:33.247848 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-c86946e4-7701-4e78-9f7d-ce9835831a18 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:33.257936 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-c86946e4-7701-4e78-9f7d-ce9835831a18 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:33.259553 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-c86946e4-7701-4e78-9f7d-ce9835831a18 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:33.260694 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-c86946e4-7701-4e78-9f7d-ce9835831a18 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "GET /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550" status: 200 len: 1407 microversion: 2.20 time: 0.458712 Feb 17 04:39:33.261282 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 648/1383] 10.222.0.78 () {60 vars in 1267 bytes} [Wed Feb 17 04:39:32 2021] GET /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550 => generated 1407 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:39:33.333886 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-ae16ba0c-e412-4df2-9843-41bbd7109900 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:39:33.335017 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-ae16ba0c-e412-4df2-9843-41bbd7109900 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: d62b250c-c52b-4bd8-b6e0-b46ada9eee6f] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:33.343138 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-ae16ba0c-e412-4df2-9843-41bbd7109900 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:33.343645 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-ae16ba0c-e412-4df2-9843-41bbd7109900 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:33.345017 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-ae16ba0c-e412-4df2-9843-41bbd7109900 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:33.345509 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-ae16ba0c-e412-4df2-9843-41bbd7109900 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:33.473487 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-ae16ba0c-e412-4df2-9843-41bbd7109900 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "POST /compute/v2.1/servers/d62b250c-c52b-4bd8-b6e0-b46ada9eee6f/action" status: 200 len: 28699 microversion: 2.1 time: 0.143974 Feb 17 04:39:33.477646 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 736/1384] 10.222.0.78 () {60 vars in 1268 bytes} [Wed Feb 17 04:39:33 2021] POST /compute/v2.1/servers/d62b250c-c52b-4bd8-b6e0-b46ada9eee6f/action => generated 28699 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 04:39:34.279441 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-58359f28-550d-488a-b1c2-b717e44e229e tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:39:34.280116 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-58359f28-550d-488a-b1c2-b717e44e229e tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 5e68206c-24dc-4ec9-b907-bf233d27d550] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:34.289369 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-58359f28-550d-488a-b1c2-b717e44e229e tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:34.289886 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-58359f28-550d-488a-b1c2-b717e44e229e tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:34.290734 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-58359f28-550d-488a-b1c2-b717e44e229e tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:34.291284 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-58359f28-550d-488a-b1c2-b717e44e229e tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:34.487893 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-ee844c9c-9592-4e19-877a-7ec30b99cdef tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:39:34.489035 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-ee844c9c-9592-4e19-877a-7ec30b99cdef tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: d62b250c-c52b-4bd8-b6e0-b46ada9eee6f] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:34.497601 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-ee844c9c-9592-4e19-877a-7ec30b99cdef tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:34.498109 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-ee844c9c-9592-4e19-877a-7ec30b99cdef tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:34.498948 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-ee844c9c-9592-4e19-877a-7ec30b99cdef tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:34.499493 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-ee844c9c-9592-4e19-877a-7ec30b99cdef tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:34.634846 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-ee844c9c-9592-4e19-877a-7ec30b99cdef tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "POST /compute/v2.1/servers/d62b250c-c52b-4bd8-b6e0-b46ada9eee6f/action" status: 200 len: 28699 microversion: 2.1 time: 0.152541 Feb 17 04:39:34.635855 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 737/1385] 10.222.0.78 () {60 vars in 1268 bytes} [Wed Feb 17 04:39:34 2021] POST /compute/v2.1/servers/d62b250c-c52b-4bd8-b6e0-b46ada9eee6f/action => generated 28699 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 17 04:39:34.664303 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-58359f28-550d-488a-b1c2-b717e44e229e tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:34.674426 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-58359f28-550d-488a-b1c2-b717e44e229e tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:34.676032 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-58359f28-550d-488a-b1c2-b717e44e229e tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:34.677163 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-58359f28-550d-488a-b1c2-b717e44e229e tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "GET /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550" status: 200 len: 1407 microversion: 2.20 time: 0.401903 Feb 17 04:39:34.677753 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 649/1386] 10.222.0.78 () {60 vars in 1267 bytes} [Wed Feb 17 04:39:34 2021] GET /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550 => generated 1407 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:39:35.647992 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-1b972abd-19cf-47bb-8f95-d983bae65723 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:39:35.649133 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-1b972abd-19cf-47bb-8f95-d983bae65723 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: d62b250c-c52b-4bd8-b6e0-b46ada9eee6f] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:35.658763 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-1b972abd-19cf-47bb-8f95-d983bae65723 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:35.659299 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-1b972abd-19cf-47bb-8f95-d983bae65723 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:35.660136 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-1b972abd-19cf-47bb-8f95-d983bae65723 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:35.660625 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-1b972abd-19cf-47bb-8f95-d983bae65723 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:35.696511 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-716cf146-4365-42ea-9c68-6ac3ca5c9e5f tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:39:35.697180 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-716cf146-4365-42ea-9c68-6ac3ca5c9e5f tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 5e68206c-24dc-4ec9-b907-bf233d27d550] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:35.706142 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-716cf146-4365-42ea-9c68-6ac3ca5c9e5f tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:35.706650 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-716cf146-4365-42ea-9c68-6ac3ca5c9e5f tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:35.707533 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-716cf146-4365-42ea-9c68-6ac3ca5c9e5f tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:35.708030 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-716cf146-4365-42ea-9c68-6ac3ca5c9e5f tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:35.796358 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-1b972abd-19cf-47bb-8f95-d983bae65723 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "POST /compute/v2.1/servers/d62b250c-c52b-4bd8-b6e0-b46ada9eee6f/action" status: 200 len: 28699 microversion: 2.1 time: 0.152529 Feb 17 04:39:35.798065 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 738/1387] 10.222.0.78 () {60 vars in 1268 bytes} [Wed Feb 17 04:39:35 2021] POST /compute/v2.1/servers/d62b250c-c52b-4bd8-b6e0-b46ada9eee6f/action => generated 28699 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 04:39:35.919808 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-716cf146-4365-42ea-9c68-6ac3ca5c9e5f tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:35.929329 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-716cf146-4365-42ea-9c68-6ac3ca5c9e5f tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:35.930907 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-716cf146-4365-42ea-9c68-6ac3ca5c9e5f tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:35.932065 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-716cf146-4365-42ea-9c68-6ac3ca5c9e5f tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "GET /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550" status: 200 len: 1407 microversion: 2.20 time: 0.239604 Feb 17 04:39:35.932659 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 650/1388] 10.222.0.78 () {60 vars in 1267 bytes} [Wed Feb 17 04:39:35 2021] GET /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550 => generated 1407 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 17 04:39:36.810525 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-e2cca891-cf36-4079-9b07-f8749b7c9b71 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:39:36.811688 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-e2cca891-cf36-4079-9b07-f8749b7c9b71 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: d62b250c-c52b-4bd8-b6e0-b46ada9eee6f] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:36.821404 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-e2cca891-cf36-4079-9b07-f8749b7c9b71 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:36.821908 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-e2cca891-cf36-4079-9b07-f8749b7c9b71 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:36.822744 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-e2cca891-cf36-4079-9b07-f8749b7c9b71 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:36.823291 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-e2cca891-cf36-4079-9b07-f8749b7c9b71 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:36.952148 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-f5c06df1-09a2-4735-8ece-ec77c79983d4 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:39:36.952778 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-e2cca891-cf36-4079-9b07-f8749b7c9b71 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "POST /compute/v2.1/servers/d62b250c-c52b-4bd8-b6e0-b46ada9eee6f/action" status: 200 len: 28699 microversion: 2.1 time: 0.146558 Feb 17 04:39:36.952918 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-f5c06df1-09a2-4735-8ece-ec77c79983d4 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 5e68206c-24dc-4ec9-b907-bf233d27d550] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:36.953707 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 739/1389] 10.222.0.78 () {60 vars in 1268 bytes} [Wed Feb 17 04:39:36 2021] POST /compute/v2.1/servers/d62b250c-c52b-4bd8-b6e0-b46ada9eee6f/action => generated 28699 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 04:39:36.961519 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-f5c06df1-09a2-4735-8ece-ec77c79983d4 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:36.962030 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-f5c06df1-09a2-4735-8ece-ec77c79983d4 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:36.962883 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-f5c06df1-09a2-4735-8ece-ec77c79983d4 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:36.963413 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-f5c06df1-09a2-4735-8ece-ec77c79983d4 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:37.182258 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-f5c06df1-09a2-4735-8ece-ec77c79983d4 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:37.192452 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-f5c06df1-09a2-4735-8ece-ec77c79983d4 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:37.194045 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-f5c06df1-09a2-4735-8ece-ec77c79983d4 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:37.195224 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-f5c06df1-09a2-4735-8ece-ec77c79983d4 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "GET /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550" status: 200 len: 1407 microversion: 2.20 time: 0.247889 Feb 17 04:39:37.195818 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 651/1390] 10.222.0.78 () {60 vars in 1267 bytes} [Wed Feb 17 04:39:36 2021] GET /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550 => generated 1407 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:39:37.966483 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-1e972ada-de3a-4862-93dd-66cfc6ebe6a3 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:39:37.967708 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-1e972ada-de3a-4862-93dd-66cfc6ebe6a3 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: d62b250c-c52b-4bd8-b6e0-b46ada9eee6f] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:37.976450 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-1e972ada-de3a-4862-93dd-66cfc6ebe6a3 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:37.976966 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-1e972ada-de3a-4862-93dd-66cfc6ebe6a3 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:37.977812 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-1e972ada-de3a-4862-93dd-66cfc6ebe6a3 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:37.978309 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-1e972ada-de3a-4862-93dd-66cfc6ebe6a3 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:38.117206 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-1e972ada-de3a-4862-93dd-66cfc6ebe6a3 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "POST /compute/v2.1/servers/d62b250c-c52b-4bd8-b6e0-b46ada9eee6f/action" status: 200 len: 28928 microversion: 2.1 time: 0.155125 Feb 17 04:39:38.118167 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 740/1391] 10.222.0.78 () {60 vars in 1268 bytes} [Wed Feb 17 04:39:37 2021] POST /compute/v2.1/servers/d62b250c-c52b-4bd8-b6e0-b46ada9eee6f/action => generated 28928 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 04:39:38.214884 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-661faaa7-f535-4a58-95fd-124eef5353f3 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:39:38.215585 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-661faaa7-f535-4a58-95fd-124eef5353f3 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 5e68206c-24dc-4ec9-b907-bf233d27d550] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:38.224161 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-661faaa7-f535-4a58-95fd-124eef5353f3 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:38.224675 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-661faaa7-f535-4a58-95fd-124eef5353f3 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:38.225519 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-661faaa7-f535-4a58-95fd-124eef5353f3 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:38.226017 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-661faaa7-f535-4a58-95fd-124eef5353f3 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:38.435523 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-661faaa7-f535-4a58-95fd-124eef5353f3 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:38.445050 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-661faaa7-f535-4a58-95fd-124eef5353f3 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:38.446637 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-661faaa7-f535-4a58-95fd-124eef5353f3 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:38.447802 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-661faaa7-f535-4a58-95fd-124eef5353f3 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "GET /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550" status: 200 len: 1407 microversion: 2.20 time: 0.236989 Feb 17 04:39:38.448395 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 652/1392] 10.222.0.78 () {60 vars in 1267 bytes} [Wed Feb 17 04:39:38 2021] GET /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550 => generated 1407 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:39:39.130034 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-5d2b27de-034e-4c07-a58e-c92358ca9393 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:39:39.131228 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-5d2b27de-034e-4c07-a58e-c92358ca9393 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: d62b250c-c52b-4bd8-b6e0-b46ada9eee6f] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:39.140065 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-5d2b27de-034e-4c07-a58e-c92358ca9393 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:39.140576 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-5d2b27de-034e-4c07-a58e-c92358ca9393 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:39.142779 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-5d2b27de-034e-4c07-a58e-c92358ca9393 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:39.143305 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-5d2b27de-034e-4c07-a58e-c92358ca9393 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:39.306073 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-5d2b27de-034e-4c07-a58e-c92358ca9393 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "POST /compute/v2.1/servers/d62b250c-c52b-4bd8-b6e0-b46ada9eee6f/action" status: 200 len: 30763 microversion: 2.1 time: 0.181071 Feb 17 04:39:39.306768 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 741/1393] 10.222.0.78 () {60 vars in 1268 bytes} [Wed Feb 17 04:39:39 2021] POST /compute/v2.1/servers/d62b250c-c52b-4bd8-b6e0-b46ada9eee6f/action => generated 30763 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 04:39:39.466027 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-516c3574-65e3-4fcc-a761-aa3c954733de tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:39:39.466754 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-516c3574-65e3-4fcc-a761-aa3c954733de tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 5e68206c-24dc-4ec9-b907-bf233d27d550] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:39.475496 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-516c3574-65e3-4fcc-a761-aa3c954733de tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:39.476011 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-516c3574-65e3-4fcc-a761-aa3c954733de tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:39.476867 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-516c3574-65e3-4fcc-a761-aa3c954733de tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:39.477372 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-516c3574-65e3-4fcc-a761-aa3c954733de tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:39.603265 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [req-e795073a-fe86-4553-a34f-62358b515e5d req-c47d8457-08c4-412a-8844-ed9e68feb309 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e68206c-24dc-4ec9-b907-bf233d27d550", "name": "network-vif-plugged", "status": "completed", "tag": "11791c9e-fcaf-4d11-8104-b4270f0591a6"}]} {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:39:39.605043 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:39:39.605043 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: warnings.warn(msg) Feb 17 04:39:39.615914 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [req-e795073a-fe86-4553-a34f-62358b515e5d req-c47d8457-08c4-412a-8844-ed9e68feb309 service nova] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:39.616163 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [req-e795073a-fe86-4553-a34f-62358b515e5d req-c47d8457-08c4-412a-8844-ed9e68feb309 service nova] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:39.634063 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.compute.server_external_events [req-e795073a-fe86-4553-a34f-62358b515e5d req-c47d8457-08c4-412a-8844-ed9e68feb309 service nova] Creating event network-vif-plugged:11791c9e-fcaf-4d11-8104-b4270f0591a6 for instance 5e68206c-24dc-4ec9-b907-bf233d27d550 on hv-cinder-75998 Feb 17 04:39:39.639114 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [req-e795073a-fe86-4553-a34f-62358b515e5d req-c47d8457-08c4-412a-8844-ed9e68feb309 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040826 Feb 17 04:39:39.639976 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 742/1394] 10.222.0.78 () {64 vars in 1308 bytes} [Wed Feb 17 04:39:39 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:39:39.700831 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-516c3574-65e3-4fcc-a761-aa3c954733de tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:39.711002 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-516c3574-65e3-4fcc-a761-aa3c954733de tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:39.712639 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-516c3574-65e3-4fcc-a761-aa3c954733de tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:39.713784 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-516c3574-65e3-4fcc-a761-aa3c954733de tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "GET /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550" status: 200 len: 1407 microversion: 2.20 time: 0.251816 Feb 17 04:39:39.714376 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 653/1395] 10.222.0.78 () {60 vars in 1267 bytes} [Wed Feb 17 04:39:39 2021] GET /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550 => generated 1407 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:39:40.320690 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-b758a0c4-acd1-4d68-a451-c74fc58741b7 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:39:40.321828 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-b758a0c4-acd1-4d68-a451-c74fc58741b7 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: d62b250c-c52b-4bd8-b6e0-b46ada9eee6f] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:40.330859 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-b758a0c4-acd1-4d68-a451-c74fc58741b7 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:40.331391 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-b758a0c4-acd1-4d68-a451-c74fc58741b7 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:40.332231 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-b758a0c4-acd1-4d68-a451-c74fc58741b7 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:40.332724 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-b758a0c4-acd1-4d68-a451-c74fc58741b7 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:40.479811 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-b758a0c4-acd1-4d68-a451-c74fc58741b7 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "POST /compute/v2.1/servers/d62b250c-c52b-4bd8-b6e0-b46ada9eee6f/action" status: 200 len: 32246 microversion: 2.1 time: 0.164133 Feb 17 04:39:40.480502 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 743/1396] 10.222.0.78 () {60 vars in 1268 bytes} [Wed Feb 17 04:39:40 2021] POST /compute/v2.1/servers/d62b250c-c52b-4bd8-b6e0-b46ada9eee6f/action => generated 32246 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 04:39:40.733962 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-f9a23ac3-f71d-49dd-b848-aeb851830246 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:39:40.734631 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-f9a23ac3-f71d-49dd-b848-aeb851830246 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 5e68206c-24dc-4ec9-b907-bf233d27d550] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:40.743309 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-f9a23ac3-f71d-49dd-b848-aeb851830246 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:40.743818 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-f9a23ac3-f71d-49dd-b848-aeb851830246 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:40.744655 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-f9a23ac3-f71d-49dd-b848-aeb851830246 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:40.745143 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-f9a23ac3-f71d-49dd-b848-aeb851830246 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:40.962355 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-f9a23ac3-f71d-49dd-b848-aeb851830246 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:40.971938 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-f9a23ac3-f71d-49dd-b848-aeb851830246 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:40.973497 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-f9a23ac3-f71d-49dd-b848-aeb851830246 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:40.974625 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-f9a23ac3-f71d-49dd-b848-aeb851830246 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "GET /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550" status: 200 len: 1407 microversion: 2.20 time: 0.245037 Feb 17 04:39:40.975232 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 654/1397] 10.222.0.78 () {60 vars in 1267 bytes} [Wed Feb 17 04:39:40 2021] GET /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550 => generated 1407 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:39:41.494022 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-6cae6ba8-9e3d-40ae-98b9-0a2621d9b3ee tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:39:41.495188 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-6cae6ba8-9e3d-40ae-98b9-0a2621d9b3ee tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: d62b250c-c52b-4bd8-b6e0-b46ada9eee6f] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:41.504279 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-6cae6ba8-9e3d-40ae-98b9-0a2621d9b3ee tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:41.504782 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-6cae6ba8-9e3d-40ae-98b9-0a2621d9b3ee tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:41.505607 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-6cae6ba8-9e3d-40ae-98b9-0a2621d9b3ee tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:41.506092 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-6cae6ba8-9e3d-40ae-98b9-0a2621d9b3ee tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:41.683229 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-6cae6ba8-9e3d-40ae-98b9-0a2621d9b3ee tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "POST /compute/v2.1/servers/d62b250c-c52b-4bd8-b6e0-b46ada9eee6f/action" status: 200 len: 33375 microversion: 2.1 time: 0.193731 Feb 17 04:39:41.683969 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 744/1398] 10.222.0.78 () {60 vars in 1268 bytes} [Wed Feb 17 04:39:41 2021] POST /compute/v2.1/servers/d62b250c-c52b-4bd8-b6e0-b46ada9eee6f/action => generated 33375 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 04:39:41.994127 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-5e0cf2f7-e9ae-4e69-b32a-bc33a3f4027e tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:39:41.994799 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-5e0cf2f7-e9ae-4e69-b32a-bc33a3f4027e tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 5e68206c-24dc-4ec9-b907-bf233d27d550] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:42.003668 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-5e0cf2f7-e9ae-4e69-b32a-bc33a3f4027e tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:42.004190 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-5e0cf2f7-e9ae-4e69-b32a-bc33a3f4027e tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:42.005051 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-5e0cf2f7-e9ae-4e69-b32a-bc33a3f4027e tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:42.005556 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-5e0cf2f7-e9ae-4e69-b32a-bc33a3f4027e tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:42.232125 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-5e0cf2f7-e9ae-4e69-b32a-bc33a3f4027e tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:42.242578 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-5e0cf2f7-e9ae-4e69-b32a-bc33a3f4027e tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:42.244233 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-5e0cf2f7-e9ae-4e69-b32a-bc33a3f4027e tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:42.245374 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-5e0cf2f7-e9ae-4e69-b32a-bc33a3f4027e tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "GET /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550" status: 200 len: 1599 microversion: 2.20 time: 0.255417 Feb 17 04:39:42.245965 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 655/1399] 10.222.0.78 () {60 vars in 1267 bytes} [Wed Feb 17 04:39:41 2021] GET /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550 => generated 1599 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:39:42.264642 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-63a8bf68-0712-406f-92cc-da0bc9782db0 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:39:42.265287 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-63a8bf68-0712-406f-92cc-da0bc9782db0 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 5e68206c-24dc-4ec9-b907-bf233d27d550] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:42.274014 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-63a8bf68-0712-406f-92cc-da0bc9782db0 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:42.274517 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-63a8bf68-0712-406f-92cc-da0bc9782db0 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:42.275374 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-63a8bf68-0712-406f-92cc-da0bc9782db0 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:42.275863 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-63a8bf68-0712-406f-92cc-da0bc9782db0 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:42.434452 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-63a8bf68-0712-406f-92cc-da0bc9782db0 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "GET /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.174251 Feb 17 04:39:42.435140 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 745/1400] 10.222.0.78 () {60 vars in 1306 bytes} [Wed Feb 17 04:39:42 2021] GET /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550/os-interface => generated 284 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 04:39:42.695913 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-7e5d1abb-8c7d-4932-9374-247de9cc9995 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:39:42.697045 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-7e5d1abb-8c7d-4932-9374-247de9cc9995 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: d62b250c-c52b-4bd8-b6e0-b46ada9eee6f] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:42.705797 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-7e5d1abb-8c7d-4932-9374-247de9cc9995 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:42.706320 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-7e5d1abb-8c7d-4932-9374-247de9cc9995 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:42.707236 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-7e5d1abb-8c7d-4932-9374-247de9cc9995 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:42.707741 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-7e5d1abb-8c7d-4932-9374-247de9cc9995 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:42.849120 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-7e5d1abb-8c7d-4932-9374-247de9cc9995 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "POST /compute/v2.1/servers/d62b250c-c52b-4bd8-b6e0-b46ada9eee6f/action" status: 200 len: 34125 microversion: 2.1 time: 0.156792 Feb 17 04:39:42.850379 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 656/1401] 10.222.0.78 () {60 vars in 1268 bytes} [Wed Feb 17 04:39:42 2021] POST /compute/v2.1/servers/d62b250c-c52b-4bd8-b6e0-b46ada9eee6f/action => generated 34125 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 04:39:43.863569 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-bd13f5ee-43df-451a-af2a-b562f46fd3fe tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:39:43.864600 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-bd13f5ee-43df-451a-af2a-b562f46fd3fe tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: d62b250c-c52b-4bd8-b6e0-b46ada9eee6f] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:43.872633 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-bd13f5ee-43df-451a-af2a-b562f46fd3fe tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:43.873151 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-bd13f5ee-43df-451a-af2a-b562f46fd3fe tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:43.873987 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-bd13f5ee-43df-451a-af2a-b562f46fd3fe tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:43.874479 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-bd13f5ee-43df-451a-af2a-b562f46fd3fe tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:44.010542 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-bd13f5ee-43df-451a-af2a-b562f46fd3fe tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "POST /compute/v2.1/servers/d62b250c-c52b-4bd8-b6e0-b46ada9eee6f/action" status: 200 len: 35035 microversion: 2.1 time: 0.151820 Feb 17 04:39:44.011919 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 746/1402] 10.222.0.78 () {60 vars in 1268 bytes} [Wed Feb 17 04:39:43 2021] POST /compute/v2.1/servers/d62b250c-c52b-4bd8-b6e0-b46ada9eee6f/action => generated 35035 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 17 04:39:44.020847 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-57b28f85-62f6-41e7-bd9f-a4f0e2b56a85 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:39:44.022073 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-57b28f85-62f6-41e7-bd9f-a4f0e2b56a85 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 5e68206c-24dc-4ec9-b907-bf233d27d550] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:44.031678 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-57b28f85-62f6-41e7-bd9f-a4f0e2b56a85 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:44.032267 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-57b28f85-62f6-41e7-bd9f-a4f0e2b56a85 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:44.033203 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-57b28f85-62f6-41e7-bd9f-a4f0e2b56a85 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:44.033769 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-57b28f85-62f6-41e7-bd9f-a4f0e2b56a85 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:44.083210 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [req-2e5aa74f-9aa0-40bb-87ff-c5fce71c8086 req-62126673-8784-4c00-9d0c-62b0f27003d1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5e68206c-24dc-4ec9-b907-bf233d27d550", "tag": "11791c9e-fcaf-4d11-8104-b4270f0591a6"}]} {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:39:44.085003 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:39:44.085003 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: warnings.warn(msg) Feb 17 04:39:44.094395 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [req-2e5aa74f-9aa0-40bb-87ff-c5fce71c8086 req-62126673-8784-4c00-9d0c-62b0f27003d1 service nova] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:44.094994 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [req-2e5aa74f-9aa0-40bb-87ff-c5fce71c8086 req-62126673-8784-4c00-9d0c-62b0f27003d1 service nova] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:44.113405 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.compute.server_external_events [req-2e5aa74f-9aa0-40bb-87ff-c5fce71c8086 req-62126673-8784-4c00-9d0c-62b0f27003d1 service nova] Creating event network-changed:11791c9e-fcaf-4d11-8104-b4270f0591a6 for instance 5e68206c-24dc-4ec9-b907-bf233d27d550 on hv-cinder-75998 Feb 17 04:39:44.118291 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [req-2e5aa74f-9aa0-40bb-87ff-c5fce71c8086 req-62126673-8784-4c00-9d0c-62b0f27003d1 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099302 Feb 17 04:39:44.118943 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 747/1403] 10.222.0.78 () {64 vars in 1308 bytes} [Wed Feb 17 04:39:44 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:39:44.200259 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-57b28f85-62f6-41e7-bd9f-a4f0e2b56a85 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "POST /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550/action" status: 200 len: 14 microversion: 2.20 time: 0.184440 Feb 17 04:39:44.201303 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 657/1404] 10.222.0.78 () {62 vars in 1309 bytes} [Wed Feb 17 04:39:44 2021] POST /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550/action => generated 14 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:39:45.026545 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-26298f4d-fe2c-48d6-acbf-01b95f653ad7 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:39:45.027983 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-26298f4d-fe2c-48d6-acbf-01b95f653ad7 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: d62b250c-c52b-4bd8-b6e0-b46ada9eee6f] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:45.038672 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-26298f4d-fe2c-48d6-acbf-01b95f653ad7 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:45.038924 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-26298f4d-fe2c-48d6-acbf-01b95f653ad7 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:45.039801 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-26298f4d-fe2c-48d6-acbf-01b95f653ad7 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:45.040286 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-26298f4d-fe2c-48d6-acbf-01b95f653ad7 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:45.181899 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-26298f4d-fe2c-48d6-acbf-01b95f653ad7 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "POST /compute/v2.1/servers/d62b250c-c52b-4bd8-b6e0-b46ada9eee6f/action" status: 200 len: 35998 microversion: 2.1 time: 0.159701 Feb 17 04:39:45.183683 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 748/1405] 10.222.0.78 () {60 vars in 1268 bytes} [Wed Feb 17 04:39:45 2021] POST /compute/v2.1/servers/d62b250c-c52b-4bd8-b6e0-b46ada9eee6f/action => generated 35998 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 04:39:45.213880 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-703c6642-01bb-456d-b290-1103f66a3343 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:39:45.215077 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-703c6642-01bb-456d-b290-1103f66a3343 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 5e68206c-24dc-4ec9-b907-bf233d27d550] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:45.224025 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-703c6642-01bb-456d-b290-1103f66a3343 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:45.224528 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-703c6642-01bb-456d-b290-1103f66a3343 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:45.225365 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-703c6642-01bb-456d-b290-1103f66a3343 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:45.225855 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-703c6642-01bb-456d-b290-1103f66a3343 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:45.387490 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-703c6642-01bb-456d-b290-1103f66a3343 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "POST /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550/action" status: 200 len: 14 microversion: 2.20 time: 0.177943 Feb 17 04:39:45.388192 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 658/1406] 10.222.0.78 () {62 vars in 1309 bytes} [Wed Feb 17 04:39:45 2021] POST /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550/action => generated 14 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:39:46.195188 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-c160b79b-70f9-4d73-8fe1-37a1c8278ef2 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:39:46.196420 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-c160b79b-70f9-4d73-8fe1-37a1c8278ef2 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: d62b250c-c52b-4bd8-b6e0-b46ada9eee6f] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:46.205183 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-c160b79b-70f9-4d73-8fe1-37a1c8278ef2 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:46.205691 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-c160b79b-70f9-4d73-8fe1-37a1c8278ef2 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:46.206535 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-c160b79b-70f9-4d73-8fe1-37a1c8278ef2 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:46.207075 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-c160b79b-70f9-4d73-8fe1-37a1c8278ef2 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:46.350676 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-c160b79b-70f9-4d73-8fe1-37a1c8278ef2 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "POST /compute/v2.1/servers/d62b250c-c52b-4bd8-b6e0-b46ada9eee6f/action" status: 200 len: 37319 microversion: 2.1 time: 0.159949 Feb 17 04:39:46.351424 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 749/1407] 10.222.0.78 () {60 vars in 1268 bytes} [Wed Feb 17 04:39:46 2021] POST /compute/v2.1/servers/d62b250c-c52b-4bd8-b6e0-b46ada9eee6f/action => generated 37319 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 04:39:46.400855 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-914b050f-2829-411f-a863-9b45323c3b8b tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:39:46.402071 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-914b050f-2829-411f-a863-9b45323c3b8b tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 5e68206c-24dc-4ec9-b907-bf233d27d550] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:46.411696 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-914b050f-2829-411f-a863-9b45323c3b8b tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:46.412191 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-914b050f-2829-411f-a863-9b45323c3b8b tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:46.413025 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-914b050f-2829-411f-a863-9b45323c3b8b tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:46.413511 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-914b050f-2829-411f-a863-9b45323c3b8b tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:46.546460 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-914b050f-2829-411f-a863-9b45323c3b8b tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "POST /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550/action" status: 200 len: 14 microversion: 2.20 time: 0.150034 Feb 17 04:39:46.547764 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 659/1408] 10.222.0.78 () {62 vars in 1309 bytes} [Wed Feb 17 04:39:46 2021] POST /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550/action => generated 14 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:39:47.365429 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-c512aec2-d833-4302-b774-d50b206b13df tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:39:47.366486 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-c512aec2-d833-4302-b774-d50b206b13df tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: d62b250c-c52b-4bd8-b6e0-b46ada9eee6f] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:47.374840 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-c512aec2-d833-4302-b774-d50b206b13df tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:47.376061 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-c512aec2-d833-4302-b774-d50b206b13df tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:47.377287 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-c512aec2-d833-4302-b774-d50b206b13df tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:47.377782 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-c512aec2-d833-4302-b774-d50b206b13df tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:47.528671 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-c512aec2-d833-4302-b774-d50b206b13df tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "POST /compute/v2.1/servers/d62b250c-c52b-4bd8-b6e0-b46ada9eee6f/action" status: 200 len: 38227 microversion: 2.1 time: 0.168775 Feb 17 04:39:47.529356 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 750/1409] 10.222.0.78 () {60 vars in 1268 bytes} [Wed Feb 17 04:39:47 2021] POST /compute/v2.1/servers/d62b250c-c52b-4bd8-b6e0-b46ada9eee6f/action => generated 38227 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 04:39:47.558844 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-00fa120e-051a-4d0a-97cb-1683fb35f702 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:39:47.560092 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-00fa120e-051a-4d0a-97cb-1683fb35f702 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 5e68206c-24dc-4ec9-b907-bf233d27d550] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:47.568887 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-00fa120e-051a-4d0a-97cb-1683fb35f702 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:47.569403 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-00fa120e-051a-4d0a-97cb-1683fb35f702 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:47.570248 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-00fa120e-051a-4d0a-97cb-1683fb35f702 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:47.570748 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-00fa120e-051a-4d0a-97cb-1683fb35f702 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:47.707491 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-00fa120e-051a-4d0a-97cb-1683fb35f702 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "POST /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550/action" status: 200 len: 14 microversion: 2.20 time: 0.152818 Feb 17 04:39:47.708095 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 660/1410] 10.222.0.78 () {62 vars in 1309 bytes} [Wed Feb 17 04:39:47 2021] POST /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550/action => generated 14 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:39:48.542599 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-c0b21282-9b13-43bd-b3ff-3c45d003e846 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:39:48.543786 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-c0b21282-9b13-43bd-b3ff-3c45d003e846 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: d62b250c-c52b-4bd8-b6e0-b46ada9eee6f] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:48.553084 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-c0b21282-9b13-43bd-b3ff-3c45d003e846 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:48.553600 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-c0b21282-9b13-43bd-b3ff-3c45d003e846 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:48.554439 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-c0b21282-9b13-43bd-b3ff-3c45d003e846 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:48.554935 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-c0b21282-9b13-43bd-b3ff-3c45d003e846 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:48.684747 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-c0b21282-9b13-43bd-b3ff-3c45d003e846 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "POST /compute/v2.1/servers/d62b250c-c52b-4bd8-b6e0-b46ada9eee6f/action" status: 200 len: 38227 microversion: 2.1 time: 0.146438 Feb 17 04:39:48.685764 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 751/1411] 10.222.0.78 () {60 vars in 1268 bytes} [Wed Feb 17 04:39:48 2021] POST /compute/v2.1/servers/d62b250c-c52b-4bd8-b6e0-b46ada9eee6f/action => generated 38227 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 04:39:48.719911 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-33cf9144-61c9-4fb8-b11e-1318b8d9ae8d tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:39:48.721050 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-33cf9144-61c9-4fb8-b11e-1318b8d9ae8d tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 5e68206c-24dc-4ec9-b907-bf233d27d550] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:48.730474 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-33cf9144-61c9-4fb8-b11e-1318b8d9ae8d tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:48.731200 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-33cf9144-61c9-4fb8-b11e-1318b8d9ae8d tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:48.732070 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-33cf9144-61c9-4fb8-b11e-1318b8d9ae8d tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:48.732842 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-33cf9144-61c9-4fb8-b11e-1318b8d9ae8d tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:48.874584 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-33cf9144-61c9-4fb8-b11e-1318b8d9ae8d tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "POST /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550/action" status: 200 len: 14 microversion: 2.20 time: 0.159178 Feb 17 04:39:48.875239 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 661/1412] 10.222.0.78 () {62 vars in 1309 bytes} [Wed Feb 17 04:39:48 2021] POST /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550/action => generated 14 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:39:49.702450 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-5d2694b4-e9a3-49f5-b872-836fcfcb3962 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:39:49.704299 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-5d2694b4-e9a3-49f5-b872-836fcfcb3962 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: d62b250c-c52b-4bd8-b6e0-b46ada9eee6f] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:49.713808 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-5d2694b4-e9a3-49f5-b872-836fcfcb3962 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:49.714318 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-5d2694b4-e9a3-49f5-b872-836fcfcb3962 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:49.715202 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-5d2694b4-e9a3-49f5-b872-836fcfcb3962 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:49.715698 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-5d2694b4-e9a3-49f5-b872-836fcfcb3962 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:49.880560 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-5d2694b4-e9a3-49f5-b872-836fcfcb3962 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "POST /compute/v2.1/servers/d62b250c-c52b-4bd8-b6e0-b46ada9eee6f/action" status: 200 len: 38227 microversion: 2.1 time: 0.185125 Feb 17 04:39:49.882251 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 752/1413] 10.222.0.78 () {60 vars in 1268 bytes} [Wed Feb 17 04:39:49 2021] POST /compute/v2.1/servers/d62b250c-c52b-4bd8-b6e0-b46ada9eee6f/action => generated 38227 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 04:39:49.888541 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-3bc7e38d-84e5-4a42-8432-134cf906580f tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:39:49.889704 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-3bc7e38d-84e5-4a42-8432-134cf906580f tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 5e68206c-24dc-4ec9-b907-bf233d27d550] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:49.900197 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-3bc7e38d-84e5-4a42-8432-134cf906580f tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:49.900715 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-3bc7e38d-84e5-4a42-8432-134cf906580f tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:49.901581 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-3bc7e38d-84e5-4a42-8432-134cf906580f tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:49.902083 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-3bc7e38d-84e5-4a42-8432-134cf906580f tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:50.031313 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-3bc7e38d-84e5-4a42-8432-134cf906580f tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "POST /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550/action" status: 200 len: 14 microversion: 2.20 time: 0.148597 Feb 17 04:39:50.032616 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 662/1414] 10.222.0.78 () {62 vars in 1309 bytes} [Wed Feb 17 04:39:49 2021] POST /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550/action => generated 14 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:39:50.899227 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-7960ad40-6d1a-435b-ba4f-415afb23c017 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:39:50.900459 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-7960ad40-6d1a-435b-ba4f-415afb23c017 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: d62b250c-c52b-4bd8-b6e0-b46ada9eee6f] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:50.909959 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-7960ad40-6d1a-435b-ba4f-415afb23c017 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:50.910481 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-7960ad40-6d1a-435b-ba4f-415afb23c017 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:50.911354 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-7960ad40-6d1a-435b-ba4f-415afb23c017 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:50.911852 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-7960ad40-6d1a-435b-ba4f-415afb23c017 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:51.043284 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-2d45c8ac-193f-45d6-aac2-aa7eb1ad42f3 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:39:51.044411 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-2d45c8ac-193f-45d6-aac2-aa7eb1ad42f3 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 5e68206c-24dc-4ec9-b907-bf233d27d550] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:51.053170 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-2d45c8ac-193f-45d6-aac2-aa7eb1ad42f3 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:51.053674 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-2d45c8ac-193f-45d6-aac2-aa7eb1ad42f3 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:51.054148 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-7960ad40-6d1a-435b-ba4f-415afb23c017 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "POST /compute/v2.1/servers/d62b250c-c52b-4bd8-b6e0-b46ada9eee6f/action" status: 200 len: 38358 microversion: 2.1 time: 0.159141 Feb 17 04:39:51.054514 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-2d45c8ac-193f-45d6-aac2-aa7eb1ad42f3 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:51.059982 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 753/1415] 10.222.0.78 () {60 vars in 1268 bytes} [Wed Feb 17 04:39:50 2021] POST /compute/v2.1/servers/d62b250c-c52b-4bd8-b6e0-b46ada9eee6f/action => generated 38358 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 04:39:51.060135 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-2d45c8ac-193f-45d6-aac2-aa7eb1ad42f3 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:51.066043 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-5f479df5-a590-40f9-8cef-1dc098468a22 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:39:51.066697 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-5f479df5-a590-40f9-8cef-1dc098468a22 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: d62b250c-c52b-4bd8-b6e0-b46ada9eee6f] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:51.075332 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-5f479df5-a590-40f9-8cef-1dc098468a22 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:51.075848 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-5f479df5-a590-40f9-8cef-1dc098468a22 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:51.076700 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-5f479df5-a590-40f9-8cef-1dc098468a22 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:51.077197 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-5f479df5-a590-40f9-8cef-1dc098468a22 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:51.139811 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-5f479df5-a590-40f9-8cef-1dc098468a22 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "GET /compute/v2.1/servers/d62b250c-c52b-4bd8-b6e0-b46ada9eee6f/ips" status: 200 len: 146 microversion: 2.1 time: 0.078372 Feb 17 04:39:51.140459 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 754/1416] 10.222.0.78 () {58 vars in 1238 bytes} [Wed Feb 17 04:39:51 2021] GET /compute/v2.1/servers/d62b250c-c52b-4bd8-b6e0-b46ada9eee6f/ips => generated 146 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:39:51.183316 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-2d45c8ac-193f-45d6-aac2-aa7eb1ad42f3 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "POST /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550/action" status: 200 len: 14 microversion: 2.20 time: 0.144274 Feb 17 04:39:51.184051 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 663/1417] 10.222.0.78 () {62 vars in 1309 bytes} [Wed Feb 17 04:39:51 2021] POST /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550/action => generated 14 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:39:52.195372 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-cc3a390d-d725-4f79-a490-f09c39febdce tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:39:52.196426 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-cc3a390d-d725-4f79-a490-f09c39febdce tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 5e68206c-24dc-4ec9-b907-bf233d27d550] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:52.205386 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-cc3a390d-d725-4f79-a490-f09c39febdce tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:52.205894 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-cc3a390d-d725-4f79-a490-f09c39febdce tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:52.206735 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-cc3a390d-d725-4f79-a490-f09c39febdce tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:52.207265 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-cc3a390d-d725-4f79-a490-f09c39febdce tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:52.360479 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-cc3a390d-d725-4f79-a490-f09c39febdce tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "POST /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550/action" status: 200 len: 14 microversion: 2.20 time: 0.168559 Feb 17 04:39:52.361175 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 755/1418] 10.222.0.78 () {62 vars in 1309 bytes} [Wed Feb 17 04:39:52 2021] POST /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550/action => generated 14 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:39:52.703975 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-d6445155-e8d2-4c64-9fa7-fd16d4b7fd18 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d0694c30-93e2-4daa-871d-173e6e32c75c"}} {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:39:52.705277 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-d6445155-e8d2-4c64-9fa7-fd16d4b7fd18 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: d62b250c-c52b-4bd8-b6e0-b46ada9eee6f] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:52.713832 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-d6445155-e8d2-4c64-9fa7-fd16d4b7fd18 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:52.714337 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-d6445155-e8d2-4c64-9fa7-fd16d4b7fd18 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:52.715192 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-d6445155-e8d2-4c64-9fa7-fd16d4b7fd18 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:52.715684 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-d6445155-e8d2-4c64-9fa7-fd16d4b7fd18 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:53.105686 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-d6445155-e8d2-4c64-9fa7-fd16d4b7fd18 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "POST /compute/v2.1/servers/d62b250c-c52b-4bd8-b6e0-b46ada9eee6f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.406682 Feb 17 04:39:53.106369 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 664/1419] 10.222.0.78 () {60 vars in 1313 bytes} [Wed Feb 17 04:39:52 2021] POST /compute/v2.1/servers/d62b250c-c52b-4bd8-b6e0-b46ada9eee6f/os-volume_attachments => generated 194 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:39:53.372886 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-3e316eb0-67b7-4da6-ad36-eb141b4377e7 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:39:53.374024 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-3e316eb0-67b7-4da6-ad36-eb141b4377e7 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 5e68206c-24dc-4ec9-b907-bf233d27d550] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:53.383719 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-3e316eb0-67b7-4da6-ad36-eb141b4377e7 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:53.384226 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-3e316eb0-67b7-4da6-ad36-eb141b4377e7 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:53.385067 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-3e316eb0-67b7-4da6-ad36-eb141b4377e7 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:53.385560 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-3e316eb0-67b7-4da6-ad36-eb141b4377e7 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:53.532038 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-3e316eb0-67b7-4da6-ad36-eb141b4377e7 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "POST /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550/action" status: 200 len: 14 microversion: 2.20 time: 0.163178 Feb 17 04:39:53.532741 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 756/1420] 10.222.0.78 () {62 vars in 1309 bytes} [Wed Feb 17 04:39:53 2021] POST /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550/action => generated 14 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:39:54.544570 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-b6752c7a-c633-4afe-8adc-c40dd9f60b5d tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:39:54.545618 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-b6752c7a-c633-4afe-8adc-c40dd9f60b5d tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 5e68206c-24dc-4ec9-b907-bf233d27d550] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:54.555129 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-b6752c7a-c633-4afe-8adc-c40dd9f60b5d tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:54.555642 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-b6752c7a-c633-4afe-8adc-c40dd9f60b5d tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:54.556480 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-b6752c7a-c633-4afe-8adc-c40dd9f60b5d tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:54.556947 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-b6752c7a-c633-4afe-8adc-c40dd9f60b5d tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:54.680442 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-b6752c7a-c633-4afe-8adc-c40dd9f60b5d tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "POST /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550/action" status: 200 len: 14 microversion: 2.20 time: 0.140794 Feb 17 04:39:54.681157 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 665/1421] 10.222.0.78 () {62 vars in 1309 bytes} [Wed Feb 17 04:39:54 2021] POST /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550/action => generated 14 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:39:55.694067 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-2a33fd51-943c-4d7b-99f7-d3334e6ef225 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:39:55.695207 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-2a33fd51-943c-4d7b-99f7-d3334e6ef225 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 5e68206c-24dc-4ec9-b907-bf233d27d550] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:55.704993 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-2a33fd51-943c-4d7b-99f7-d3334e6ef225 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:55.705499 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-2a33fd51-943c-4d7b-99f7-d3334e6ef225 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:55.706332 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-2a33fd51-943c-4d7b-99f7-d3334e6ef225 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:55.706827 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-2a33fd51-943c-4d7b-99f7-d3334e6ef225 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:55.847460 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-2a33fd51-943c-4d7b-99f7-d3334e6ef225 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "POST /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550/action" status: 200 len: 3675 microversion: 2.20 time: 0.157776 Feb 17 04:39:55.848336 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 757/1422] 10.222.0.78 () {62 vars in 1309 bytes} [Wed Feb 17 04:39:55 2021] POST /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550/action => generated 3675 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:39:56.861261 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-f8a8c1df-f115-4c46-8440-ad743b5e13c8 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:39:56.862326 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-f8a8c1df-f115-4c46-8440-ad743b5e13c8 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 5e68206c-24dc-4ec9-b907-bf233d27d550] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:56.870928 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-f8a8c1df-f115-4c46-8440-ad743b5e13c8 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:56.871476 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-f8a8c1df-f115-4c46-8440-ad743b5e13c8 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:56.872323 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-f8a8c1df-f115-4c46-8440-ad743b5e13c8 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:56.872825 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-f8a8c1df-f115-4c46-8440-ad743b5e13c8 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:57.005555 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-f8a8c1df-f115-4c46-8440-ad743b5e13c8 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "POST /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550/action" status: 200 len: 14483 microversion: 2.20 time: 0.149828 Feb 17 04:39:57.006247 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 666/1423] 10.222.0.78 () {62 vars in 1309 bytes} [Wed Feb 17 04:39:56 2021] POST /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550/action => generated 14483 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:39:58.019707 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-756116ba-e7f9-48b9-9fe5-b4248d4c35ec tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:39:58.020851 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-756116ba-e7f9-48b9-9fe5-b4248d4c35ec tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 5e68206c-24dc-4ec9-b907-bf233d27d550] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:58.029398 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-756116ba-e7f9-48b9-9fe5-b4248d4c35ec tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:58.029905 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-756116ba-e7f9-48b9-9fe5-b4248d4c35ec tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:58.030743 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-756116ba-e7f9-48b9-9fe5-b4248d4c35ec tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:58.031282 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-756116ba-e7f9-48b9-9fe5-b4248d4c35ec tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:58.186110 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-756116ba-e7f9-48b9-9fe5-b4248d4c35ec tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "POST /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550/action" status: 200 len: 18356 microversion: 2.20 time: 0.171963 Feb 17 04:39:58.186819 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 758/1424] 10.222.0.78 () {62 vars in 1309 bytes} [Wed Feb 17 04:39:58 2021] POST /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550/action => generated 18356 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:39:59.199694 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-1c03b778-cef4-46d0-b34e-10b2f97a016d tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:39:59.200822 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-1c03b778-cef4-46d0-b34e-10b2f97a016d tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 5e68206c-24dc-4ec9-b907-bf233d27d550] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:59.209704 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-1c03b778-cef4-46d0-b34e-10b2f97a016d tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:59.210214 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-1c03b778-cef4-46d0-b34e-10b2f97a016d tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:59.211082 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-1c03b778-cef4-46d0-b34e-10b2f97a016d tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:59.211553 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-1c03b778-cef4-46d0-b34e-10b2f97a016d tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:59.346433 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-1c03b778-cef4-46d0-b34e-10b2f97a016d tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "POST /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550/action" status: 200 len: 19342 microversion: 2.20 time: 0.151104 Feb 17 04:39:59.347049 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 667/1425] 10.222.0.78 () {62 vars in 1309 bytes} [Wed Feb 17 04:39:59 2021] POST /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550/action => generated 19342 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:40:00.359253 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-0a879ce9-bc31-4c0d-a7fb-609ec3308e9a tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:40:00.361053 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-0a879ce9-bc31-4c0d-a7fb-609ec3308e9a tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 5e68206c-24dc-4ec9-b907-bf233d27d550] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:40:00.369489 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-0a879ce9-bc31-4c0d-a7fb-609ec3308e9a tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:00.369939 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-0a879ce9-bc31-4c0d-a7fb-609ec3308e9a tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:00.370771 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-0a879ce9-bc31-4c0d-a7fb-609ec3308e9a tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:00.371291 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-0a879ce9-bc31-4c0d-a7fb-609ec3308e9a tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:00.514313 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-0a879ce9-bc31-4c0d-a7fb-609ec3308e9a tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "POST /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550/action" status: 200 len: 21960 microversion: 2.20 time: 0.159685 Feb 17 04:40:00.515048 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 759/1426] 10.222.0.78 () {62 vars in 1309 bytes} [Wed Feb 17 04:40:00 2021] POST /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550/action => generated 21960 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:40:00.949015 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-d8a24508-f49f-44b4-847f-a0a1cc332339 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:40:00.950149 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-d8a24508-f49f-44b4-847f-a0a1cc332339 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: d62b250c-c52b-4bd8-b6e0-b46ada9eee6f] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:40:00.958878 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-d8a24508-f49f-44b4-847f-a0a1cc332339 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:00.959421 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-d8a24508-f49f-44b4-847f-a0a1cc332339 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:00.960257 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-d8a24508-f49f-44b4-847f-a0a1cc332339 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:00.960753 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-d8a24508-f49f-44b4-847f-a0a1cc332339 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:01.028813 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-d8a24508-f49f-44b4-847f-a0a1cc332339 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "GET /compute/v2.1/servers/d62b250c-c52b-4bd8-b6e0-b46ada9eee6f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.084302 Feb 17 04:40:01.029430 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 668/1427] 10.222.0.78 () {58 vars in 1292 bytes} [Wed Feb 17 04:40:00 2021] GET /compute/v2.1/servers/d62b250c-c52b-4bd8-b6e0-b46ada9eee6f/os-volume_attachments => generated 197 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:40:01.041123 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-12572b6a-c5ff-40e6-9669-c4add3129aee tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:40:01.041787 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-12572b6a-c5ff-40e6-9669-c4add3129aee tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: d62b250c-c52b-4bd8-b6e0-b46ada9eee6f] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:40:01.050610 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-12572b6a-c5ff-40e6-9669-c4add3129aee tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:01.051152 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-12572b6a-c5ff-40e6-9669-c4add3129aee tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:01.052007 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-12572b6a-c5ff-40e6-9669-c4add3129aee tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:01.052509 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-12572b6a-c5ff-40e6-9669-c4add3129aee tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:01.120942 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-12572b6a-c5ff-40e6-9669-c4add3129aee tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "GET /compute/v2.1/servers/d62b250c-c52b-4bd8-b6e0-b46ada9eee6f/os-volume_attachments/d0694c30-93e2-4daa-871d-173e6e32c75c" status: 200 len: 194 microversion: 2.1 time: 0.084545 Feb 17 04:40:01.121606 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 760/1428] 10.222.0.78 () {58 vars in 1403 bytes} [Wed Feb 17 04:40:01 2021] GET /compute/v2.1/servers/d62b250c-c52b-4bd8-b6e0-b46ada9eee6f/os-volume_attachments/d0694c30-93e2-4daa-871d-173e6e32c75c => generated 194 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:40:01.526835 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-2be2135b-0048-404f-8701-e2160055f1fa tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:40:01.527903 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-2be2135b-0048-404f-8701-e2160055f1fa tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 5e68206c-24dc-4ec9-b907-bf233d27d550] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:40:01.536713 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-2be2135b-0048-404f-8701-e2160055f1fa tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:01.536920 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-2be2135b-0048-404f-8701-e2160055f1fa tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:01.537764 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-2be2135b-0048-404f-8701-e2160055f1fa tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:01.538253 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-2be2135b-0048-404f-8701-e2160055f1fa tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:01.673260 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-2be2135b-0048-404f-8701-e2160055f1fa tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "POST /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550/action" status: 200 len: 23223 microversion: 2.20 time: 0.150494 Feb 17 04:40:01.674090 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 669/1429] 10.222.0.78 () {62 vars in 1309 bytes} [Wed Feb 17 04:40:01 2021] POST /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550/action => generated 23223 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:40:02.682270 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-a113bb49-4acf-4813-9339-5738bdfa0cd7 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "09d6d6f6-11a7-4376-bd5e-9cbf7f5afad5"}} {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:40:02.683480 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-a113bb49-4acf-4813-9339-5738bdfa0cd7 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: d62b250c-c52b-4bd8-b6e0-b46ada9eee6f] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:40:02.685576 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-8a175574-c109-4f54-9258-11af04c59b6b tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:40:02.686746 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-8a175574-c109-4f54-9258-11af04c59b6b tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 5e68206c-24dc-4ec9-b907-bf233d27d550] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:40:02.694423 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-a113bb49-4acf-4813-9339-5738bdfa0cd7 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:02.695357 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-a113bb49-4acf-4813-9339-5738bdfa0cd7 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:02.696255 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-a113bb49-4acf-4813-9339-5738bdfa0cd7 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:02.696429 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-8a175574-c109-4f54-9258-11af04c59b6b tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:02.696751 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-a113bb49-4acf-4813-9339-5738bdfa0cd7 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:02.696950 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-8a175574-c109-4f54-9258-11af04c59b6b tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:02.697810 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-8a175574-c109-4f54-9258-11af04c59b6b tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:02.698307 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-8a175574-c109-4f54-9258-11af04c59b6b tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:02.851798 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-8a175574-c109-4f54-9258-11af04c59b6b tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "POST /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550/action" status: 200 len: 24647 microversion: 2.20 time: 0.170413 Feb 17 04:40:02.855974 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 670/1430] 10.222.0.78 () {62 vars in 1309 bytes} [Wed Feb 17 04:40:02 2021] POST /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550/action => generated 24647 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Feb 17 04:40:03.098327 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-a113bb49-4acf-4813-9339-5738bdfa0cd7 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "POST /compute/v2.1/servers/d62b250c-c52b-4bd8-b6e0-b46ada9eee6f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.419929 Feb 17 04:40:03.099137 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 761/1431] 10.222.0.78 () {60 vars in 1313 bytes} [Wed Feb 17 04:40:02 2021] POST /compute/v2.1/servers/d62b250c-c52b-4bd8-b6e0-b46ada9eee6f/os-volume_attachments => generated 194 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:40:03.866184 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-b6eb728d-de64-4ab3-a961-65a85b092d32 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:40:03.867330 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-b6eb728d-de64-4ab3-a961-65a85b092d32 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 5e68206c-24dc-4ec9-b907-bf233d27d550] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:40:03.876274 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-b6eb728d-de64-4ab3-a961-65a85b092d32 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:03.876813 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-b6eb728d-de64-4ab3-a961-65a85b092d32 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:03.877684 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-b6eb728d-de64-4ab3-a961-65a85b092d32 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:03.878177 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-b6eb728d-de64-4ab3-a961-65a85b092d32 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:04.014342 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-b6eb728d-de64-4ab3-a961-65a85b092d32 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "POST /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550/action" status: 200 len: 26032 microversion: 2.20 time: 0.152829 Feb 17 04:40:04.019383 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 671/1432] 10.222.0.78 () {62 vars in 1309 bytes} [Wed Feb 17 04:40:03 2021] POST /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550/action => generated 26032 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:40:05.028356 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-dce5992a-d1aa-49b0-ac8f-ce204edb59a3 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:40:05.029618 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-dce5992a-d1aa-49b0-ac8f-ce204edb59a3 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 5e68206c-24dc-4ec9-b907-bf233d27d550] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:40:05.039565 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-dce5992a-d1aa-49b0-ac8f-ce204edb59a3 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:05.040083 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-dce5992a-d1aa-49b0-ac8f-ce204edb59a3 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:05.040931 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-dce5992a-d1aa-49b0-ac8f-ce204edb59a3 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:05.041427 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-dce5992a-d1aa-49b0-ac8f-ce204edb59a3 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:05.180515 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-dce5992a-d1aa-49b0-ac8f-ce204edb59a3 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "POST /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550/action" status: 200 len: 27199 microversion: 2.20 time: 0.156423 Feb 17 04:40:05.181605 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 762/1433] 10.222.0.78 () {62 vars in 1309 bytes} [Wed Feb 17 04:40:05 2021] POST /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550/action => generated 27199 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:40:06.194908 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-895727e0-691f-4988-b0e2-676e6d1098ee tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:40:06.196141 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-895727e0-691f-4988-b0e2-676e6d1098ee tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 5e68206c-24dc-4ec9-b907-bf233d27d550] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:40:06.205340 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-895727e0-691f-4988-b0e2-676e6d1098ee tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:06.205847 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-895727e0-691f-4988-b0e2-676e6d1098ee tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:06.206684 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-895727e0-691f-4988-b0e2-676e6d1098ee tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:06.207201 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-895727e0-691f-4988-b0e2-676e6d1098ee tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:06.363080 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-895727e0-691f-4988-b0e2-676e6d1098ee tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "POST /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550/action" status: 200 len: 27732 microversion: 2.20 time: 0.172105 Feb 17 04:40:06.363847 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 672/1434] 10.222.0.78 () {62 vars in 1309 bytes} [Wed Feb 17 04:40:06 2021] POST /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550/action => generated 27732 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:40:07.376586 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-66e6da0b-51ed-42a9-872c-f1444d50f208 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:40:07.377660 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-66e6da0b-51ed-42a9-872c-f1444d50f208 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 5e68206c-24dc-4ec9-b907-bf233d27d550] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:40:07.386216 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-66e6da0b-51ed-42a9-872c-f1444d50f208 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:07.386732 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-66e6da0b-51ed-42a9-872c-f1444d50f208 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:07.387623 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-66e6da0b-51ed-42a9-872c-f1444d50f208 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:07.388115 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-66e6da0b-51ed-42a9-872c-f1444d50f208 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:07.533198 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-66e6da0b-51ed-42a9-872c-f1444d50f208 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "POST /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550/action" status: 200 len: 28113 microversion: 2.20 time: 0.161048 Feb 17 04:40:07.537370 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 763/1435] 10.222.0.78 () {62 vars in 1309 bytes} [Wed Feb 17 04:40:07 2021] POST /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550/action => generated 28113 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:40:08.546518 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-7c452e0c-5816-490f-ba13-3fa043c51b44 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:40:08.548471 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-7c452e0c-5816-490f-ba13-3fa043c51b44 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 5e68206c-24dc-4ec9-b907-bf233d27d550] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:40:08.557112 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-7c452e0c-5816-490f-ba13-3fa043c51b44 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:08.557629 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-7c452e0c-5816-490f-ba13-3fa043c51b44 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:08.558479 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-7c452e0c-5816-490f-ba13-3fa043c51b44 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:08.558981 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-7c452e0c-5816-490f-ba13-3fa043c51b44 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:08.700935 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-7c452e0c-5816-490f-ba13-3fa043c51b44 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "POST /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550/action" status: 200 len: 28155 microversion: 2.20 time: 0.158731 Feb 17 04:40:08.701895 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 673/1436] 10.222.0.78 () {62 vars in 1309 bytes} [Wed Feb 17 04:40:08 2021] POST /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550/action => generated 28155 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:40:09.714303 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-1bb7c909-deca-4647-99d3-e56ba30c03c7 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:40:09.715465 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-1bb7c909-deca-4647-99d3-e56ba30c03c7 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 5e68206c-24dc-4ec9-b907-bf233d27d550] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:40:09.724118 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-1bb7c909-deca-4647-99d3-e56ba30c03c7 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:09.724621 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-1bb7c909-deca-4647-99d3-e56ba30c03c7 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:09.725458 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-1bb7c909-deca-4647-99d3-e56ba30c03c7 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:09.725948 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-1bb7c909-deca-4647-99d3-e56ba30c03c7 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:09.861507 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-1bb7c909-deca-4647-99d3-e56ba30c03c7 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "POST /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550/action" status: 200 len: 28155 microversion: 2.20 time: 0.151610 Feb 17 04:40:09.862220 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 764/1437] 10.222.0.78 () {62 vars in 1309 bytes} [Wed Feb 17 04:40:09 2021] POST /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550/action => generated 28155 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:40:10.874558 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-747e56f2-1148-49b9-a5ad-07307fd0a420 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:40:10.876778 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-747e56f2-1148-49b9-a5ad-07307fd0a420 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 5e68206c-24dc-4ec9-b907-bf233d27d550] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:40:10.885456 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-747e56f2-1148-49b9-a5ad-07307fd0a420 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:10.885973 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-747e56f2-1148-49b9-a5ad-07307fd0a420 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:10.886822 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-747e56f2-1148-49b9-a5ad-07307fd0a420 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:10.887357 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-747e56f2-1148-49b9-a5ad-07307fd0a420 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:10.948907 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-f91c0f3a-fca1-4067-a1c7-a4a4eaf76b70 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:40:10.950044 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-f91c0f3a-fca1-4067-a1c7-a4a4eaf76b70 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: d62b250c-c52b-4bd8-b6e0-b46ada9eee6f] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:40:10.960464 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-f91c0f3a-fca1-4067-a1c7-a4a4eaf76b70 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:10.960969 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-f91c0f3a-fca1-4067-a1c7-a4a4eaf76b70 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:10.961811 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-f91c0f3a-fca1-4067-a1c7-a4a4eaf76b70 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:10.962303 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-f91c0f3a-fca1-4067-a1c7-a4a4eaf76b70 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:11.024424 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-747e56f2-1148-49b9-a5ad-07307fd0a420 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "POST /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550/action" status: 200 len: 28155 microversion: 2.20 time: 0.154207 Feb 17 04:40:11.028590 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 674/1438] 10.222.0.78 () {62 vars in 1309 bytes} [Wed Feb 17 04:40:10 2021] POST /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550/action => generated 28155 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:40:11.033965 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-f91c0f3a-fca1-4067-a1c7-a4a4eaf76b70 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "GET /compute/v2.1/servers/d62b250c-c52b-4bd8-b6e0-b46ada9eee6f/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.089495 Feb 17 04:40:11.034587 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 765/1439] 10.222.0.78 () {58 vars in 1292 bytes} [Wed Feb 17 04:40:10 2021] GET /compute/v2.1/servers/d62b250c-c52b-4bd8-b6e0-b46ada9eee6f/os-volume_attachments => generated 371 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:40:11.230846 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-126f2582-18cf-4695-b36f-8ebb30b60a32 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:40:11.231554 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-126f2582-18cf-4695-b36f-8ebb30b60a32 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: d62b250c-c52b-4bd8-b6e0-b46ada9eee6f] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:40:11.241185 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-126f2582-18cf-4695-b36f-8ebb30b60a32 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:11.241692 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-126f2582-18cf-4695-b36f-8ebb30b60a32 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:11.242524 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-126f2582-18cf-4695-b36f-8ebb30b60a32 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:11.243012 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-126f2582-18cf-4695-b36f-8ebb30b60a32 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:11.309537 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-126f2582-18cf-4695-b36f-8ebb30b60a32 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "GET /compute/v2.1/servers/d62b250c-c52b-4bd8-b6e0-b46ada9eee6f/os-volume_attachments/d0694c30-93e2-4daa-871d-173e6e32c75c" status: 200 len: 194 microversion: 2.1 time: 0.083229 Feb 17 04:40:11.310175 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 675/1440] 10.222.0.78 () {58 vars in 1403 bytes} [Wed Feb 17 04:40:11 2021] GET /compute/v2.1/servers/d62b250c-c52b-4bd8-b6e0-b46ada9eee6f/os-volume_attachments/d0694c30-93e2-4daa-871d-173e6e32c75c => generated 194 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:40:11.321777 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-c73f3720-f1c8-4045-837e-3056d90d4de5 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:40:11.322334 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-c73f3720-f1c8-4045-837e-3056d90d4de5 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: d62b250c-c52b-4bd8-b6e0-b46ada9eee6f] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:40:11.330540 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-c73f3720-f1c8-4045-837e-3056d90d4de5 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:11.331072 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-c73f3720-f1c8-4045-837e-3056d90d4de5 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:11.331942 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-c73f3720-f1c8-4045-837e-3056d90d4de5 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:11.332440 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-c73f3720-f1c8-4045-837e-3056d90d4de5 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:11.506492 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.objects.instance [None req-c73f3720-f1c8-4045-837e-3056d90d4de5 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lazy-loading 'services' on Instance uuid d62b250c-c52b-4bd8-b6e0-b46ada9eee6f {{(pid=98179) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Feb 17 04:40:11.647658 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-c73f3720-f1c8-4045-837e-3056d90d4de5 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "DELETE /compute/v2.1/servers/d62b250c-c52b-4bd8-b6e0-b46ada9eee6f/os-volume_attachments/d0694c30-93e2-4daa-871d-173e6e32c75c" status: 202 len: 0 microversion: 2.1 time: 0.329569 Feb 17 04:40:11.648442 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 766/1441] 10.222.0.78 () {58 vars in 1406 bytes} [Wed Feb 17 04:40:11 2021] DELETE /compute/v2.1/servers/d62b250c-c52b-4bd8-b6e0-b46ada9eee6f/os-volume_attachments/d0694c30-93e2-4daa-871d-173e6e32c75c => generated 0 bytes in 331 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:40:12.037465 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-e5c49294-d2af-4fa4-9a3d-94fab2763352 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:40:12.038504 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-e5c49294-d2af-4fa4-9a3d-94fab2763352 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 5e68206c-24dc-4ec9-b907-bf233d27d550] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:40:12.046313 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-e5c49294-d2af-4fa4-9a3d-94fab2763352 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:12.047502 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-e5c49294-d2af-4fa4-9a3d-94fab2763352 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:12.048335 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-e5c49294-d2af-4fa4-9a3d-94fab2763352 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:12.048829 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-e5c49294-d2af-4fa4-9a3d-94fab2763352 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:12.195885 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-e5c49294-d2af-4fa4-9a3d-94fab2763352 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "POST /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550/action" status: 200 len: 28155 microversion: 2.20 time: 0.162146 Feb 17 04:40:12.196592 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 676/1442] 10.222.0.78 () {62 vars in 1309 bytes} [Wed Feb 17 04:40:12 2021] POST /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550/action => generated 28155 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:40:13.210891 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-4ab7f7a0-85ed-420b-b3f4-215a8de8b9ee tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:40:13.212179 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-4ab7f7a0-85ed-420b-b3f4-215a8de8b9ee tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 5e68206c-24dc-4ec9-b907-bf233d27d550] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:40:13.221345 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-4ab7f7a0-85ed-420b-b3f4-215a8de8b9ee tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:13.221854 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-4ab7f7a0-85ed-420b-b3f4-215a8de8b9ee tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:13.222695 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-4ab7f7a0-85ed-420b-b3f4-215a8de8b9ee tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:13.223223 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-4ab7f7a0-85ed-420b-b3f4-215a8de8b9ee tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:13.350311 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-4ab7f7a0-85ed-420b-b3f4-215a8de8b9ee tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "POST /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550/action" status: 200 len: 28155 microversion: 2.20 time: 0.144657 Feb 17 04:40:13.350923 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 767/1443] 10.222.0.78 () {62 vars in 1309 bytes} [Wed Feb 17 04:40:13 2021] POST /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550/action => generated 28155 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:40:13.970069 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-fd38956e-e372-453d-849b-91594ee34d93 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:40:13.970721 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-fd38956e-e372-453d-849b-91594ee34d93 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: d62b250c-c52b-4bd8-b6e0-b46ada9eee6f] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:40:13.979475 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-fd38956e-e372-453d-849b-91594ee34d93 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:13.979995 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-fd38956e-e372-453d-849b-91594ee34d93 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:13.980849 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-fd38956e-e372-453d-849b-91594ee34d93 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:13.981358 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-fd38956e-e372-453d-849b-91594ee34d93 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:14.049923 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-fd38956e-e372-453d-849b-91594ee34d93 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "GET /compute/v2.1/servers/d62b250c-c52b-4bd8-b6e0-b46ada9eee6f/os-volume_attachments/09d6d6f6-11a7-4376-bd5e-9cbf7f5afad5" status: 200 len: 194 microversion: 2.1 time: 0.084505 Feb 17 04:40:14.050564 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 677/1444] 10.222.0.78 () {58 vars in 1403 bytes} [Wed Feb 17 04:40:13 2021] GET /compute/v2.1/servers/d62b250c-c52b-4bd8-b6e0-b46ada9eee6f/os-volume_attachments/09d6d6f6-11a7-4376-bd5e-9cbf7f5afad5 => generated 194 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:40:14.061779 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-e400cef8-47d1-4653-ae05-4db26b98fa1a tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:40:14.063077 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-e400cef8-47d1-4653-ae05-4db26b98fa1a tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: d62b250c-c52b-4bd8-b6e0-b46ada9eee6f] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:40:14.071844 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-e400cef8-47d1-4653-ae05-4db26b98fa1a tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:14.072349 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-e400cef8-47d1-4653-ae05-4db26b98fa1a tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:14.073186 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-e400cef8-47d1-4653-ae05-4db26b98fa1a tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:14.073681 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-e400cef8-47d1-4653-ae05-4db26b98fa1a tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:14.245423 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.objects.instance [None req-e400cef8-47d1-4653-ae05-4db26b98fa1a tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lazy-loading 'services' on Instance uuid d62b250c-c52b-4bd8-b6e0-b46ada9eee6f {{(pid=98179) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Feb 17 04:40:14.362707 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-c00bcde2-053c-4a1e-932f-cd39cac97e1c tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:40:14.363824 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-c00bcde2-053c-4a1e-932f-cd39cac97e1c tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 5e68206c-24dc-4ec9-b907-bf233d27d550] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:40:14.372010 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-c00bcde2-053c-4a1e-932f-cd39cac97e1c tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:14.372495 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-c00bcde2-053c-4a1e-932f-cd39cac97e1c tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:14.373189 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-c00bcde2-053c-4a1e-932f-cd39cac97e1c tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:14.373680 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-c00bcde2-053c-4a1e-932f-cd39cac97e1c tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:14.387770 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-e400cef8-47d1-4653-ae05-4db26b98fa1a tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "DELETE /compute/v2.1/servers/d62b250c-c52b-4bd8-b6e0-b46ada9eee6f/os-volume_attachments/09d6d6f6-11a7-4376-bd5e-9cbf7f5afad5" status: 202 len: 0 microversion: 2.1 time: 0.330120 Feb 17 04:40:14.388438 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 768/1445] 10.222.0.78 () {58 vars in 1406 bytes} [Wed Feb 17 04:40:14 2021] DELETE /compute/v2.1/servers/d62b250c-c52b-4bd8-b6e0-b46ada9eee6f/os-volume_attachments/09d6d6f6-11a7-4376-bd5e-9cbf7f5afad5 => generated 0 bytes in 332 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:40:14.540653 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-c00bcde2-053c-4a1e-932f-cd39cac97e1c tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "POST /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550/action" status: 200 len: 28155 microversion: 2.20 time: 0.181797 Feb 17 04:40:14.544879 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 678/1446] 10.222.0.78 () {62 vars in 1309 bytes} [Wed Feb 17 04:40:14 2021] POST /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550/action => generated 28155 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:40:15.553759 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-06e1b2e6-2f4f-4372-97c8-488617669d8c tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:40:15.554892 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-06e1b2e6-2f4f-4372-97c8-488617669d8c tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 5e68206c-24dc-4ec9-b907-bf233d27d550] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:40:15.564331 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-06e1b2e6-2f4f-4372-97c8-488617669d8c tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:15.564665 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-06e1b2e6-2f4f-4372-97c8-488617669d8c tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:15.565517 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-06e1b2e6-2f4f-4372-97c8-488617669d8c tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:15.566012 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-06e1b2e6-2f4f-4372-97c8-488617669d8c tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:15.713688 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-06e1b2e6-2f4f-4372-97c8-488617669d8c tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "POST /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550/action" status: 200 len: 28155 microversion: 2.20 time: 0.164343 Feb 17 04:40:15.714660 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 769/1447] 10.222.0.78 () {62 vars in 1309 bytes} [Wed Feb 17 04:40:15 2021] POST /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550/action => generated 28155 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:40:16.719998 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 17 04:40:16.720474 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: Wed Feb 17 04:40:16 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 17 04:40:16.737897 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-89c6282b-7f5c-4226-8d8a-c8e17f638ddb tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:40:16.739628 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-89c6282b-7f5c-4226-8d8a-c8e17f638ddb tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 5e68206c-24dc-4ec9-b907-bf233d27d550] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:40:16.749168 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-89c6282b-7f5c-4226-8d8a-c8e17f638ddb tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:16.749717 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-89c6282b-7f5c-4226-8d8a-c8e17f638ddb tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:16.750650 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-89c6282b-7f5c-4226-8d8a-c8e17f638ddb tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:16.751182 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-89c6282b-7f5c-4226-8d8a-c8e17f638ddb tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:16.882865 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-89c6282b-7f5c-4226-8d8a-c8e17f638ddb tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "POST /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550/action" status: 200 len: 28155 microversion: 2.20 time: 0.151241 Feb 17 04:40:16.886571 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 679/1448] 10.222.0.78 () {62 vars in 1309 bytes} [Wed Feb 17 04:40:16 2021] POST /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550/action => generated 28155 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:40:17.100947 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-3581d63e-90b2-4dcc-8e12-6ae6811ba73e tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:40:17.101606 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-3581d63e-90b2-4dcc-8e12-6ae6811ba73e tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: d62b250c-c52b-4bd8-b6e0-b46ada9eee6f] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:40:17.111027 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-3581d63e-90b2-4dcc-8e12-6ae6811ba73e tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:17.111571 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-3581d63e-90b2-4dcc-8e12-6ae6811ba73e tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:17.112417 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-3581d63e-90b2-4dcc-8e12-6ae6811ba73e tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:17.112919 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-3581d63e-90b2-4dcc-8e12-6ae6811ba73e tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:17.179490 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-3581d63e-90b2-4dcc-8e12-6ae6811ba73e tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: d62b250c-c52b-4bd8-b6e0-b46ada9eee6f] Going to try to terminate instance {{(pid=98179) delete /opt/stack/nova/nova/compute/api.py:2540}} Feb 17 04:40:17.292566 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-3581d63e-90b2-4dcc-8e12-6ae6811ba73e tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "DELETE /compute/v2.1/servers/d62b250c-c52b-4bd8-b6e0-b46ada9eee6f" status: 204 len: 0 microversion: 2.1 time: 0.195929 Feb 17 04:40:17.293270 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 770/1449] 10.222.0.78 () {58 vars in 1229 bytes} [Wed Feb 17 04:40:17 2021] DELETE /compute/v2.1/servers/d62b250c-c52b-4bd8-b6e0-b46ada9eee6f => generated 0 bytes in 198 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 17 04:40:17.303156 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-a1050eda-f474-45c9-aeab-14b33caa1f1a tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:40:17.303945 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-a1050eda-f474-45c9-aeab-14b33caa1f1a tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: d62b250c-c52b-4bd8-b6e0-b46ada9eee6f] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:40:17.313299 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-a1050eda-f474-45c9-aeab-14b33caa1f1a tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:17.314109 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-a1050eda-f474-45c9-aeab-14b33caa1f1a tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:17.315006 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-a1050eda-f474-45c9-aeab-14b33caa1f1a tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:17.315535 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-a1050eda-f474-45c9-aeab-14b33caa1f1a tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:17.888163 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-a1050eda-f474-45c9-aeab-14b33caa1f1a tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2deb449189ba427a9b8fcb0e21f22566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2c8716a46f54187902492f8ce162f58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:17.896794 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-a78adfd7-fa88-4438-8b4e-c73bf5977a41 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:40:17.898036 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-a78adfd7-fa88-4438-8b4e-c73bf5977a41 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 5e68206c-24dc-4ec9-b907-bf233d27d550] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:40:17.898178 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-a1050eda-f474-45c9-aeab-14b33caa1f1a tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "GET /compute/v2.1/servers/d62b250c-c52b-4bd8-b6e0-b46ada9eee6f" status: 200 len: 1672 microversion: 2.1 time: 0.599521 Feb 17 04:40:17.898656 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 680/1450] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:40:17 2021] GET /compute/v2.1/servers/d62b250c-c52b-4bd8-b6e0-b46ada9eee6f => generated 1672 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:40:17.906502 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-a78adfd7-fa88-4438-8b4e-c73bf5977a41 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:17.907022 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-a78adfd7-fa88-4438-8b4e-c73bf5977a41 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:17.907902 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-a78adfd7-fa88-4438-8b4e-c73bf5977a41 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:17.908404 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-a78adfd7-fa88-4438-8b4e-c73bf5977a41 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:18.067980 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-a78adfd7-fa88-4438-8b4e-c73bf5977a41 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "POST /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550/action" status: 200 len: 28155 microversion: 2.20 time: 0.175526 Feb 17 04:40:18.068692 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 771/1451] 10.222.0.78 () {62 vars in 1309 bytes} [Wed Feb 17 04:40:17 2021] POST /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550/action => generated 28155 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Feb 17 04:40:18.918215 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-5e7006d4-9606-4907-b7f8-59aec1bfe99a tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:40:18.918893 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-5e7006d4-9606-4907-b7f8-59aec1bfe99a tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: d62b250c-c52b-4bd8-b6e0-b46ada9eee6f] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:40:18.927976 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-5e7006d4-9606-4907-b7f8-59aec1bfe99a tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:18.928491 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-5e7006d4-9606-4907-b7f8-59aec1bfe99a tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:18.929333 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-5e7006d4-9606-4907-b7f8-59aec1bfe99a tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:18.929831 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-5e7006d4-9606-4907-b7f8-59aec1bfe99a tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:19.081768 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-16b97744-6676-412f-9048-05106bd92598 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:40:19.082843 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-16b97744-6676-412f-9048-05106bd92598 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 5e68206c-24dc-4ec9-b907-bf233d27d550] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:40:19.091612 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-16b97744-6676-412f-9048-05106bd92598 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:19.092139 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-16b97744-6676-412f-9048-05106bd92598 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:19.093006 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-16b97744-6676-412f-9048-05106bd92598 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:19.094103 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-16b97744-6676-412f-9048-05106bd92598 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:19.142433 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-5e7006d4-9606-4907-b7f8-59aec1bfe99a tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2deb449189ba427a9b8fcb0e21f22566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2c8716a46f54187902492f8ce162f58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:19.164531 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-5e7006d4-9606-4907-b7f8-59aec1bfe99a tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "GET /compute/v2.1/servers/d62b250c-c52b-4bd8-b6e0-b46ada9eee6f" status: 200 len: 1672 microversion: 2.1 time: 0.250341 Feb 17 04:40:19.165141 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 681/1452] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:40:18 2021] GET /compute/v2.1/servers/d62b250c-c52b-4bd8-b6e0-b46ada9eee6f => generated 1672 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:40:19.241423 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-16b97744-6676-412f-9048-05106bd92598 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "POST /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550/action" status: 200 len: 28155 microversion: 2.20 time: 0.164125 Feb 17 04:40:19.242145 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 772/1453] 10.222.0.78 () {62 vars in 1309 bytes} [Wed Feb 17 04:40:19 2021] POST /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550/action => generated 28155 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Feb 17 04:40:20.184617 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-22088308-13f2-429d-86dc-72b773205149 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:40:20.185359 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-22088308-13f2-429d-86dc-72b773205149 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: d62b250c-c52b-4bd8-b6e0-b46ada9eee6f] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:40:20.194231 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-22088308-13f2-429d-86dc-72b773205149 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:20.194738 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-22088308-13f2-429d-86dc-72b773205149 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:20.195604 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-22088308-13f2-429d-86dc-72b773205149 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:20.196090 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-22088308-13f2-429d-86dc-72b773205149 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:20.255536 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-e7d3bee0-b8d9-48b1-9a62-e2dfee7466f4 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:40:20.256846 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-e7d3bee0-b8d9-48b1-9a62-e2dfee7466f4 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 5e68206c-24dc-4ec9-b907-bf233d27d550] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:40:20.265682 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-e7d3bee0-b8d9-48b1-9a62-e2dfee7466f4 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:20.266548 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-e7d3bee0-b8d9-48b1-9a62-e2dfee7466f4 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:20.267582 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-e7d3bee0-b8d9-48b1-9a62-e2dfee7466f4 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:20.268175 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-e7d3bee0-b8d9-48b1-9a62-e2dfee7466f4 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:20.394105 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-e7d3bee0-b8d9-48b1-9a62-e2dfee7466f4 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "POST /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550/action" status: 200 len: 28155 microversion: 2.20 time: 0.143794 Feb 17 04:40:20.398291 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 773/1454] 10.222.0.78 () {62 vars in 1309 bytes} [Wed Feb 17 04:40:20 2021] POST /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550/action => generated 28155 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Feb 17 04:40:20.653170 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-22088308-13f2-429d-86dc-72b773205149 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2deb449189ba427a9b8fcb0e21f22566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2c8716a46f54187902492f8ce162f58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:20.663945 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-22088308-13f2-429d-86dc-72b773205149 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "GET /compute/v2.1/servers/d62b250c-c52b-4bd8-b6e0-b46ada9eee6f" status: 200 len: 1672 microversion: 2.1 time: 0.483350 Feb 17 04:40:20.664564 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 682/1455] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:40:20 2021] GET /compute/v2.1/servers/d62b250c-c52b-4bd8-b6e0-b46ada9eee6f => generated 1672 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:40:21.203152 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [req-39ccbb88-857c-480b-8824-9cc4c59c7e40 req-2b8e1260-80fa-4a91-8bdb-9e292f77d100 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d62b250c-c52b-4bd8-b6e0-b46ada9eee6f", "name": "network-vif-unplugged", "status": "completed", "tag": "72a7c07e-7741-4138-b15c-7f46d1c74f7a"}]} {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:40:21.205703 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:40:21.205703 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: warnings.warn(msg) Feb 17 04:40:21.214681 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [req-39ccbb88-857c-480b-8824-9cc4c59c7e40 req-2b8e1260-80fa-4a91-8bdb-9e292f77d100 service nova] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:21.215233 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [req-39ccbb88-857c-480b-8824-9cc4c59c7e40 req-2b8e1260-80fa-4a91-8bdb-9e292f77d100 service nova] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:21.232962 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.compute.server_external_events [req-39ccbb88-857c-480b-8824-9cc4c59c7e40 req-2b8e1260-80fa-4a91-8bdb-9e292f77d100 service nova] Creating event network-vif-unplugged:72a7c07e-7741-4138-b15c-7f46d1c74f7a for instance d62b250c-c52b-4bd8-b6e0-b46ada9eee6f on hv-cinder-75998 Feb 17 04:40:21.238809 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [req-39ccbb88-857c-480b-8824-9cc4c59c7e40 req-2b8e1260-80fa-4a91-8bdb-9e292f77d100 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.176913 Feb 17 04:40:21.239708 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 774/1456] 10.222.0.78 () {64 vars in 1308 bytes} [Wed Feb 17 04:40:21 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:40:21.406351 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-14ef7e43-3a02-4cb8-81cd-9a0432ef8f7e tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:40:21.408489 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-14ef7e43-3a02-4cb8-81cd-9a0432ef8f7e tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 5e68206c-24dc-4ec9-b907-bf233d27d550] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:40:21.417393 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-14ef7e43-3a02-4cb8-81cd-9a0432ef8f7e tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:21.417911 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-14ef7e43-3a02-4cb8-81cd-9a0432ef8f7e tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:21.418751 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-14ef7e43-3a02-4cb8-81cd-9a0432ef8f7e tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:21.419278 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-14ef7e43-3a02-4cb8-81cd-9a0432ef8f7e tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:21.558066 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-14ef7e43-3a02-4cb8-81cd-9a0432ef8f7e tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "POST /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550/action" status: 200 len: 28155 microversion: 2.20 time: 0.155709 Feb 17 04:40:21.558742 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 683/1457] 10.222.0.78 () {62 vars in 1309 bytes} [Wed Feb 17 04:40:21 2021] POST /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550/action => generated 28155 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:40:21.684532 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-435cd0ca-cce9-48d1-987c-9c05fbb1208d tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:40:21.685365 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-435cd0ca-cce9-48d1-987c-9c05fbb1208d tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: d62b250c-c52b-4bd8-b6e0-b46ada9eee6f] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:40:21.693827 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-435cd0ca-cce9-48d1-987c-9c05fbb1208d tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:21.694344 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-435cd0ca-cce9-48d1-987c-9c05fbb1208d tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:21.695282 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-435cd0ca-cce9-48d1-987c-9c05fbb1208d tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:21.695792 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-435cd0ca-cce9-48d1-987c-9c05fbb1208d tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:21.914737 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-435cd0ca-cce9-48d1-987c-9c05fbb1208d tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2deb449189ba427a9b8fcb0e21f22566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2c8716a46f54187902492f8ce162f58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:21.924500 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-435cd0ca-cce9-48d1-987c-9c05fbb1208d tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "GET /compute/v2.1/servers/d62b250c-c52b-4bd8-b6e0-b46ada9eee6f" status: 200 len: 1672 microversion: 2.1 time: 0.244453 Feb 17 04:40:21.925127 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 775/1458] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:40:21 2021] GET /compute/v2.1/servers/d62b250c-c52b-4bd8-b6e0-b46ada9eee6f => generated 1672 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:40:22.571423 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-26372557-dfbe-433e-847a-11a0fc910b10 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:40:22.573134 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-26372557-dfbe-433e-847a-11a0fc910b10 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 5e68206c-24dc-4ec9-b907-bf233d27d550] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:40:22.583107 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-26372557-dfbe-433e-847a-11a0fc910b10 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:22.583681 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-26372557-dfbe-433e-847a-11a0fc910b10 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:22.584475 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-26372557-dfbe-433e-847a-11a0fc910b10 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:22.584976 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-26372557-dfbe-433e-847a-11a0fc910b10 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:22.721069 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-26372557-dfbe-433e-847a-11a0fc910b10 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "POST /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550/action" status: 200 len: 28155 microversion: 2.20 time: 0.154087 Feb 17 04:40:22.725284 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 684/1459] 10.222.0.78 () {62 vars in 1309 bytes} [Wed Feb 17 04:40:22 2021] POST /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550/action => generated 28155 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:40:22.943883 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-b9a486a5-e48a-4883-ae9b-b41f4c960978 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:40:22.944739 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-b9a486a5-e48a-4883-ae9b-b41f4c960978 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: d62b250c-c52b-4bd8-b6e0-b46ada9eee6f] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:40:22.952953 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-b9a486a5-e48a-4883-ae9b-b41f4c960978 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:22.954078 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-b9a486a5-e48a-4883-ae9b-b41f4c960978 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:22.955233 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-b9a486a5-e48a-4883-ae9b-b41f4c960978 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:22.955929 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-b9a486a5-e48a-4883-ae9b-b41f4c960978 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:23.047997 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [req-74da042f-c527-4be1-b906-71bdeb85315a req-89aef1b3-616b-4715-ae72-74b4fa7c9db6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d62b250c-c52b-4bd8-b6e0-b46ada9eee6f", "name": "network-vif-deleted", "tag": "72a7c07e-7741-4138-b15c-7f46d1c74f7a"}]} {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:40:23.049720 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:40:23.049720 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: warnings.warn(msg) Feb 17 04:40:23.065515 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [req-74da042f-c527-4be1-b906-71bdeb85315a req-89aef1b3-616b-4715-ae72-74b4fa7c9db6 service nova] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:23.066303 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [req-74da042f-c527-4be1-b906-71bdeb85315a req-89aef1b3-616b-4715-ae72-74b4fa7c9db6 service nova] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:23.086367 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.compute.server_external_events [req-74da042f-c527-4be1-b906-71bdeb85315a req-89aef1b3-616b-4715-ae72-74b4fa7c9db6 service nova] Creating event network-vif-deleted:72a7c07e-7741-4138-b15c-7f46d1c74f7a for instance d62b250c-c52b-4bd8-b6e0-b46ada9eee6f on hv-cinder-75998 Feb 17 04:40:23.092155 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [req-74da042f-c527-4be1-b906-71bdeb85315a req-89aef1b3-616b-4715-ae72-74b4fa7c9db6 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051168 Feb 17 04:40:23.095550 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 685/1460] 10.222.0.78 () {64 vars in 1308 bytes} [Wed Feb 17 04:40:23 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:40:23.123246 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-b9a486a5-e48a-4883-ae9b-b41f4c960978 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2deb449189ba427a9b8fcb0e21f22566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2c8716a46f54187902492f8ce162f58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:23.132768 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-b9a486a5-e48a-4883-ae9b-b41f4c960978 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "GET /compute/v2.1/servers/d62b250c-c52b-4bd8-b6e0-b46ada9eee6f" status: 200 len: 1606 microversion: 2.1 time: 0.192736 Feb 17 04:40:23.133712 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 776/1461] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:40:22 2021] GET /compute/v2.1/servers/d62b250c-c52b-4bd8-b6e0-b46ada9eee6f => generated 1606 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:40:23.734111 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-aa5f2d51-9796-405a-9b17-90737a480917 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:40:23.736396 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-aa5f2d51-9796-405a-9b17-90737a480917 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 5e68206c-24dc-4ec9-b907-bf233d27d550] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:40:23.744455 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-aa5f2d51-9796-405a-9b17-90737a480917 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:23.744965 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-aa5f2d51-9796-405a-9b17-90737a480917 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:23.745940 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-aa5f2d51-9796-405a-9b17-90737a480917 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:23.746576 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-aa5f2d51-9796-405a-9b17-90737a480917 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:23.894861 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-aa5f2d51-9796-405a-9b17-90737a480917 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "POST /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550/action" status: 200 len: 28155 microversion: 2.20 time: 0.165337 Feb 17 04:40:23.895771 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 686/1462] 10.222.0.78 () {62 vars in 1309 bytes} [Wed Feb 17 04:40:23 2021] POST /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550/action => generated 28155 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:40:24.152542 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-9932467d-9aee-499f-82c6-e4b2f32b1408 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:40:24.153205 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-9932467d-9aee-499f-82c6-e4b2f32b1408 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: d62b250c-c52b-4bd8-b6e0-b46ada9eee6f] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:40:24.162265 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-9932467d-9aee-499f-82c6-e4b2f32b1408 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:24.162780 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-9932467d-9aee-499f-82c6-e4b2f32b1408 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:24.163667 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-9932467d-9aee-499f-82c6-e4b2f32b1408 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:24.164166 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-9932467d-9aee-499f-82c6-e4b2f32b1408 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:24.218185 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.wsgi [None req-9932467d-9aee-499f-82c6-e4b2f32b1408 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] HTTP exception thrown: Instance d62b250c-c52b-4bd8-b6e0-b46ada9eee6f could not be found. Feb 17 04:40:24.219734 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-9932467d-9aee-499f-82c6-e4b2f32b1408 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Returning 404 to user: Instance d62b250c-c52b-4bd8-b6e0-b46ada9eee6f could not be found. {{(pid=98179) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 17 04:40:24.220658 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-9932467d-9aee-499f-82c6-e4b2f32b1408 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "GET /compute/v2.1/servers/d62b250c-c52b-4bd8-b6e0-b46ada9eee6f" status: 404 len: 111 microversion: 2.1 time: 0.072161 Feb 17 04:40:24.221274 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 777/1463] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:40:24 2021] GET /compute/v2.1/servers/d62b250c-c52b-4bd8-b6e0-b46ada9eee6f => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 17 04:40:24.230732 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-7cb4cb98-6710-49ad-a1d8-82d00edd814c tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Calling method '.version_select at 0x7f57c8828488>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:40:24.252044 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-7cb4cb98-6710-49ad-a1d8-82d00edd814c tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-508379513" status: 202 len: 0 microversion: 2.1 time: 0.025646 Feb 17 04:40:24.252689 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 687/1464] 10.222.0.78 () {58 vars in 1208 bytes} [Wed Feb 17 04:40:24 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-508379513 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:40:24.907899 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-c876cab7-c4e6-4950-b6dd-cee9bfa73adf tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:40:24.908966 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-c876cab7-c4e6-4950-b6dd-cee9bfa73adf tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 5e68206c-24dc-4ec9-b907-bf233d27d550] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:40:24.917412 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-c876cab7-c4e6-4950-b6dd-cee9bfa73adf tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:24.917923 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-c876cab7-c4e6-4950-b6dd-cee9bfa73adf tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:24.918799 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-c876cab7-c4e6-4950-b6dd-cee9bfa73adf tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:24.919325 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-c876cab7-c4e6-4950-b6dd-cee9bfa73adf tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:25.071621 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-c876cab7-c4e6-4950-b6dd-cee9bfa73adf tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "POST /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550/action" status: 200 len: 28446 microversion: 2.20 time: 0.168017 Feb 17 04:40:25.072244 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 778/1465] 10.222.0.78 () {62 vars in 1309 bytes} [Wed Feb 17 04:40:24 2021] POST /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550/action => generated 28446 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:40:26.086373 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-2a170929-504f-4f3e-a000-ca0e5a825fc8 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:40:26.087508 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-2a170929-504f-4f3e-a000-ca0e5a825fc8 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 5e68206c-24dc-4ec9-b907-bf233d27d550] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:40:26.096956 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-2a170929-504f-4f3e-a000-ca0e5a825fc8 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:26.097484 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-2a170929-504f-4f3e-a000-ca0e5a825fc8 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:26.098344 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-2a170929-504f-4f3e-a000-ca0e5a825fc8 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:26.098848 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-2a170929-504f-4f3e-a000-ca0e5a825fc8 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:26.238624 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-2a170929-504f-4f3e-a000-ca0e5a825fc8 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "POST /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550/action" status: 200 len: 28462 microversion: 2.20 time: 0.156806 Feb 17 04:40:26.242905 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 688/1466] 10.222.0.78 () {62 vars in 1309 bytes} [Wed Feb 17 04:40:26 2021] POST /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550/action => generated 28462 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:40:27.251178 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-efb69434-8550-40e5-acc9-17e0174de874 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:40:27.252317 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-efb69434-8550-40e5-acc9-17e0174de874 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 5e68206c-24dc-4ec9-b907-bf233d27d550] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:40:27.260948 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-efb69434-8550-40e5-acc9-17e0174de874 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:27.261462 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-efb69434-8550-40e5-acc9-17e0174de874 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:27.262300 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-efb69434-8550-40e5-acc9-17e0174de874 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:27.262801 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-efb69434-8550-40e5-acc9-17e0174de874 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:27.416900 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-efb69434-8550-40e5-acc9-17e0174de874 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "POST /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550/action" status: 200 len: 28614 microversion: 2.20 time: 0.170161 Feb 17 04:40:27.417510 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 779/1467] 10.222.0.78 () {62 vars in 1309 bytes} [Wed Feb 17 04:40:27 2021] POST /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550/action => generated 28614 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:40:28.430194 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-f015bc5d-8b74-40db-a6dc-e6dc496be6c6 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:40:28.431391 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-f015bc5d-8b74-40db-a6dc-e6dc496be6c6 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 5e68206c-24dc-4ec9-b907-bf233d27d550] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:40:28.440249 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-f015bc5d-8b74-40db-a6dc-e6dc496be6c6 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:28.440761 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-f015bc5d-8b74-40db-a6dc-e6dc496be6c6 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:28.441596 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-f015bc5d-8b74-40db-a6dc-e6dc496be6c6 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:28.442087 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-f015bc5d-8b74-40db-a6dc-e6dc496be6c6 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:28.577354 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-f015bc5d-8b74-40db-a6dc-e6dc496be6c6 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "POST /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550/action" status: 200 len: 28614 microversion: 2.20 time: 0.151565 Feb 17 04:40:28.578051 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 689/1468] 10.222.0.78 () {62 vars in 1309 bytes} [Wed Feb 17 04:40:28 2021] POST /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550/action => generated 28614 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:40:29.105073 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-2182fc92-e4c2-467a-b4eb-c44b3d0eb113 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:40:29.105719 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-2182fc92-e4c2-467a-b4eb-c44b3d0eb113 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: d62b250c-c52b-4bd8-b6e0-b46ada9eee6f] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:40:29.115536 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-2182fc92-e4c2-467a-b4eb-c44b3d0eb113 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:29.116051 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-2182fc92-e4c2-467a-b4eb-c44b3d0eb113 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:29.116880 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-2182fc92-e4c2-467a-b4eb-c44b3d0eb113 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:29.117373 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-2182fc92-e4c2-467a-b4eb-c44b3d0eb113 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:29.170746 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.wsgi [None req-2182fc92-e4c2-467a-b4eb-c44b3d0eb113 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] HTTP exception thrown: Instance d62b250c-c52b-4bd8-b6e0-b46ada9eee6f could not be found. Feb 17 04:40:29.171476 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-2182fc92-e4c2-467a-b4eb-c44b3d0eb113 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Returning 404 to user: Instance d62b250c-c52b-4bd8-b6e0-b46ada9eee6f could not be found. {{(pid=98179) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 17 04:40:29.172932 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-2182fc92-e4c2-467a-b4eb-c44b3d0eb113 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "DELETE /compute/v2.1/servers/d62b250c-c52b-4bd8-b6e0-b46ada9eee6f" status: 404 len: 111 microversion: 2.1 time: 0.072476 Feb 17 04:40:29.173576 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 780/1469] 10.222.0.78 () {58 vars in 1229 bytes} [Wed Feb 17 04:40:29 2021] DELETE /compute/v2.1/servers/d62b250c-c52b-4bd8-b6e0-b46ada9eee6f => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 17 04:40:29.182897 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-ffda98ae-e130-4a8d-b690-e283054ec49d tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:40:29.183713 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-ffda98ae-e130-4a8d-b690-e283054ec49d tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: d62b250c-c52b-4bd8-b6e0-b46ada9eee6f] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:40:29.193055 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-ffda98ae-e130-4a8d-b690-e283054ec49d tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:29.193568 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-ffda98ae-e130-4a8d-b690-e283054ec49d tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:29.194413 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-ffda98ae-e130-4a8d-b690-e283054ec49d tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:29.194916 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-ffda98ae-e130-4a8d-b690-e283054ec49d tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:29.247454 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.wsgi [None req-ffda98ae-e130-4a8d-b690-e283054ec49d tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] HTTP exception thrown: Instance d62b250c-c52b-4bd8-b6e0-b46ada9eee6f could not be found. Feb 17 04:40:29.248116 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-ffda98ae-e130-4a8d-b690-e283054ec49d tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Returning 404 to user: Instance d62b250c-c52b-4bd8-b6e0-b46ada9eee6f could not be found. {{(pid=98178) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 17 04:40:29.249018 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-ffda98ae-e130-4a8d-b690-e283054ec49d tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "GET /compute/v2.1/servers/d62b250c-c52b-4bd8-b6e0-b46ada9eee6f" status: 404 len: 111 microversion: 2.1 time: 0.070737 Feb 17 04:40:29.249625 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 690/1470] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:40:29 2021] GET /compute/v2.1/servers/d62b250c-c52b-4bd8-b6e0-b46ada9eee6f => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 17 04:40:29.590756 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-cad182d7-3d7f-4dcf-b908-fb3b9c08eeb1 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:40:29.591812 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-cad182d7-3d7f-4dcf-b908-fb3b9c08eeb1 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 5e68206c-24dc-4ec9-b907-bf233d27d550] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:40:29.600314 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-cad182d7-3d7f-4dcf-b908-fb3b9c08eeb1 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:29.600813 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-cad182d7-3d7f-4dcf-b908-fb3b9c08eeb1 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:29.601641 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-cad182d7-3d7f-4dcf-b908-fb3b9c08eeb1 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:29.602131 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-cad182d7-3d7f-4dcf-b908-fb3b9c08eeb1 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:29.735804 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-cad182d7-3d7f-4dcf-b908-fb3b9c08eeb1 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "POST /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550/action" status: 200 len: 28614 microversion: 2.20 time: 0.149031 Feb 17 04:40:29.736601 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 781/1471] 10.222.0.78 () {62 vars in 1309 bytes} [Wed Feb 17 04:40:29 2021] POST /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550/action => generated 28614 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:40:30.506493 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-13a3c926-61ac-48bb-a8d1-d196ec8ad949 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:40:30.507233 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-13a3c926-61ac-48bb-a8d1-d196ec8ad949 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: 29d1ce27-f63b-4523-88be-55f65a6a2529] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:40:30.516546 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-13a3c926-61ac-48bb-a8d1-d196ec8ad949 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:30.517077 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-13a3c926-61ac-48bb-a8d1-d196ec8ad949 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:30.517956 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-13a3c926-61ac-48bb-a8d1-d196ec8ad949 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:30.518457 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-13a3c926-61ac-48bb-a8d1-d196ec8ad949 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:30.577759 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.wsgi [None req-13a3c926-61ac-48bb-a8d1-d196ec8ad949 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] HTTP exception thrown: Instance 29d1ce27-f63b-4523-88be-55f65a6a2529 could not be found. Feb 17 04:40:30.578534 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-13a3c926-61ac-48bb-a8d1-d196ec8ad949 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Returning 404 to user: Instance 29d1ce27-f63b-4523-88be-55f65a6a2529 could not be found. {{(pid=98178) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 17 04:40:30.579487 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-13a3c926-61ac-48bb-a8d1-d196ec8ad949 tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "DELETE /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529" status: 404 len: 111 microversion: 2.1 time: 0.077255 Feb 17 04:40:30.580140 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 691/1472] 10.222.0.78 () {58 vars in 1229 bytes} [Wed Feb 17 04:40:30 2021] DELETE /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 17 04:40:30.589766 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-5cca6573-a230-4741-a7dc-f235009ec71c tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:40:30.590555 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-5cca6573-a230-4741-a7dc-f235009ec71c tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] [instance: 29d1ce27-f63b-4523-88be-55f65a6a2529] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:40:30.600082 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-5cca6573-a230-4741-a7dc-f235009ec71c tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:30.600692 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-5cca6573-a230-4741-a7dc-f235009ec71c tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:30.601444 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-5cca6573-a230-4741-a7dc-f235009ec71c tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:30.601947 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-5cca6573-a230-4741-a7dc-f235009ec71c tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:30.662201 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.wsgi [None req-5cca6573-a230-4741-a7dc-f235009ec71c tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] HTTP exception thrown: Instance 29d1ce27-f63b-4523-88be-55f65a6a2529 could not be found. Feb 17 04:40:30.662889 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-5cca6573-a230-4741-a7dc-f235009ec71c tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] Returning 404 to user: Instance 29d1ce27-f63b-4523-88be-55f65a6a2529 could not be found. {{(pid=98179) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 17 04:40:30.663841 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-5cca6573-a230-4741-a7dc-f235009ec71c tempest-AttachVolumeTestJSON-497285955 tempest-AttachVolumeTestJSON-497285955-project] 10.222.0.78 "GET /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529" status: 404 len: 111 microversion: 2.1 time: 0.078872 Feb 17 04:40:30.664480 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 782/1473] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:40:30 2021] GET /compute/v2.1/servers/29d1ce27-f63b-4523-88be-55f65a6a2529 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 17 04:40:30.748658 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-12b4ae9f-b4d6-4594-8c46-08390ca7d218 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:40:30.749699 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-12b4ae9f-b4d6-4594-8c46-08390ca7d218 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 5e68206c-24dc-4ec9-b907-bf233d27d550] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:40:30.759796 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-12b4ae9f-b4d6-4594-8c46-08390ca7d218 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:30.760968 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-12b4ae9f-b4d6-4594-8c46-08390ca7d218 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:30.761835 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-12b4ae9f-b4d6-4594-8c46-08390ca7d218 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:30.762337 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-12b4ae9f-b4d6-4594-8c46-08390ca7d218 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:30.892365 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-12b4ae9f-b4d6-4594-8c46-08390ca7d218 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "POST /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550/action" status: 200 len: 28614 microversion: 2.20 time: 0.146414 Feb 17 04:40:30.893194 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 692/1474] 10.222.0.78 () {62 vars in 1309 bytes} [Wed Feb 17 04:40:30 2021] POST /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550/action => generated 28614 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:40:31.904595 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-8e9e26e5-6a6e-41a3-b6db-d899645746e0 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:40:31.905698 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-8e9e26e5-6a6e-41a3-b6db-d899645746e0 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 5e68206c-24dc-4ec9-b907-bf233d27d550] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:40:31.914234 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-8e9e26e5-6a6e-41a3-b6db-d899645746e0 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:31.914750 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-8e9e26e5-6a6e-41a3-b6db-d899645746e0 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:31.915620 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-8e9e26e5-6a6e-41a3-b6db-d899645746e0 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:31.916129 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-8e9e26e5-6a6e-41a3-b6db-d899645746e0 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:32.052760 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-8e9e26e5-6a6e-41a3-b6db-d899645746e0 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "POST /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550/action" status: 200 len: 28614 microversion: 2.20 time: 0.152019 Feb 17 04:40:32.056995 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 783/1475] 10.222.0.78 () {62 vars in 1309 bytes} [Wed Feb 17 04:40:31 2021] POST /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550/action => generated 28614 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:40:33.068349 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-dd1ec593-1bc7-4e16-bbd0-49bcd7b5eef7 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:40:33.069520 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-dd1ec593-1bc7-4e16-bbd0-49bcd7b5eef7 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 5e68206c-24dc-4ec9-b907-bf233d27d550] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:40:33.079879 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-dd1ec593-1bc7-4e16-bbd0-49bcd7b5eef7 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:33.080486 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-dd1ec593-1bc7-4e16-bbd0-49bcd7b5eef7 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:33.081372 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-dd1ec593-1bc7-4e16-bbd0-49bcd7b5eef7 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:33.081869 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-dd1ec593-1bc7-4e16-bbd0-49bcd7b5eef7 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:33.214015 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-dd1ec593-1bc7-4e16-bbd0-49bcd7b5eef7 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "POST /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550/action" status: 200 len: 28614 microversion: 2.20 time: 0.152059 Feb 17 04:40:33.215000 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 693/1476] 10.222.0.78 () {62 vars in 1309 bytes} [Wed Feb 17 04:40:33 2021] POST /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550/action => generated 28614 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:40:34.227427 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-baee1c55-e3f3-4db2-bde0-c94101760a33 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:40:34.229591 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-baee1c55-e3f3-4db2-bde0-c94101760a33 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 5e68206c-24dc-4ec9-b907-bf233d27d550] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:40:34.238982 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-baee1c55-e3f3-4db2-bde0-c94101760a33 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:34.239651 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-baee1c55-e3f3-4db2-bde0-c94101760a33 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:34.240593 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-baee1c55-e3f3-4db2-bde0-c94101760a33 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:34.241169 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-baee1c55-e3f3-4db2-bde0-c94101760a33 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:34.365572 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-baee1c55-e3f3-4db2-bde0-c94101760a33 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "POST /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550/action" status: 200 len: 28614 microversion: 2.20 time: 0.142308 Feb 17 04:40:34.366323 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 784/1477] 10.222.0.78 () {62 vars in 1309 bytes} [Wed Feb 17 04:40:34 2021] POST /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550/action => generated 28614 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:40:35.379448 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-605209a3-3bb6-4c6c-bebf-f7ddee5c393c tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:40:35.380757 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-605209a3-3bb6-4c6c-bebf-f7ddee5c393c tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 5e68206c-24dc-4ec9-b907-bf233d27d550] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:40:35.389492 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-605209a3-3bb6-4c6c-bebf-f7ddee5c393c tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:35.389962 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-605209a3-3bb6-4c6c-bebf-f7ddee5c393c tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:35.390846 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-605209a3-3bb6-4c6c-bebf-f7ddee5c393c tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:35.391373 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-605209a3-3bb6-4c6c-bebf-f7ddee5c393c tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:35.519165 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-605209a3-3bb6-4c6c-bebf-f7ddee5c393c tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "POST /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550/action" status: 200 len: 28614 microversion: 2.20 time: 0.144217 Feb 17 04:40:35.520161 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 694/1478] 10.222.0.78 () {62 vars in 1309 bytes} [Wed Feb 17 04:40:35 2021] POST /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550/action => generated 28614 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:40:36.533179 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-f52d9a42-ce80-4e30-b05a-229932006576 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:40:36.534361 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-f52d9a42-ce80-4e30-b05a-229932006576 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 5e68206c-24dc-4ec9-b907-bf233d27d550] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:40:36.542885 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-f52d9a42-ce80-4e30-b05a-229932006576 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:36.543423 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-f52d9a42-ce80-4e30-b05a-229932006576 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:36.544295 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-f52d9a42-ce80-4e30-b05a-229932006576 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:36.544796 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-f52d9a42-ce80-4e30-b05a-229932006576 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:36.696115 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-f52d9a42-ce80-4e30-b05a-229932006576 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "POST /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550/action" status: 200 len: 28614 microversion: 2.20 time: 0.167907 Feb 17 04:40:36.697017 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 785/1479] 10.222.0.78 () {62 vars in 1309 bytes} [Wed Feb 17 04:40:36 2021] POST /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550/action => generated 28614 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:40:37.711282 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-db1962f1-8613-4a20-a06d-14417b81bcb6 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:40:37.712425 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-db1962f1-8613-4a20-a06d-14417b81bcb6 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 5e68206c-24dc-4ec9-b907-bf233d27d550] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:40:37.721519 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-db1962f1-8613-4a20-a06d-14417b81bcb6 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:37.722042 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-db1962f1-8613-4a20-a06d-14417b81bcb6 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:37.722897 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-db1962f1-8613-4a20-a06d-14417b81bcb6 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:37.723427 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-db1962f1-8613-4a20-a06d-14417b81bcb6 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:37.858496 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-db1962f1-8613-4a20-a06d-14417b81bcb6 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "POST /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550/action" status: 200 len: 28614 microversion: 2.20 time: 0.152344 Feb 17 04:40:37.859231 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 695/1480] 10.222.0.78 () {62 vars in 1309 bytes} [Wed Feb 17 04:40:37 2021] POST /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550/action => generated 28614 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:40:38.872209 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-c0f7d703-bb59-4017-b903-06028170cca0 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:40:38.873458 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-c0f7d703-bb59-4017-b903-06028170cca0 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 5e68206c-24dc-4ec9-b907-bf233d27d550] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:40:38.883213 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-c0f7d703-bb59-4017-b903-06028170cca0 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:38.883753 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-c0f7d703-bb59-4017-b903-06028170cca0 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:38.884755 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-c0f7d703-bb59-4017-b903-06028170cca0 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:38.885258 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-c0f7d703-bb59-4017-b903-06028170cca0 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:39.016244 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-c0f7d703-bb59-4017-b903-06028170cca0 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "POST /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550/action" status: 200 len: 28614 microversion: 2.20 time: 0.147784 Feb 17 04:40:39.017173 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 786/1481] 10.222.0.78 () {62 vars in 1309 bytes} [Wed Feb 17 04:40:38 2021] POST /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550/action => generated 28614 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:40:40.029304 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-da8e233b-ea55-4197-a28f-9b3a05f154a8 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:40:40.030453 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-da8e233b-ea55-4197-a28f-9b3a05f154a8 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 5e68206c-24dc-4ec9-b907-bf233d27d550] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:40:40.039431 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-da8e233b-ea55-4197-a28f-9b3a05f154a8 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:40.039951 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-da8e233b-ea55-4197-a28f-9b3a05f154a8 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:40.040803 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-da8e233b-ea55-4197-a28f-9b3a05f154a8 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:40.041312 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-da8e233b-ea55-4197-a28f-9b3a05f154a8 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:40.170335 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-da8e233b-ea55-4197-a28f-9b3a05f154a8 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "POST /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550/action" status: 200 len: 28614 microversion: 2.20 time: 0.145413 Feb 17 04:40:40.173723 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 696/1482] 10.222.0.78 () {62 vars in 1309 bytes} [Wed Feb 17 04:40:40 2021] POST /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550/action => generated 28614 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:40:41.183878 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-06e03295-a182-4be2-8f67-b9c69d4249ed tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:40:41.185165 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-06e03295-a182-4be2-8f67-b9c69d4249ed tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 5e68206c-24dc-4ec9-b907-bf233d27d550] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:40:41.194547 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-06e03295-a182-4be2-8f67-b9c69d4249ed tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:41.195199 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-06e03295-a182-4be2-8f67-b9c69d4249ed tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:41.196136 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-06e03295-a182-4be2-8f67-b9c69d4249ed tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:41.196637 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-06e03295-a182-4be2-8f67-b9c69d4249ed tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:41.330303 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-06e03295-a182-4be2-8f67-b9c69d4249ed tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "POST /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550/action" status: 200 len: 28614 microversion: 2.20 time: 0.151292 Feb 17 04:40:41.331117 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 787/1483] 10.222.0.78 () {62 vars in 1309 bytes} [Wed Feb 17 04:40:41 2021] POST /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550/action => generated 28614 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:40:42.343817 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-f1bea625-3dbc-4be5-99a8-34cea6f8621b tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:40:42.345089 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-f1bea625-3dbc-4be5-99a8-34cea6f8621b tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 5e68206c-24dc-4ec9-b907-bf233d27d550] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:40:42.353333 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-f1bea625-3dbc-4be5-99a8-34cea6f8621b tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:42.353843 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-f1bea625-3dbc-4be5-99a8-34cea6f8621b tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:42.354731 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-f1bea625-3dbc-4be5-99a8-34cea6f8621b tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:42.355262 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-f1bea625-3dbc-4be5-99a8-34cea6f8621b tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:42.489011 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-f1bea625-3dbc-4be5-99a8-34cea6f8621b tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "POST /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550/action" status: 200 len: 28614 microversion: 2.20 time: 0.150091 Feb 17 04:40:42.489735 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 697/1484] 10.222.0.78 () {62 vars in 1309 bytes} [Wed Feb 17 04:40:42 2021] POST /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550/action => generated 28614 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:40:43.502702 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-33eb619d-043c-4909-b9c6-f791c9b7bc8e tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:40:43.503864 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-33eb619d-043c-4909-b9c6-f791c9b7bc8e tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 5e68206c-24dc-4ec9-b907-bf233d27d550] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:40:43.512367 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-33eb619d-043c-4909-b9c6-f791c9b7bc8e tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:43.512922 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-33eb619d-043c-4909-b9c6-f791c9b7bc8e tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:43.513759 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-33eb619d-043c-4909-b9c6-f791c9b7bc8e tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:43.514246 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-33eb619d-043c-4909-b9c6-f791c9b7bc8e tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:43.646300 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-33eb619d-043c-4909-b9c6-f791c9b7bc8e tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "POST /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550/action" status: 200 len: 28614 microversion: 2.20 time: 0.148518 Feb 17 04:40:43.650513 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 788/1485] 10.222.0.78 () {62 vars in 1309 bytes} [Wed Feb 17 04:40:43 2021] POST /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550/action => generated 28614 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:40:44.660467 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-98e93a97-6d62-4800-8c0e-e56f2ce8ae00 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:40:44.661601 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-98e93a97-6d62-4800-8c0e-e56f2ce8ae00 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 5e68206c-24dc-4ec9-b907-bf233d27d550] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:40:44.670261 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-98e93a97-6d62-4800-8c0e-e56f2ce8ae00 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:44.670774 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-98e93a97-6d62-4800-8c0e-e56f2ce8ae00 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:44.672777 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-98e93a97-6d62-4800-8c0e-e56f2ce8ae00 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:44.673286 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-98e93a97-6d62-4800-8c0e-e56f2ce8ae00 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:44.799021 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-98e93a97-6d62-4800-8c0e-e56f2ce8ae00 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "POST /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550/action" status: 200 len: 28614 microversion: 2.20 time: 0.143913 Feb 17 04:40:44.799765 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 698/1486] 10.222.0.78 () {62 vars in 1309 bytes} [Wed Feb 17 04:40:44 2021] POST /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550/action => generated 28614 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:40:45.813476 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-c0b440e8-55f0-44ca-b1d8-a77ba1168330 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:40:45.814732 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-c0b440e8-55f0-44ca-b1d8-a77ba1168330 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 5e68206c-24dc-4ec9-b907-bf233d27d550] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:40:45.823444 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-c0b440e8-55f0-44ca-b1d8-a77ba1168330 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:45.823959 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-c0b440e8-55f0-44ca-b1d8-a77ba1168330 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:45.824802 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-c0b440e8-55f0-44ca-b1d8-a77ba1168330 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:45.825299 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-c0b440e8-55f0-44ca-b1d8-a77ba1168330 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:45.950213 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-c0b440e8-55f0-44ca-b1d8-a77ba1168330 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "POST /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550/action" status: 200 len: 28614 microversion: 2.20 time: 0.142108 Feb 17 04:40:45.950912 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 789/1487] 10.222.0.78 () {62 vars in 1309 bytes} [Wed Feb 17 04:40:45 2021] POST /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550/action => generated 28614 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:40:46.963479 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-810e6225-6ce5-4861-a7ef-a9e92c6f73f1 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:40:46.964599 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-810e6225-6ce5-4861-a7ef-a9e92c6f73f1 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 5e68206c-24dc-4ec9-b907-bf233d27d550] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:40:46.975600 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-810e6225-6ce5-4861-a7ef-a9e92c6f73f1 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:46.976135 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-810e6225-6ce5-4861-a7ef-a9e92c6f73f1 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:46.977004 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-810e6225-6ce5-4861-a7ef-a9e92c6f73f1 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:46.977506 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-810e6225-6ce5-4861-a7ef-a9e92c6f73f1 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:47.105163 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-810e6225-6ce5-4861-a7ef-a9e92c6f73f1 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "POST /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550/action" status: 200 len: 28614 microversion: 2.20 time: 0.146024 Feb 17 04:40:47.110299 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 699/1488] 10.222.0.78 () {62 vars in 1309 bytes} [Wed Feb 17 04:40:46 2021] POST /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550/action => generated 28614 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:40:48.119395 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-139d3aa5-bb94-4984-a3a3-2ef6ac9b85ca tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:40:48.120536 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-139d3aa5-bb94-4984-a3a3-2ef6ac9b85ca tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 5e68206c-24dc-4ec9-b907-bf233d27d550] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:40:48.129371 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-139d3aa5-bb94-4984-a3a3-2ef6ac9b85ca tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:48.129689 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-139d3aa5-bb94-4984-a3a3-2ef6ac9b85ca tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:48.130536 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-139d3aa5-bb94-4984-a3a3-2ef6ac9b85ca tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:48.131026 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-139d3aa5-bb94-4984-a3a3-2ef6ac9b85ca tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:48.259589 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-139d3aa5-bb94-4984-a3a3-2ef6ac9b85ca tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "POST /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550/action" status: 200 len: 28614 microversion: 2.20 time: 0.144589 Feb 17 04:40:48.260544 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 790/1489] 10.222.0.78 () {62 vars in 1309 bytes} [Wed Feb 17 04:40:48 2021] POST /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550/action => generated 28614 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:40:49.272971 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-1db408b8-a225-45a7-82bd-a866792246cb tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:40:49.274099 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-1db408b8-a225-45a7-82bd-a866792246cb tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 5e68206c-24dc-4ec9-b907-bf233d27d550] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:40:49.283101 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-1db408b8-a225-45a7-82bd-a866792246cb tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:49.283607 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-1db408b8-a225-45a7-82bd-a866792246cb tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:49.284495 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-1db408b8-a225-45a7-82bd-a866792246cb tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:49.284897 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-1db408b8-a225-45a7-82bd-a866792246cb tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:49.418336 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-1db408b8-a225-45a7-82bd-a866792246cb tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "POST /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550/action" status: 200 len: 28614 microversion: 2.20 time: 0.149434 Feb 17 04:40:49.422739 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 700/1490] 10.222.0.78 () {62 vars in 1309 bytes} [Wed Feb 17 04:40:49 2021] POST /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550/action => generated 28614 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:40:50.431494 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-1d5a8cb0-3d4c-4aba-9020-d849ccc1ff57 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:40:50.432667 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-1d5a8cb0-3d4c-4aba-9020-d849ccc1ff57 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 5e68206c-24dc-4ec9-b907-bf233d27d550] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:40:50.442458 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-1d5a8cb0-3d4c-4aba-9020-d849ccc1ff57 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:50.442970 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-1d5a8cb0-3d4c-4aba-9020-d849ccc1ff57 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:50.443849 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-1d5a8cb0-3d4c-4aba-9020-d849ccc1ff57 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:50.444346 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-1d5a8cb0-3d4c-4aba-9020-d849ccc1ff57 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:50.580548 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-1d5a8cb0-3d4c-4aba-9020-d849ccc1ff57 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "POST /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550/action" status: 200 len: 28614 microversion: 2.20 time: 0.153341 Feb 17 04:40:50.581252 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 791/1491] 10.222.0.78 () {62 vars in 1309 bytes} [Wed Feb 17 04:40:50 2021] POST /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550/action => generated 28614 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:40:51.595880 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-ec76ba30-2564-4ec2-8796-6283be4fb744 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:40:51.596761 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-ec76ba30-2564-4ec2-8796-6283be4fb744 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 5e68206c-24dc-4ec9-b907-bf233d27d550] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:40:51.609300 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-ec76ba30-2564-4ec2-8796-6283be4fb744 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:51.609818 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-ec76ba30-2564-4ec2-8796-6283be4fb744 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:51.611349 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-ec76ba30-2564-4ec2-8796-6283be4fb744 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:51.611880 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-ec76ba30-2564-4ec2-8796-6283be4fb744 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:51.755020 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-ec76ba30-2564-4ec2-8796-6283be4fb744 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "POST /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550/action" status: 200 len: 28614 microversion: 2.20 time: 0.164609 Feb 17 04:40:51.756083 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 701/1492] 10.222.0.78 () {62 vars in 1309 bytes} [Wed Feb 17 04:40:51 2021] POST /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550/action => generated 28614 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:40:52.768512 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-af2ec8bb-897c-4459-a2c5-d16bb0e0c32e tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:40:52.769633 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-af2ec8bb-897c-4459-a2c5-d16bb0e0c32e tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 5e68206c-24dc-4ec9-b907-bf233d27d550] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:40:52.778167 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-af2ec8bb-897c-4459-a2c5-d16bb0e0c32e tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:52.778670 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-af2ec8bb-897c-4459-a2c5-d16bb0e0c32e tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:52.779525 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-af2ec8bb-897c-4459-a2c5-d16bb0e0c32e tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:52.780012 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-af2ec8bb-897c-4459-a2c5-d16bb0e0c32e tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:52.925617 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-af2ec8bb-897c-4459-a2c5-d16bb0e0c32e tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "POST /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550/action" status: 200 len: 28614 microversion: 2.20 time: 0.161668 Feb 17 04:40:52.926252 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 792/1493] 10.222.0.78 () {62 vars in 1309 bytes} [Wed Feb 17 04:40:52 2021] POST /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550/action => generated 28614 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:40:53.938111 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-a7bd398d-2623-4394-81c0-f30508079df2 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:40:53.940227 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-a7bd398d-2623-4394-81c0-f30508079df2 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 5e68206c-24dc-4ec9-b907-bf233d27d550] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:40:53.950308 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-a7bd398d-2623-4394-81c0-f30508079df2 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:53.950835 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-a7bd398d-2623-4394-81c0-f30508079df2 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:53.951716 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-a7bd398d-2623-4394-81c0-f30508079df2 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:53.952223 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-a7bd398d-2623-4394-81c0-f30508079df2 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:54.084323 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-a7bd398d-2623-4394-81c0-f30508079df2 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "POST /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550/action" status: 200 len: 28614 microversion: 2.20 time: 0.150853 Feb 17 04:40:54.088722 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 702/1494] 10.222.0.78 () {62 vars in 1309 bytes} [Wed Feb 17 04:40:53 2021] POST /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550/action => generated 28614 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:40:55.098974 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-3fdcbb0e-72ce-468b-ad5e-8243d90cecba tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:40:55.100277 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-3fdcbb0e-72ce-468b-ad5e-8243d90cecba tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 5e68206c-24dc-4ec9-b907-bf233d27d550] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:40:55.109564 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-3fdcbb0e-72ce-468b-ad5e-8243d90cecba tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:55.110128 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-3fdcbb0e-72ce-468b-ad5e-8243d90cecba tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:55.111063 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-3fdcbb0e-72ce-468b-ad5e-8243d90cecba tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:55.111578 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-3fdcbb0e-72ce-468b-ad5e-8243d90cecba tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:55.242415 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-3fdcbb0e-72ce-468b-ad5e-8243d90cecba tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "POST /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550/action" status: 200 len: 28614 microversion: 2.20 time: 0.149194 Feb 17 04:40:55.243146 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 793/1495] 10.222.0.78 () {62 vars in 1309 bytes} [Wed Feb 17 04:40:55 2021] POST /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550/action => generated 28614 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:40:56.254969 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-d531191b-a89f-4b1c-b62d-59f2ee73a82c tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:40:56.256146 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-d531191b-a89f-4b1c-b62d-59f2ee73a82c tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 5e68206c-24dc-4ec9-b907-bf233d27d550] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:40:56.264848 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-d531191b-a89f-4b1c-b62d-59f2ee73a82c tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:56.265367 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-d531191b-a89f-4b1c-b62d-59f2ee73a82c tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:56.266212 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-d531191b-a89f-4b1c-b62d-59f2ee73a82c tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:56.266743 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-d531191b-a89f-4b1c-b62d-59f2ee73a82c tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:56.408915 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-d531191b-a89f-4b1c-b62d-59f2ee73a82c tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "POST /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550/action" status: 200 len: 28614 microversion: 2.20 time: 0.158208 Feb 17 04:40:56.409646 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 703/1496] 10.222.0.78 () {62 vars in 1309 bytes} [Wed Feb 17 04:40:56 2021] POST /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550/action => generated 28614 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:40:57.422145 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-64996d0f-08c6-452b-9d4e-bf501266ee79 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:40:57.424054 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-64996d0f-08c6-452b-9d4e-bf501266ee79 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 5e68206c-24dc-4ec9-b907-bf233d27d550] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:40:57.432784 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-64996d0f-08c6-452b-9d4e-bf501266ee79 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:57.433289 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-64996d0f-08c6-452b-9d4e-bf501266ee79 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:57.434124 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-64996d0f-08c6-452b-9d4e-bf501266ee79 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:57.434616 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-64996d0f-08c6-452b-9d4e-bf501266ee79 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:57.577988 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-64996d0f-08c6-452b-9d4e-bf501266ee79 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "POST /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550/action" status: 200 len: 29344 microversion: 2.20 time: 0.160306 Feb 17 04:40:57.579021 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 794/1497] 10.222.0.78 () {62 vars in 1309 bytes} [Wed Feb 17 04:40:57 2021] POST /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550/action => generated 29344 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:40:58.591594 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-597bcb8a-6c09-412d-b28a-26fe047e9b41 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:40:58.592653 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-597bcb8a-6c09-412d-b28a-26fe047e9b41 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 5e68206c-24dc-4ec9-b907-bf233d27d550] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:40:58.602818 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-597bcb8a-6c09-412d-b28a-26fe047e9b41 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:58.603355 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-597bcb8a-6c09-412d-b28a-26fe047e9b41 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:58.604207 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-597bcb8a-6c09-412d-b28a-26fe047e9b41 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:58.604704 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-597bcb8a-6c09-412d-b28a-26fe047e9b41 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:58.741775 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-597bcb8a-6c09-412d-b28a-26fe047e9b41 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "POST /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550/action" status: 200 len: 31336 microversion: 2.20 time: 0.154610 Feb 17 04:40:58.742743 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 704/1498] 10.222.0.78 () {62 vars in 1309 bytes} [Wed Feb 17 04:40:58 2021] POST /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550/action => generated 31336 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:40:59.755486 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-47671d78-a826-45c0-95b4-91d8afa8a70c tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:40:59.756628 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-47671d78-a826-45c0-95b4-91d8afa8a70c tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 5e68206c-24dc-4ec9-b907-bf233d27d550] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:40:59.765197 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-47671d78-a826-45c0-95b4-91d8afa8a70c tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:59.765707 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-47671d78-a826-45c0-95b4-91d8afa8a70c tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:59.767126 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-47671d78-a826-45c0-95b4-91d8afa8a70c tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:59.767632 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-47671d78-a826-45c0-95b4-91d8afa8a70c tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:59.911204 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-47671d78-a826-45c0-95b4-91d8afa8a70c tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "POST /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550/action" status: 200 len: 32959 microversion: 2.20 time: 0.160508 Feb 17 04:40:59.911955 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 795/1499] 10.222.0.78 () {62 vars in 1309 bytes} [Wed Feb 17 04:40:59 2021] POST /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550/action => generated 32959 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Feb 17 04:41:00.926217 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-518e98a7-d157-40d5-b708-b3f06cfc3543 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:41:00.927422 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-518e98a7-d157-40d5-b708-b3f06cfc3543 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 5e68206c-24dc-4ec9-b907-bf233d27d550] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:41:00.939017 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-518e98a7-d157-40d5-b708-b3f06cfc3543 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:00.939017 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-518e98a7-d157-40d5-b708-b3f06cfc3543 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:00.939017 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-518e98a7-d157-40d5-b708-b3f06cfc3543 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:00.939017 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-518e98a7-d157-40d5-b708-b3f06cfc3543 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:01.087246 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-518e98a7-d157-40d5-b708-b3f06cfc3543 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "POST /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550/action" status: 200 len: 33761 microversion: 2.20 time: 0.166576 Feb 17 04:41:01.091557 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 705/1500] 10.222.0.78 () {62 vars in 1309 bytes} [Wed Feb 17 04:41:00 2021] POST /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550/action => generated 33761 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:41:02.101138 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-6bc30083-a8b3-4d1a-a921-806a8bdaa9b2 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:41:02.102275 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-6bc30083-a8b3-4d1a-a921-806a8bdaa9b2 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 5e68206c-24dc-4ec9-b907-bf233d27d550] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:41:02.112359 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-6bc30083-a8b3-4d1a-a921-806a8bdaa9b2 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:02.112875 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-6bc30083-a8b3-4d1a-a921-806a8bdaa9b2 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:02.113726 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-6bc30083-a8b3-4d1a-a921-806a8bdaa9b2 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:02.114225 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-6bc30083-a8b3-4d1a-a921-806a8bdaa9b2 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:02.271271 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-6bc30083-a8b3-4d1a-a921-806a8bdaa9b2 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "POST /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550/action" status: 200 len: 35031 microversion: 2.20 time: 0.174430 Feb 17 04:41:02.272081 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 796/1501] 10.222.0.78 () {62 vars in 1309 bytes} [Wed Feb 17 04:41:02 2021] POST /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550/action => generated 35031 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:41:02.532911 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-3032deaf-0ff4-45b2-baab-c056fb2befb2 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Calling method '.version_select at 0x7f57c93ea048>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:41:03.284936 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-3032deaf-0ff4-45b2-baab-c056fb2befb2 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] [instance: 62a16d76-4309-472d-9c9e-6e86b36a653c] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:41:03.285492 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-812cde62-88a0-4a65-a26d-829636c794e7 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:41:03.286642 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-812cde62-88a0-4a65-a26d-829636c794e7 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 5e68206c-24dc-4ec9-b907-bf233d27d550] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:41:03.294109 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-3032deaf-0ff4-45b2-baab-c056fb2befb2 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:03.294623 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-3032deaf-0ff4-45b2-baab-c056fb2befb2 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:03.295268 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-812cde62-88a0-4a65-a26d-829636c794e7 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:03.295518 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-3032deaf-0ff4-45b2-baab-c056fb2befb2 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:03.295786 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-812cde62-88a0-4a65-a26d-829636c794e7 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:03.296020 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-3032deaf-0ff4-45b2-baab-c056fb2befb2 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:03.296636 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-812cde62-88a0-4a65-a26d-829636c794e7 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:03.297139 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-812cde62-88a0-4a65-a26d-829636c794e7 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:03.366183 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-3032deaf-0ff4-45b2-baab-c056fb2befb2 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Acquired lock "refresh_cache-62a16d76-4309-472d-9c9e-6e86b36a653c" {{(pid=98178) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:266}} Feb 17 04:41:03.448940 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-812cde62-88a0-4a65-a26d-829636c794e7 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "POST /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550/action" status: 200 len: 36510 microversion: 2.20 time: 0.168392 Feb 17 04:41:03.449913 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 797/1502] 10.222.0.78 () {62 vars in 1309 bytes} [Wed Feb 17 04:41:03 2021] POST /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550/action => generated 36510 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Feb 17 04:41:04.462655 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-750ecace-e9d9-4484-a0bb-24ab82c6afde tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:41:04.463841 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-750ecace-e9d9-4484-a0bb-24ab82c6afde tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 5e68206c-24dc-4ec9-b907-bf233d27d550] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:41:04.472616 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-750ecace-e9d9-4484-a0bb-24ab82c6afde tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:04.473129 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-750ecace-e9d9-4484-a0bb-24ab82c6afde tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:04.473970 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-750ecace-e9d9-4484-a0bb-24ab82c6afde tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:04.474459 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-750ecace-e9d9-4484-a0bb-24ab82c6afde tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:04.619451 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-750ecace-e9d9-4484-a0bb-24ab82c6afde tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "POST /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550/action" status: 200 len: 37953 microversion: 2.20 time: 0.160922 Feb 17 04:41:04.623804 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 798/1503] 10.222.0.78 () {62 vars in 1309 bytes} [Wed Feb 17 04:41:04 2021] POST /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550/action => generated 37953 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Feb 17 04:41:05.152539 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.network.neutron [None req-3032deaf-0ff4-45b2-baab-c056fb2befb2 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] [instance: 62a16d76-4309-472d-9c9e-6e86b36a653c] Building network info cache for instance {{(pid=98178) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1836}} Feb 17 04:41:05.162917 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [req-0bb549db-6066-4e35-aa31-a9119b47a85a req-c69db187-be30-445d-92df-906da8be6001 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "62a16d76-4309-472d-9c9e-6e86b36a653c", "tag": "5ba59ff1-b19b-4ba6-9ef2-07dccd6b3a55"}]} {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:41:05.164571 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:41:05.164571 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: warnings.warn(msg) Feb 17 04:41:05.180859 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [req-0bb549db-6066-4e35-aa31-a9119b47a85a req-c69db187-be30-445d-92df-906da8be6001 service nova] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:05.181366 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [req-0bb549db-6066-4e35-aa31-a9119b47a85a req-c69db187-be30-445d-92df-906da8be6001 service nova] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:05.201748 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.compute.server_external_events [req-0bb549db-6066-4e35-aa31-a9119b47a85a req-c69db187-be30-445d-92df-906da8be6001 service nova] Creating event network-changed:5ba59ff1-b19b-4ba6-9ef2-07dccd6b3a55 for instance 62a16d76-4309-472d-9c9e-6e86b36a653c on hv-cinder-75998 Feb 17 04:41:05.207276 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [req-0bb549db-6066-4e35-aa31-a9119b47a85a req-c69db187-be30-445d-92df-906da8be6001 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048792 Feb 17 04:41:05.207939 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 799/1504] 10.222.0.78 () {64 vars in 1308 bytes} [Wed Feb 17 04:41:05 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 17 04:41:05.633050 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-92875cb0-d149-4eca-8df6-f81802a7a044 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:41:05.635166 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-92875cb0-d149-4eca-8df6-f81802a7a044 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 5e68206c-24dc-4ec9-b907-bf233d27d550] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:41:05.644842 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-92875cb0-d149-4eca-8df6-f81802a7a044 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:05.645286 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-92875cb0-d149-4eca-8df6-f81802a7a044 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:05.646346 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-92875cb0-d149-4eca-8df6-f81802a7a044 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:05.646811 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-92875cb0-d149-4eca-8df6-f81802a7a044 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:05.800498 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-92875cb0-d149-4eca-8df6-f81802a7a044 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "POST /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550/action" status: 200 len: 38167 microversion: 2.20 time: 0.171837 Feb 17 04:41:05.801494 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 800/1505] 10.222.0.78 () {62 vars in 1309 bytes} [Wed Feb 17 04:41:05 2021] POST /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550/action => generated 38167 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Feb 17 04:41:06.814668 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-223b1600-532a-4ba0-b9b7-7d832af5f07d tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:41:06.816096 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-223b1600-532a-4ba0-b9b7-7d832af5f07d tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 5e68206c-24dc-4ec9-b907-bf233d27d550] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:41:06.824724 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-223b1600-532a-4ba0-b9b7-7d832af5f07d tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:06.825232 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-223b1600-532a-4ba0-b9b7-7d832af5f07d tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:06.826206 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-223b1600-532a-4ba0-b9b7-7d832af5f07d tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:06.826702 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-223b1600-532a-4ba0-b9b7-7d832af5f07d tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:06.920151 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.network.neutron [None req-3032deaf-0ff4-45b2-baab-c056fb2befb2 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] [instance: 62a16d76-4309-472d-9c9e-6e86b36a653c] Updating instance_info_cache with network_info: [{"id": "5ba59ff1-b19b-4ba6-9ef2-07dccd6b3a55", "address": "fa:16:3e:08:4c:70", "network": {"id": "736cba91-156c-4244-b589-a5a8068074fb", "bridge": "br-int", "label": "tempest-TestShelveInstance-1453013093-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "79050d22ac3d4c7eb85cd6a19be9ef10", "mtu": 1450, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, "devname": "tap5ba59ff1-b1", "ovs_interfaceid": "5ba59ff1-b19b-4ba6-9ef2-07dccd6b3a55", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "meta": {}}] {{(pid=98178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Feb 17 04:41:06.931068 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-3032deaf-0ff4-45b2-baab-c056fb2befb2 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Releasing lock "refresh_cache-62a16d76-4309-472d-9c9e-6e86b36a653c" {{(pid=98178) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:282}} Feb 17 04:41:06.932024 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-3032deaf-0ff4-45b2-baab-c056fb2befb2 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] 10.222.0.78 "DELETE /compute/v2.1/os-floating-ips/d723d154-1ddd-4576-a038-18ec6b364981" status: 202 len: 0 microversion: 2.1 time: 4.592089 Feb 17 04:41:06.932675 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 706/1506] 10.222.0.78 () {58 vars in 1253 bytes} [Wed Feb 17 04:41:02 2021] DELETE /compute/v2.1/os-floating-ips/d723d154-1ddd-4576-a038-18ec6b364981 => generated 0 bytes in 4594 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:41:06.941709 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-c424bf97-ad52-484d-a143-26284c1e5434 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:41:06.942264 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-c424bf97-ad52-484d-a143-26284c1e5434 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] [instance: 62a16d76-4309-472d-9c9e-6e86b36a653c] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:41:06.950095 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-c424bf97-ad52-484d-a143-26284c1e5434 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:06.950606 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-c424bf97-ad52-484d-a143-26284c1e5434 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:06.951479 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-c424bf97-ad52-484d-a143-26284c1e5434 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:06.951978 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-c424bf97-ad52-484d-a143-26284c1e5434 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:06.975797 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-223b1600-532a-4ba0-b9b7-7d832af5f07d tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "POST /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550/action" status: 200 len: 38167 microversion: 2.20 time: 0.165533 Feb 17 04:41:06.980224 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 801/1507] 10.222.0.78 () {62 vars in 1309 bytes} [Wed Feb 17 04:41:06 2021] POST /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550/action => generated 38167 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Feb 17 04:41:07.018523 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-c424bf97-ad52-484d-a143-26284c1e5434 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] [instance: 62a16d76-4309-472d-9c9e-6e86b36a653c] Going to try to terminate instance {{(pid=98178) delete /opt/stack/nova/nova/compute/api.py:2540}} Feb 17 04:41:07.156401 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-c424bf97-ad52-484d-a143-26284c1e5434 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] 10.222.0.78 "DELETE /compute/v2.1/servers/62a16d76-4309-472d-9c9e-6e86b36a653c" status: 204 len: 0 microversion: 2.1 time: 0.218788 Feb 17 04:41:07.156983 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 707/1508] 10.222.0.78 () {58 vars in 1229 bytes} [Wed Feb 17 04:41:06 2021] DELETE /compute/v2.1/servers/62a16d76-4309-472d-9c9e-6e86b36a653c => generated 0 bytes in 220 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Feb 17 04:41:07.166250 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-65d07a29-ee59-4235-8f1e-869c34407827 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:41:07.167310 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-65d07a29-ee59-4235-8f1e-869c34407827 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] [instance: 62a16d76-4309-472d-9c9e-6e86b36a653c] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:41:07.176730 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-65d07a29-ee59-4235-8f1e-869c34407827 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:07.177240 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-65d07a29-ee59-4235-8f1e-869c34407827 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:07.178098 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-65d07a29-ee59-4235-8f1e-869c34407827 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:07.178591 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-65d07a29-ee59-4235-8f1e-869c34407827 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:07.402242 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-65d07a29-ee59-4235-8f1e-869c34407827 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb8b6c44468c498f9dc0d3a8776433d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79050d22ac3d4c7eb85cd6a19be9ef10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:41:07.411735 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-65d07a29-ee59-4235-8f1e-869c34407827 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] 10.222.0.78 "GET /compute/v2.1/servers/62a16d76-4309-472d-9c9e-6e86b36a653c" status: 200 len: 1453 microversion: 2.1 time: 0.249806 Feb 17 04:41:07.412331 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 802/1509] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:41:07 2021] GET /compute/v2.1/servers/62a16d76-4309-472d-9c9e-6e86b36a653c => generated 1453 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:41:07.990103 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-2f15691e-bb2f-4283-b34f-e1d135bd90c6 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:41:07.991414 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-2f15691e-bb2f-4283-b34f-e1d135bd90c6 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 5e68206c-24dc-4ec9-b907-bf233d27d550] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:41:07.999606 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-2f15691e-bb2f-4283-b34f-e1d135bd90c6 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:08.000355 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-2f15691e-bb2f-4283-b34f-e1d135bd90c6 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:08.001430 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-2f15691e-bb2f-4283-b34f-e1d135bd90c6 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:08.001924 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-2f15691e-bb2f-4283-b34f-e1d135bd90c6 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:08.143235 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-2f15691e-bb2f-4283-b34f-e1d135bd90c6 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "POST /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550/action" status: 200 len: 38167 microversion: 2.20 time: 0.158055 Feb 17 04:41:08.144081 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 708/1510] 10.222.0.78 () {62 vars in 1309 bytes} [Wed Feb 17 04:41:07 2021] POST /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550/action => generated 38167 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:41:08.430613 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-8db180e4-df86-40d6-8e71-8af37b04d940 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:41:08.431291 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-8db180e4-df86-40d6-8e71-8af37b04d940 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] [instance: 62a16d76-4309-472d-9c9e-6e86b36a653c] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:41:08.439599 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-8db180e4-df86-40d6-8e71-8af37b04d940 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:08.440108 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-8db180e4-df86-40d6-8e71-8af37b04d940 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:08.440951 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-8db180e4-df86-40d6-8e71-8af37b04d940 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:08.441449 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-8db180e4-df86-40d6-8e71-8af37b04d940 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:08.663195 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-8db180e4-df86-40d6-8e71-8af37b04d940 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb8b6c44468c498f9dc0d3a8776433d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79050d22ac3d4c7eb85cd6a19be9ef10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:41:08.673290 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-8db180e4-df86-40d6-8e71-8af37b04d940 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] 10.222.0.78 "GET /compute/v2.1/servers/62a16d76-4309-472d-9c9e-6e86b36a653c" status: 200 len: 1453 microversion: 2.1 time: 0.246314 Feb 17 04:41:08.674021 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 803/1511] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:41:08 2021] GET /compute/v2.1/servers/62a16d76-4309-472d-9c9e-6e86b36a653c => generated 1453 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:41:09.159331 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-7564a76f-2a1d-41dd-ab35-608efa8aa790 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:41:09.160485 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-7564a76f-2a1d-41dd-ab35-608efa8aa790 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 5e68206c-24dc-4ec9-b907-bf233d27d550] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:41:09.169271 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-7564a76f-2a1d-41dd-ab35-608efa8aa790 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:09.169782 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-7564a76f-2a1d-41dd-ab35-608efa8aa790 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:09.170640 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-7564a76f-2a1d-41dd-ab35-608efa8aa790 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:09.171164 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-7564a76f-2a1d-41dd-ab35-608efa8aa790 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:09.382533 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-7564a76f-2a1d-41dd-ab35-608efa8aa790 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "POST /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550/action" status: 200 len: 38308 microversion: 2.20 time: 0.229000 Feb 17 04:41:09.383386 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 709/1512] 10.222.0.78 () {62 vars in 1309 bytes} [Wed Feb 17 04:41:09 2021] POST /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550/action => generated 38308 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:41:09.394013 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-53ec48ed-0a73-4015-9744-a4e3932dd266 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:41:09.394562 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-53ec48ed-0a73-4015-9744-a4e3932dd266 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 5e68206c-24dc-4ec9-b907-bf233d27d550] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:41:09.402637 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-53ec48ed-0a73-4015-9744-a4e3932dd266 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:09.403183 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-53ec48ed-0a73-4015-9744-a4e3932dd266 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:09.404108 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-53ec48ed-0a73-4015-9744-a4e3932dd266 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:09.404611 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-53ec48ed-0a73-4015-9744-a4e3932dd266 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:09.472212 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-53ec48ed-0a73-4015-9744-a4e3932dd266 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "GET /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550/ips" status: 200 len: 152 microversion: 2.20 time: 0.082287 Feb 17 04:41:09.472858 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 804/1513] 10.222.0.78 () {60 vars in 1279 bytes} [Wed Feb 17 04:41:09 2021] GET /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550/ips => generated 152 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 04:41:09.635849 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [req-40b03853-67fd-4311-8e8e-f1651d0c6f5e req-cd720817-6801-45b7-8f63-a0c94d0bb116 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62a16d76-4309-472d-9c9e-6e86b36a653c", "name": "network-vif-unplugged", "status": "completed", "tag": "5ba59ff1-b19b-4ba6-9ef2-07dccd6b3a55"}]} {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:41:09.637679 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:41:09.637679 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: warnings.warn(msg) Feb 17 04:41:09.647826 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [req-40b03853-67fd-4311-8e8e-f1651d0c6f5e req-cd720817-6801-45b7-8f63-a0c94d0bb116 service nova] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:09.648335 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [req-40b03853-67fd-4311-8e8e-f1651d0c6f5e req-cd720817-6801-45b7-8f63-a0c94d0bb116 service nova] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:09.666603 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.compute.server_external_events [req-40b03853-67fd-4311-8e8e-f1651d0c6f5e req-cd720817-6801-45b7-8f63-a0c94d0bb116 service nova] Creating event network-vif-unplugged:5ba59ff1-b19b-4ba6-9ef2-07dccd6b3a55 for instance 62a16d76-4309-472d-9c9e-6e86b36a653c on hv-cinder-75998 Feb 17 04:41:09.671943 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [req-40b03853-67fd-4311-8e8e-f1651d0c6f5e req-cd720817-6801-45b7-8f63-a0c94d0bb116 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044460 Feb 17 04:41:09.673427 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 710/1514] 10.222.0.78 () {64 vars in 1308 bytes} [Wed Feb 17 04:41:09 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:41:09.693408 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-5a0fe381-50a2-45b8-8e19-803912cbf1b6 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:41:09.694293 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-5a0fe381-50a2-45b8-8e19-803912cbf1b6 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] [instance: 62a16d76-4309-472d-9c9e-6e86b36a653c] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:41:09.703217 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-5a0fe381-50a2-45b8-8e19-803912cbf1b6 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:09.703743 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-5a0fe381-50a2-45b8-8e19-803912cbf1b6 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:09.704791 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-5a0fe381-50a2-45b8-8e19-803912cbf1b6 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:09.705287 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-5a0fe381-50a2-45b8-8e19-803912cbf1b6 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:10.028859 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-5a0fe381-50a2-45b8-8e19-803912cbf1b6 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb8b6c44468c498f9dc0d3a8776433d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79050d22ac3d4c7eb85cd6a19be9ef10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:41:10.038377 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-5a0fe381-50a2-45b8-8e19-803912cbf1b6 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] 10.222.0.78 "GET /compute/v2.1/servers/62a16d76-4309-472d-9c9e-6e86b36a653c" status: 200 len: 1453 microversion: 2.1 time: 0.349765 Feb 17 04:41:10.039117 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 805/1515] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:41:09 2021] GET /compute/v2.1/servers/62a16d76-4309-472d-9c9e-6e86b36a653c => generated 1453 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:41:10.885493 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [req-cb366aed-a224-46e3-b9f3-712e4afaf343 req-08604bb9-ad4d-4d34-ad74-41ef5b36b2c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62a16d76-4309-472d-9c9e-6e86b36a653c", "name": "network-vif-deleted", "tag": "5ba59ff1-b19b-4ba6-9ef2-07dccd6b3a55"}]} {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:41:10.887159 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:41:10.887159 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: warnings.warn(msg) Feb 17 04:41:10.897444 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [req-cb366aed-a224-46e3-b9f3-712e4afaf343 req-08604bb9-ad4d-4d34-ad74-41ef5b36b2c7 service nova] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:10.898328 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [req-cb366aed-a224-46e3-b9f3-712e4afaf343 req-08604bb9-ad4d-4d34-ad74-41ef5b36b2c7 service nova] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:10.919205 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.compute.server_external_events [req-cb366aed-a224-46e3-b9f3-712e4afaf343 req-08604bb9-ad4d-4d34-ad74-41ef5b36b2c7 service nova] Creating event network-vif-deleted:5ba59ff1-b19b-4ba6-9ef2-07dccd6b3a55 for instance 62a16d76-4309-472d-9c9e-6e86b36a653c on hv-cinder-75998 Feb 17 04:41:10.924124 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [req-cb366aed-a224-46e3-b9f3-712e4afaf343 req-08604bb9-ad4d-4d34-ad74-41ef5b36b2c7 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044007 Feb 17 04:41:10.925038 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 711/1516] 10.222.0.78 () {64 vars in 1308 bytes} [Wed Feb 17 04:41:10 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:41:11.058130 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-cfcc386b-bf84-4ba9-8a5d-8525064bc40b tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:41:11.059235 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-cfcc386b-bf84-4ba9-8a5d-8525064bc40b tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] [instance: 62a16d76-4309-472d-9c9e-6e86b36a653c] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:41:11.069331 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-cfcc386b-bf84-4ba9-8a5d-8525064bc40b tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:11.069843 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-cfcc386b-bf84-4ba9-8a5d-8525064bc40b tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:11.070712 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-cfcc386b-bf84-4ba9-8a5d-8525064bc40b tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:11.071244 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-cfcc386b-bf84-4ba9-8a5d-8525064bc40b tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:11.211553 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-cfcc386b-bf84-4ba9-8a5d-8525064bc40b tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb8b6c44468c498f9dc0d3a8776433d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79050d22ac3d4c7eb85cd6a19be9ef10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:41:11.221297 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-cfcc386b-bf84-4ba9-8a5d-8525064bc40b tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] 10.222.0.78 "GET /compute/v2.1/servers/62a16d76-4309-472d-9c9e-6e86b36a653c" status: 200 len: 1219 microversion: 2.1 time: 0.167260 Feb 17 04:41:11.222012 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 806/1517] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:41:11 2021] GET /compute/v2.1/servers/62a16d76-4309-472d-9c9e-6e86b36a653c => generated 1219 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:41:12.240592 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-4cdbe0d7-b023-4641-af63-21e55af0177c tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:41:12.241268 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-efd46ea0-2980-4c65-ab04-40720db4868e tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:41:12.243103 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-efd46ea0-2980-4c65-ab04-40720db4868e tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] [instance: 62a16d76-4309-472d-9c9e-6e86b36a653c] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:41:12.251274 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-4cdbe0d7-b023-4641-af63-21e55af0177c tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 5e68206c-24dc-4ec9-b907-bf233d27d550] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:41:12.252165 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-efd46ea0-2980-4c65-ab04-40720db4868e tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:12.252687 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-efd46ea0-2980-4c65-ab04-40720db4868e tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:12.253554 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-efd46ea0-2980-4c65-ab04-40720db4868e tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:12.254050 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-efd46ea0-2980-4c65-ab04-40720db4868e tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:12.260116 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-4cdbe0d7-b023-4641-af63-21e55af0177c tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:12.260807 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-4cdbe0d7-b023-4641-af63-21e55af0177c tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:12.261851 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-4cdbe0d7-b023-4641-af63-21e55af0177c tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:12.262420 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-4cdbe0d7-b023-4641-af63-21e55af0177c tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:12.311001 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.wsgi [None req-efd46ea0-2980-4c65-ab04-40720db4868e tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] HTTP exception thrown: Instance 62a16d76-4309-472d-9c9e-6e86b36a653c could not be found. Feb 17 04:41:12.311722 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-efd46ea0-2980-4c65-ab04-40720db4868e tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Returning 404 to user: Instance 62a16d76-4309-472d-9c9e-6e86b36a653c could not be found. {{(pid=98178) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 17 04:41:12.312630 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-efd46ea0-2980-4c65-ab04-40720db4868e tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] 10.222.0.78 "GET /compute/v2.1/servers/62a16d76-4309-472d-9c9e-6e86b36a653c" status: 404 len: 111 microversion: 2.1 time: 0.077544 Feb 17 04:41:12.313973 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 712/1518] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:41:12 2021] GET /compute/v2.1/servers/62a16d76-4309-472d-9c9e-6e86b36a653c => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 17 04:41:12.322639 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-df9e1427-fa99-43d5-bfe4-9e5c7eb17f28 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Calling method '.version_select at 0x7f57c8720510>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:41:12.328918 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.objects.instance [None req-4cdbe0d7-b023-4641-af63-21e55af0177c tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lazy-loading 'flavor' on Instance uuid 5e68206c-24dc-4ec9-b907-bf233d27d550 {{(pid=98179) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Feb 17 04:41:12.580161 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-df9e1427-fa99-43d5-bfe4-9e5c7eb17f28 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] 10.222.0.78 "DELETE /compute/v2.1/os-security-groups/874b7eeb-b4d6-4567-8340-88cb5924cc7f" status: 202 len: 0 microversion: 2.1 time: 0.261240 Feb 17 04:41:12.584030 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 713/1519] 10.222.0.78 () {58 vars in 1262 bytes} [Wed Feb 17 04:41:12 2021] DELETE /compute/v2.1/os-security-groups/874b7eeb-b4d6-4567-8340-88cb5924cc7f => generated 0 bytes in 263 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Feb 17 04:41:12.588978 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-e9529d18-c7ff-40ce-9554-db7a2c5f43e0 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] Calling method '.version_select at 0x7f57c8720f28>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:41:12.609045 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-e9529d18-c7ff-40ce-9554-db7a2c5f43e0 tempest-TestShelveInstance-968777847 tempest-TestShelveInstance-968777847-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-585983373" status: 202 len: 0 microversion: 2.1 time: 0.023685 Feb 17 04:41:12.609964 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 714/1520] 10.222.0.78 () {58 vars in 1241 bytes} [Wed Feb 17 04:41:12 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-585983373 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:41:12.692179 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-4cdbe0d7-b023-4641-af63-21e55af0177c tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "POST /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550/action" status: 202 len: 0 microversion: 2.20 time: 0.455384 Feb 17 04:41:12.692900 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 807/1521] 10.222.0.78 () {62 vars in 1309 bytes} [Wed Feb 17 04:41:12 2021] POST /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550/action => generated 0 bytes in 458 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Feb 17 04:41:12.701636 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-279b1d41-e399-4863-a8f1-2f96269c6a2b tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:41:12.702309 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-279b1d41-e399-4863-a8f1-2f96269c6a2b tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 5e68206c-24dc-4ec9-b907-bf233d27d550] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:41:12.711466 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-279b1d41-e399-4863-a8f1-2f96269c6a2b tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:12.712288 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-279b1d41-e399-4863-a8f1-2f96269c6a2b tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:12.713168 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-279b1d41-e399-4863-a8f1-2f96269c6a2b tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:12.713823 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-279b1d41-e399-4863-a8f1-2f96269c6a2b tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:13.470433 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-279b1d41-e399-4863-a8f1-2f96269c6a2b tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:41:13.480557 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-279b1d41-e399-4863-a8f1-2f96269c6a2b tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:41:13.482409 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-279b1d41-e399-4863-a8f1-2f96269c6a2b tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:41:13.483635 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-279b1d41-e399-4863-a8f1-2f96269c6a2b tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "GET /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550" status: 200 len: 1724 microversion: 2.20 time: 0.786135 Feb 17 04:41:13.484233 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 715/1522] 10.222.0.78 () {60 vars in 1267 bytes} [Wed Feb 17 04:41:12 2021] GET /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550 => generated 1724 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:41:14.505046 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-b2caee4f-ab87-470a-bfba-40e960e52c29 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:41:14.506083 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-b2caee4f-ab87-470a-bfba-40e960e52c29 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 5e68206c-24dc-4ec9-b907-bf233d27d550] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:41:14.514489 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-b2caee4f-ab87-470a-bfba-40e960e52c29 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:14.514992 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-b2caee4f-ab87-470a-bfba-40e960e52c29 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:14.515876 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-b2caee4f-ab87-470a-bfba-40e960e52c29 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:14.517276 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-b2caee4f-ab87-470a-bfba-40e960e52c29 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:14.743618 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-b2caee4f-ab87-470a-bfba-40e960e52c29 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:41:14.754244 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-b2caee4f-ab87-470a-bfba-40e960e52c29 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:41:14.755869 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-b2caee4f-ab87-470a-bfba-40e960e52c29 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:41:14.757088 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-b2caee4f-ab87-470a-bfba-40e960e52c29 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "GET /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550" status: 200 len: 1724 microversion: 2.20 time: 0.256878 Feb 17 04:41:14.757878 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 808/1523] 10.222.0.78 () {60 vars in 1267 bytes} [Wed Feb 17 04:41:14 2021] GET /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550 => generated 1724 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:41:15.777559 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-efb9a71d-2a31-4c17-ab86-0c3d61a10a04 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:41:15.778517 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-efb9a71d-2a31-4c17-ab86-0c3d61a10a04 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 5e68206c-24dc-4ec9-b907-bf233d27d550] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:41:15.788490 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-efb9a71d-2a31-4c17-ab86-0c3d61a10a04 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:15.788995 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-efb9a71d-2a31-4c17-ab86-0c3d61a10a04 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:15.789853 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-efb9a71d-2a31-4c17-ab86-0c3d61a10a04 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:15.790340 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-efb9a71d-2a31-4c17-ab86-0c3d61a10a04 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:16.586953 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-efb9a71d-2a31-4c17-ab86-0c3d61a10a04 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:41:16.605131 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-efb9a71d-2a31-4c17-ab86-0c3d61a10a04 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:41:16.606969 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-efb9a71d-2a31-4c17-ab86-0c3d61a10a04 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:41:16.608373 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-efb9a71d-2a31-4c17-ab86-0c3d61a10a04 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "GET /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550" status: 200 len: 1724 microversion: 2.20 time: 0.835063 Feb 17 04:41:16.609238 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 716/1524] 10.222.0.78 () {60 vars in 1267 bytes} [Wed Feb 17 04:41:15 2021] GET /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550 => generated 1724 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:41:17.629354 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-0989a448-bf2b-4890-ba54-87ba825501e7 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:41:17.629973 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-0989a448-bf2b-4890-ba54-87ba825501e7 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 5e68206c-24dc-4ec9-b907-bf233d27d550] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:41:17.638410 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-0989a448-bf2b-4890-ba54-87ba825501e7 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:17.638890 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-0989a448-bf2b-4890-ba54-87ba825501e7 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:17.639764 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-0989a448-bf2b-4890-ba54-87ba825501e7 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:17.640390 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-0989a448-bf2b-4890-ba54-87ba825501e7 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:18.039132 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-0989a448-bf2b-4890-ba54-87ba825501e7 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:41:18.049849 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-0989a448-bf2b-4890-ba54-87ba825501e7 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:41:18.051448 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-0989a448-bf2b-4890-ba54-87ba825501e7 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:41:18.052627 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-0989a448-bf2b-4890-ba54-87ba825501e7 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "GET /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550" status: 200 len: 1724 microversion: 2.20 time: 0.428302 Feb 17 04:41:18.053461 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 809/1525] 10.222.0.78 () {60 vars in 1267 bytes} [Wed Feb 17 04:41:17 2021] GET /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550 => generated 1724 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:41:19.072545 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-b410b8db-3b59-4822-96cc-6e9f20635d3a tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:41:19.073247 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-b410b8db-3b59-4822-96cc-6e9f20635d3a tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 5e68206c-24dc-4ec9-b907-bf233d27d550] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:41:19.082236 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-b410b8db-3b59-4822-96cc-6e9f20635d3a tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:19.082742 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-b410b8db-3b59-4822-96cc-6e9f20635d3a tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:19.083626 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-b410b8db-3b59-4822-96cc-6e9f20635d3a tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:19.084264 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-b410b8db-3b59-4822-96cc-6e9f20635d3a tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:19.316178 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-b410b8db-3b59-4822-96cc-6e9f20635d3a tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:41:19.329325 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-b410b8db-3b59-4822-96cc-6e9f20635d3a tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:41:19.330930 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-b410b8db-3b59-4822-96cc-6e9f20635d3a tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:41:19.332329 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-b410b8db-3b59-4822-96cc-6e9f20635d3a tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "GET /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550" status: 200 len: 1724 microversion: 2.20 time: 0.263971 Feb 17 04:41:19.344719 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 717/1526] 10.222.0.78 () {60 vars in 1267 bytes} [Wed Feb 17 04:41:19 2021] GET /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550 => generated 1724 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 17 04:41:20.351243 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-83eefdd7-b22e-48d4-9e85-5b907cd017e4 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:41:20.351896 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-83eefdd7-b22e-48d4-9e85-5b907cd017e4 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 5e68206c-24dc-4ec9-b907-bf233d27d550] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:41:20.361104 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-83eefdd7-b22e-48d4-9e85-5b907cd017e4 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:20.361600 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-83eefdd7-b22e-48d4-9e85-5b907cd017e4 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:20.362730 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-83eefdd7-b22e-48d4-9e85-5b907cd017e4 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:20.363257 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-83eefdd7-b22e-48d4-9e85-5b907cd017e4 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:20.821822 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-83eefdd7-b22e-48d4-9e85-5b907cd017e4 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:41:20.833093 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-83eefdd7-b22e-48d4-9e85-5b907cd017e4 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:41:20.834703 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-83eefdd7-b22e-48d4-9e85-5b907cd017e4 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:41:20.835925 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-83eefdd7-b22e-48d4-9e85-5b907cd017e4 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "GET /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550" status: 200 len: 1724 microversion: 2.20 time: 0.488775 Feb 17 04:41:20.848694 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 810/1527] 10.222.0.78 () {60 vars in 1267 bytes} [Wed Feb 17 04:41:20 2021] GET /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550 => generated 1724 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:41:21.857222 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-fba3a9d8-e87d-4987-a8a5-9c200024fee8 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:41:21.857882 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-fba3a9d8-e87d-4987-a8a5-9c200024fee8 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 5e68206c-24dc-4ec9-b907-bf233d27d550] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:41:21.866463 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-fba3a9d8-e87d-4987-a8a5-9c200024fee8 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:21.866971 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-fba3a9d8-e87d-4987-a8a5-9c200024fee8 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:21.867842 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-fba3a9d8-e87d-4987-a8a5-9c200024fee8 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:21.868338 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-fba3a9d8-e87d-4987-a8a5-9c200024fee8 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:22.098383 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-fba3a9d8-e87d-4987-a8a5-9c200024fee8 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:41:22.108383 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-fba3a9d8-e87d-4987-a8a5-9c200024fee8 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:41:22.111096 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-fba3a9d8-e87d-4987-a8a5-9c200024fee8 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:41:22.112287 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-fba3a9d8-e87d-4987-a8a5-9c200024fee8 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "GET /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550" status: 200 len: 1724 microversion: 2.20 time: 0.259624 Feb 17 04:41:22.113061 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 718/1528] 10.222.0.78 () {60 vars in 1267 bytes} [Wed Feb 17 04:41:21 2021] GET /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550 => generated 1724 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:41:23.132260 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-b67942e3-42ce-4054-af2b-05b9ba8ca3c1 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:41:23.133735 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-b67942e3-42ce-4054-af2b-05b9ba8ca3c1 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 5e68206c-24dc-4ec9-b907-bf233d27d550] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:41:23.143163 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-b67942e3-42ce-4054-af2b-05b9ba8ca3c1 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:23.144019 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-b67942e3-42ce-4054-af2b-05b9ba8ca3c1 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:23.144876 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-b67942e3-42ce-4054-af2b-05b9ba8ca3c1 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:23.145370 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-b67942e3-42ce-4054-af2b-05b9ba8ca3c1 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:23.386468 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-b67942e3-42ce-4054-af2b-05b9ba8ca3c1 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:41:23.397288 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-b67942e3-42ce-4054-af2b-05b9ba8ca3c1 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:41:23.399347 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-b67942e3-42ce-4054-af2b-05b9ba8ca3c1 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:41:23.400617 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-b67942e3-42ce-4054-af2b-05b9ba8ca3c1 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "GET /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550" status: 200 len: 1724 microversion: 2.20 time: 0.272499 Feb 17 04:41:23.401195 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 811/1529] 10.222.0.78 () {60 vars in 1267 bytes} [Wed Feb 17 04:41:23 2021] GET /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550 => generated 1724 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:41:24.420242 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-a08586bf-68ed-41d9-b656-33cda9cc4321 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:41:24.420922 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-a08586bf-68ed-41d9-b656-33cda9cc4321 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 5e68206c-24dc-4ec9-b907-bf233d27d550] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:41:24.429452 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-a08586bf-68ed-41d9-b656-33cda9cc4321 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:24.429955 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-a08586bf-68ed-41d9-b656-33cda9cc4321 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:24.430805 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-a08586bf-68ed-41d9-b656-33cda9cc4321 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:24.431353 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-a08586bf-68ed-41d9-b656-33cda9cc4321 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:24.840078 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-a08586bf-68ed-41d9-b656-33cda9cc4321 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:41:24.851165 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-a08586bf-68ed-41d9-b656-33cda9cc4321 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:41:24.852759 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-a08586bf-68ed-41d9-b656-33cda9cc4321 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:41:24.853957 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-a08586bf-68ed-41d9-b656-33cda9cc4321 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "GET /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550" status: 200 len: 1724 microversion: 2.20 time: 0.437750 Feb 17 04:41:24.854531 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 719/1530] 10.222.0.78 () {60 vars in 1267 bytes} [Wed Feb 17 04:41:24 2021] GET /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550 => generated 1724 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:41:25.874236 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-062621ec-599a-404c-9b8e-735d373f6cdf tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:41:25.875364 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-062621ec-599a-404c-9b8e-735d373f6cdf tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 5e68206c-24dc-4ec9-b907-bf233d27d550] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:41:25.883692 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-062621ec-599a-404c-9b8e-735d373f6cdf tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:25.884346 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-062621ec-599a-404c-9b8e-735d373f6cdf tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:25.885277 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-062621ec-599a-404c-9b8e-735d373f6cdf tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:25.885907 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-062621ec-599a-404c-9b8e-735d373f6cdf tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:26.117442 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-062621ec-599a-404c-9b8e-735d373f6cdf tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:41:26.129331 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-062621ec-599a-404c-9b8e-735d373f6cdf tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:41:26.130918 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-062621ec-599a-404c-9b8e-735d373f6cdf tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:41:26.143068 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-062621ec-599a-404c-9b8e-735d373f6cdf tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "GET /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550" status: 200 len: 1724 microversion: 2.20 time: 0.272601 Feb 17 04:41:26.151106 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 812/1531] 10.222.0.78 () {60 vars in 1267 bytes} [Wed Feb 17 04:41:25 2021] GET /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550 => generated 1724 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:41:27.162225 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-6e0036af-83ab-4df4-b51a-93ba6d1536e5 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:41:27.163464 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-6e0036af-83ab-4df4-b51a-93ba6d1536e5 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 5e68206c-24dc-4ec9-b907-bf233d27d550] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:41:27.177608 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-6e0036af-83ab-4df4-b51a-93ba6d1536e5 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:27.178132 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-6e0036af-83ab-4df4-b51a-93ba6d1536e5 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:27.178977 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-6e0036af-83ab-4df4-b51a-93ba6d1536e5 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:27.179688 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-6e0036af-83ab-4df4-b51a-93ba6d1536e5 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:27.413788 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-6e0036af-83ab-4df4-b51a-93ba6d1536e5 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:41:27.427174 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-6e0036af-83ab-4df4-b51a-93ba6d1536e5 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:41:27.429465 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-6e0036af-83ab-4df4-b51a-93ba6d1536e5 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:41:27.431703 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-6e0036af-83ab-4df4-b51a-93ba6d1536e5 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "GET /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550" status: 200 len: 1724 microversion: 2.20 time: 0.273215 Feb 17 04:41:27.432534 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 720/1532] 10.222.0.78 () {60 vars in 1267 bytes} [Wed Feb 17 04:41:27 2021] GET /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550 => generated 1724 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:41:28.452062 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-683ce2b3-e97b-4bbe-a790-3787e9695f6b tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:41:28.452661 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-683ce2b3-e97b-4bbe-a790-3787e9695f6b tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 5e68206c-24dc-4ec9-b907-bf233d27d550] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:41:28.461616 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-683ce2b3-e97b-4bbe-a790-3787e9695f6b tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:28.462125 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-683ce2b3-e97b-4bbe-a790-3787e9695f6b tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:28.463054 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-683ce2b3-e97b-4bbe-a790-3787e9695f6b tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:28.463560 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-683ce2b3-e97b-4bbe-a790-3787e9695f6b tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:28.690474 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-683ce2b3-e97b-4bbe-a790-3787e9695f6b tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:41:28.699990 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-683ce2b3-e97b-4bbe-a790-3787e9695f6b tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:41:28.701569 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-683ce2b3-e97b-4bbe-a790-3787e9695f6b tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:41:28.703020 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-683ce2b3-e97b-4bbe-a790-3787e9695f6b tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "GET /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550" status: 200 len: 1724 microversion: 2.20 time: 0.255239 Feb 17 04:41:28.703621 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 813/1533] 10.222.0.78 () {60 vars in 1267 bytes} [Wed Feb 17 04:41:28 2021] GET /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550 => generated 1724 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:41:29.723363 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-810ebc61-6b76-4ec1-be08-fc47ae67b3f5 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:41:29.724032 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-810ebc61-6b76-4ec1-be08-fc47ae67b3f5 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 5e68206c-24dc-4ec9-b907-bf233d27d550] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:41:29.732430 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-810ebc61-6b76-4ec1-be08-fc47ae67b3f5 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:29.732943 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-810ebc61-6b76-4ec1-be08-fc47ae67b3f5 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:29.733782 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-810ebc61-6b76-4ec1-be08-fc47ae67b3f5 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:29.734280 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-810ebc61-6b76-4ec1-be08-fc47ae67b3f5 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:29.947966 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-810ebc61-6b76-4ec1-be08-fc47ae67b3f5 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:41:29.957366 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-810ebc61-6b76-4ec1-be08-fc47ae67b3f5 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:41:29.958956 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-810ebc61-6b76-4ec1-be08-fc47ae67b3f5 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:41:29.960185 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-810ebc61-6b76-4ec1-be08-fc47ae67b3f5 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "GET /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550" status: 200 len: 1745 microversion: 2.20 time: 0.241684 Feb 17 04:41:29.960786 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 721/1534] 10.222.0.78 () {60 vars in 1267 bytes} [Wed Feb 17 04:41:29 2021] GET /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550 => generated 1745 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:41:30.980416 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-fe64505c-2596-4fd4-957f-9c1106acbd24 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:41:30.981052 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-fe64505c-2596-4fd4-957f-9c1106acbd24 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 5e68206c-24dc-4ec9-b907-bf233d27d550] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:41:30.989973 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-fe64505c-2596-4fd4-957f-9c1106acbd24 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:30.990471 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-fe64505c-2596-4fd4-957f-9c1106acbd24 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:30.991332 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-fe64505c-2596-4fd4-957f-9c1106acbd24 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:30.991816 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-fe64505c-2596-4fd4-957f-9c1106acbd24 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:31.205462 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-fe64505c-2596-4fd4-957f-9c1106acbd24 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:41:31.214719 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-fe64505c-2596-4fd4-957f-9c1106acbd24 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:41:31.216349 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-fe64505c-2596-4fd4-957f-9c1106acbd24 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:41:31.217517 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-fe64505c-2596-4fd4-957f-9c1106acbd24 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "GET /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550" status: 200 len: 1745 microversion: 2.20 time: 0.241180 Feb 17 04:41:31.218092 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 814/1535] 10.222.0.78 () {60 vars in 1267 bytes} [Wed Feb 17 04:41:30 2021] GET /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550 => generated 1745 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:41:32.237857 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-40c5e725-13a0-4086-a96e-f4055e1b4eed tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:41:32.238563 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-40c5e725-13a0-4086-a96e-f4055e1b4eed tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 5e68206c-24dc-4ec9-b907-bf233d27d550] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:41:32.246545 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-40c5e725-13a0-4086-a96e-f4055e1b4eed tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:32.247077 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-40c5e725-13a0-4086-a96e-f4055e1b4eed tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:32.247940 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-40c5e725-13a0-4086-a96e-f4055e1b4eed tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:32.248440 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-40c5e725-13a0-4086-a96e-f4055e1b4eed tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:32.463880 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-40c5e725-13a0-4086-a96e-f4055e1b4eed tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:41:32.474530 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-40c5e725-13a0-4086-a96e-f4055e1b4eed tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:41:32.476161 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-40c5e725-13a0-4086-a96e-f4055e1b4eed tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:41:32.477358 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-40c5e725-13a0-4086-a96e-f4055e1b4eed tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "GET /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550" status: 200 len: 1745 microversion: 2.20 time: 0.244253 Feb 17 04:41:32.478042 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 722/1536] 10.222.0.78 () {60 vars in 1267 bytes} [Wed Feb 17 04:41:32 2021] GET /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550 => generated 1745 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:41:33.497327 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-960b699f-1a63-408c-9df8-92cca1c671ca tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:41:33.498008 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-960b699f-1a63-408c-9df8-92cca1c671ca tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 5e68206c-24dc-4ec9-b907-bf233d27d550] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:41:33.506074 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-960b699f-1a63-408c-9df8-92cca1c671ca tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:33.506586 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-960b699f-1a63-408c-9df8-92cca1c671ca tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:33.507484 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-960b699f-1a63-408c-9df8-92cca1c671ca tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:33.507982 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-960b699f-1a63-408c-9df8-92cca1c671ca tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:33.862134 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-960b699f-1a63-408c-9df8-92cca1c671ca tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:41:33.871457 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-960b699f-1a63-408c-9df8-92cca1c671ca tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:41:33.873036 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-960b699f-1a63-408c-9df8-92cca1c671ca tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:41:33.874201 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-960b699f-1a63-408c-9df8-92cca1c671ca tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "GET /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550" status: 200 len: 1745 microversion: 2.20 time: 0.381029 Feb 17 04:41:33.874781 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 815/1537] 10.222.0.78 () {60 vars in 1267 bytes} [Wed Feb 17 04:41:33 2021] GET /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550 => generated 1745 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:41:34.894830 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-9c286cd4-703b-4c0c-b6d4-c3db5e9d341e tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:41:34.895642 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-9c286cd4-703b-4c0c-b6d4-c3db5e9d341e tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 5e68206c-24dc-4ec9-b907-bf233d27d550] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:41:34.903588 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-9c286cd4-703b-4c0c-b6d4-c3db5e9d341e tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:34.904080 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-9c286cd4-703b-4c0c-b6d4-c3db5e9d341e tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:34.904920 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-9c286cd4-703b-4c0c-b6d4-c3db5e9d341e tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:34.905416 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-9c286cd4-703b-4c0c-b6d4-c3db5e9d341e tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:35.117068 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-9c286cd4-703b-4c0c-b6d4-c3db5e9d341e tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:41:35.126226 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-9c286cd4-703b-4c0c-b6d4-c3db5e9d341e tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:41:35.127839 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-9c286cd4-703b-4c0c-b6d4-c3db5e9d341e tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:41:35.129584 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-9c286cd4-703b-4c0c-b6d4-c3db5e9d341e tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "GET /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550" status: 200 len: 1745 microversion: 2.20 time: 0.239636 Feb 17 04:41:35.130165 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 723/1538] 10.222.0.78 () {60 vars in 1267 bytes} [Wed Feb 17 04:41:34 2021] GET /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550 => generated 1745 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:41:36.149500 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-0538c37f-d99a-4065-95bb-556f589596fd tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:41:36.150171 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-0538c37f-d99a-4065-95bb-556f589596fd tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 5e68206c-24dc-4ec9-b907-bf233d27d550] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:41:36.158160 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-0538c37f-d99a-4065-95bb-556f589596fd tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:36.158671 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-0538c37f-d99a-4065-95bb-556f589596fd tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:36.159533 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-0538c37f-d99a-4065-95bb-556f589596fd tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:36.160092 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-0538c37f-d99a-4065-95bb-556f589596fd tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:36.375002 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-0538c37f-d99a-4065-95bb-556f589596fd tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:41:36.384883 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-0538c37f-d99a-4065-95bb-556f589596fd tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:41:36.386483 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-0538c37f-d99a-4065-95bb-556f589596fd tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:41:36.387722 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-0538c37f-d99a-4065-95bb-556f589596fd tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "GET /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550" status: 200 len: 1745 microversion: 2.20 time: 0.242393 Feb 17 04:41:36.388299 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 816/1539] 10.222.0.78 () {60 vars in 1267 bytes} [Wed Feb 17 04:41:36 2021] GET /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550 => generated 1745 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:41:37.407285 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-11b29ba0-0155-4d32-8ae5-62a11affd8fc tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:41:37.408127 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-11b29ba0-0155-4d32-8ae5-62a11affd8fc tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 5e68206c-24dc-4ec9-b907-bf233d27d550] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:41:37.416544 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-11b29ba0-0155-4d32-8ae5-62a11affd8fc tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:37.417053 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-11b29ba0-0155-4d32-8ae5-62a11affd8fc tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:37.417887 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-11b29ba0-0155-4d32-8ae5-62a11affd8fc tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:37.418374 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-11b29ba0-0155-4d32-8ae5-62a11affd8fc tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:37.632295 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-11b29ba0-0155-4d32-8ae5-62a11affd8fc tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:41:37.641476 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-11b29ba0-0155-4d32-8ae5-62a11affd8fc tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:41:37.643076 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-11b29ba0-0155-4d32-8ae5-62a11affd8fc tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:41:37.644913 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-11b29ba0-0155-4d32-8ae5-62a11affd8fc tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "GET /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550" status: 200 len: 1745 microversion: 2.20 time: 0.241058 Feb 17 04:41:37.645510 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 724/1540] 10.222.0.78 () {60 vars in 1267 bytes} [Wed Feb 17 04:41:37 2021] GET /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550 => generated 1745 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:41:38.664941 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-41dd66db-f92a-441b-8863-7acba8bb2865 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:41:38.665756 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-41dd66db-f92a-441b-8863-7acba8bb2865 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 5e68206c-24dc-4ec9-b907-bf233d27d550] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:41:38.673733 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-41dd66db-f92a-441b-8863-7acba8bb2865 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:38.674235 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-41dd66db-f92a-441b-8863-7acba8bb2865 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:38.675086 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-41dd66db-f92a-441b-8863-7acba8bb2865 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:38.676264 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-41dd66db-f92a-441b-8863-7acba8bb2865 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:38.898397 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-41dd66db-f92a-441b-8863-7acba8bb2865 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:41:38.907856 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-41dd66db-f92a-441b-8863-7acba8bb2865 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:41:38.909670 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-41dd66db-f92a-441b-8863-7acba8bb2865 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:41:38.911316 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-41dd66db-f92a-441b-8863-7acba8bb2865 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "GET /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550" status: 200 len: 1745 microversion: 2.20 time: 0.250362 Feb 17 04:41:38.912599 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 817/1541] 10.222.0.78 () {60 vars in 1267 bytes} [Wed Feb 17 04:41:38 2021] GET /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550 => generated 1745 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 17 04:41:39.930728 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-9a1d67c5-a55d-4030-9a53-652ce97b35fa tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:41:39.931441 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-9a1d67c5-a55d-4030-9a53-652ce97b35fa tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 5e68206c-24dc-4ec9-b907-bf233d27d550] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:41:39.940166 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-9a1d67c5-a55d-4030-9a53-652ce97b35fa tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:39.940674 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-9a1d67c5-a55d-4030-9a53-652ce97b35fa tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:39.942230 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-9a1d67c5-a55d-4030-9a53-652ce97b35fa tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:39.942729 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-9a1d67c5-a55d-4030-9a53-652ce97b35fa tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:40.403871 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-9a1d67c5-a55d-4030-9a53-652ce97b35fa tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:41:40.414979 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-9a1d67c5-a55d-4030-9a53-652ce97b35fa tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:41:40.416620 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-9a1d67c5-a55d-4030-9a53-652ce97b35fa tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:41:40.417825 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-9a1d67c5-a55d-4030-9a53-652ce97b35fa tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "GET /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550" status: 200 len: 1740 microversion: 2.20 time: 0.491267 Feb 17 04:41:40.423415 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 725/1542] 10.222.0.78 () {60 vars in 1267 bytes} [Wed Feb 17 04:41:39 2021] GET /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550 => generated 1740 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:41:41.437438 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-a17b6d15-8956-42cb-80ef-b8f293e522f0 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:41:41.438036 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-a17b6d15-8956-42cb-80ef-b8f293e522f0 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 5e68206c-24dc-4ec9-b907-bf233d27d550] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:41:41.447435 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-a17b6d15-8956-42cb-80ef-b8f293e522f0 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:41.448035 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-a17b6d15-8956-42cb-80ef-b8f293e522f0 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:41.448876 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-a17b6d15-8956-42cb-80ef-b8f293e522f0 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:41.449415 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-a17b6d15-8956-42cb-80ef-b8f293e522f0 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:41.691799 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-a17b6d15-8956-42cb-80ef-b8f293e522f0 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:41:41.701870 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-a17b6d15-8956-42cb-80ef-b8f293e522f0 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:41:41.703614 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-a17b6d15-8956-42cb-80ef-b8f293e522f0 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:41:41.704916 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-a17b6d15-8956-42cb-80ef-b8f293e522f0 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "GET /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550" status: 200 len: 1740 microversion: 2.20 time: 0.271990 Feb 17 04:41:41.705600 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 818/1543] 10.222.0.78 () {60 vars in 1267 bytes} [Wed Feb 17 04:41:41 2021] GET /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550 => generated 1740 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:41:42.726989 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-d9b8de43-4962-4d30-a350-7d85fd511f18 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:41:42.728276 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-d9b8de43-4962-4d30-a350-7d85fd511f18 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 5e68206c-24dc-4ec9-b907-bf233d27d550] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:41:42.737710 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-d9b8de43-4962-4d30-a350-7d85fd511f18 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:42.739085 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-d9b8de43-4962-4d30-a350-7d85fd511f18 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:42.740194 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-d9b8de43-4962-4d30-a350-7d85fd511f18 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:42.740776 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-d9b8de43-4962-4d30-a350-7d85fd511f18 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:43.059530 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-d9b8de43-4962-4d30-a350-7d85fd511f18 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:41:43.071477 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-d9b8de43-4962-4d30-a350-7d85fd511f18 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:41:43.073774 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-d9b8de43-4962-4d30-a350-7d85fd511f18 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:41:43.075339 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-d9b8de43-4962-4d30-a350-7d85fd511f18 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "GET /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550" status: 200 len: 1740 microversion: 2.20 time: 0.354283 Feb 17 04:41:43.076088 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 726/1544] 10.222.0.78 () {60 vars in 1267 bytes} [Wed Feb 17 04:41:42 2021] GET /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550 => generated 1740 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:41:44.095317 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-edeeface-29ab-4099-8f68-8b33ce73f644 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:41:44.096695 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-edeeface-29ab-4099-8f68-8b33ce73f644 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 5e68206c-24dc-4ec9-b907-bf233d27d550] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:41:44.105868 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-edeeface-29ab-4099-8f68-8b33ce73f644 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:44.106966 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-edeeface-29ab-4099-8f68-8b33ce73f644 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:44.108040 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-edeeface-29ab-4099-8f68-8b33ce73f644 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:44.108726 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-edeeface-29ab-4099-8f68-8b33ce73f644 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:44.390003 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-edeeface-29ab-4099-8f68-8b33ce73f644 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:41:44.399933 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-edeeface-29ab-4099-8f68-8b33ce73f644 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:41:44.402289 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-edeeface-29ab-4099-8f68-8b33ce73f644 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:41:44.403841 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-edeeface-29ab-4099-8f68-8b33ce73f644 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "GET /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550" status: 200 len: 1740 microversion: 2.20 time: 0.312508 Feb 17 04:41:44.404666 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 819/1545] 10.222.0.78 () {60 vars in 1267 bytes} [Wed Feb 17 04:41:44 2021] GET /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550 => generated 1740 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:41:45.426691 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-489086e9-1b91-4509-9579-419a56bb9798 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:41:45.427448 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-489086e9-1b91-4509-9579-419a56bb9798 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 5e68206c-24dc-4ec9-b907-bf233d27d550] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:41:45.440525 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-489086e9-1b91-4509-9579-419a56bb9798 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:45.441040 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-489086e9-1b91-4509-9579-419a56bb9798 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:45.442817 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-489086e9-1b91-4509-9579-419a56bb9798 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:45.443708 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-489086e9-1b91-4509-9579-419a56bb9798 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:45.679394 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-489086e9-1b91-4509-9579-419a56bb9798 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:41:45.690246 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-489086e9-1b91-4509-9579-419a56bb9798 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:41:45.691984 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-489086e9-1b91-4509-9579-419a56bb9798 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:41:45.693268 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-489086e9-1b91-4509-9579-419a56bb9798 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "GET /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550" status: 200 len: 1740 microversion: 2.20 time: 0.270723 Feb 17 04:41:45.693906 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 727/1546] 10.222.0.78 () {60 vars in 1267 bytes} [Wed Feb 17 04:41:45 2021] GET /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550 => generated 1740 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:41:46.714329 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-90f1e62a-9a13-4517-a093-b2cd1fd4592b tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:41:46.716020 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-90f1e62a-9a13-4517-a093-b2cd1fd4592b tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 5e68206c-24dc-4ec9-b907-bf233d27d550] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:41:46.724205 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-90f1e62a-9a13-4517-a093-b2cd1fd4592b tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:46.724722 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-90f1e62a-9a13-4517-a093-b2cd1fd4592b tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:46.725612 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-90f1e62a-9a13-4517-a093-b2cd1fd4592b tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:46.726114 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-90f1e62a-9a13-4517-a093-b2cd1fd4592b tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:46.880354 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 17 04:41:46.880604 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: Wed Feb 17 04:41:46 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 17 04:41:46.985643 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-90f1e62a-9a13-4517-a093-b2cd1fd4592b tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:41:47.012671 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-90f1e62a-9a13-4517-a093-b2cd1fd4592b tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:41:47.014387 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-90f1e62a-9a13-4517-a093-b2cd1fd4592b tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:41:47.016964 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-90f1e62a-9a13-4517-a093-b2cd1fd4592b tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "GET /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550" status: 200 len: 1740 microversion: 2.20 time: 0.306956 Feb 17 04:41:47.019177 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 820/1547] 10.222.0.78 () {60 vars in 1267 bytes} [Wed Feb 17 04:41:46 2021] GET /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550 => generated 1740 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:41:48.039453 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-7bc8d4cc-3392-473f-b808-14a517741917 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:41:48.040138 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-7bc8d4cc-3392-473f-b808-14a517741917 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 5e68206c-24dc-4ec9-b907-bf233d27d550] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:41:48.050120 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-7bc8d4cc-3392-473f-b808-14a517741917 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:48.051292 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-7bc8d4cc-3392-473f-b808-14a517741917 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:48.052246 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-7bc8d4cc-3392-473f-b808-14a517741917 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:48.052747 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-7bc8d4cc-3392-473f-b808-14a517741917 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:48.292135 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-7bc8d4cc-3392-473f-b808-14a517741917 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:41:48.304054 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-7bc8d4cc-3392-473f-b808-14a517741917 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:41:48.305741 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-7bc8d4cc-3392-473f-b808-14a517741917 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:41:48.308992 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-7bc8d4cc-3392-473f-b808-14a517741917 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "GET /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550" status: 200 len: 1740 microversion: 2.20 time: 0.272973 Feb 17 04:41:48.319651 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 728/1548] 10.222.0.78 () {60 vars in 1267 bytes} [Wed Feb 17 04:41:48 2021] GET /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550 => generated 1740 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:41:49.136977 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 17 04:41:49.137744 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: Wed Feb 17 04:41:49 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 17 04:41:49.328802 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-5df0a6e4-e5ab-4f1b-960f-30a93744f98c tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:41:49.329475 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-5df0a6e4-e5ab-4f1b-960f-30a93744f98c tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 5e68206c-24dc-4ec9-b907-bf233d27d550] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:41:49.345781 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-5df0a6e4-e5ab-4f1b-960f-30a93744f98c tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:49.345781 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-5df0a6e4-e5ab-4f1b-960f-30a93744f98c tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:49.345781 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-5df0a6e4-e5ab-4f1b-960f-30a93744f98c tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:49.345781 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-5df0a6e4-e5ab-4f1b-960f-30a93744f98c tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:49.587002 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-5df0a6e4-e5ab-4f1b-960f-30a93744f98c tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:41:49.596302 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-5df0a6e4-e5ab-4f1b-960f-30a93744f98c tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:41:49.598111 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-5df0a6e4-e5ab-4f1b-960f-30a93744f98c tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:41:49.599345 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-5df0a6e4-e5ab-4f1b-960f-30a93744f98c tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "GET /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550" status: 200 len: 1740 microversion: 2.20 time: 0.274646 Feb 17 04:41:49.599930 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 821/1549] 10.222.0.78 () {60 vars in 1267 bytes} [Wed Feb 17 04:41:49 2021] GET /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550 => generated 1740 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:41:50.618849 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-5678659b-e6fd-4fbf-9a58-6b6383cc6cc7 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:41:50.620286 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-5678659b-e6fd-4fbf-9a58-6b6383cc6cc7 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 5e68206c-24dc-4ec9-b907-bf233d27d550] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:41:50.631206 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-5678659b-e6fd-4fbf-9a58-6b6383cc6cc7 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:50.631730 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-5678659b-e6fd-4fbf-9a58-6b6383cc6cc7 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:50.632595 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-5678659b-e6fd-4fbf-9a58-6b6383cc6cc7 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:50.633096 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-5678659b-e6fd-4fbf-9a58-6b6383cc6cc7 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:50.851580 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-5678659b-e6fd-4fbf-9a58-6b6383cc6cc7 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:41:50.861202 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-5678659b-e6fd-4fbf-9a58-6b6383cc6cc7 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:41:50.862775 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-5678659b-e6fd-4fbf-9a58-6b6383cc6cc7 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:41:50.864651 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-5678659b-e6fd-4fbf-9a58-6b6383cc6cc7 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "GET /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550" status: 200 len: 1722 microversion: 2.20 time: 0.249853 Feb 17 04:41:50.865236 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 729/1550] 10.222.0.78 () {60 vars in 1267 bytes} [Wed Feb 17 04:41:50 2021] GET /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550 => generated 1722 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:41:51.885580 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-f9db4037-5699-4d27-b19a-fb2b07c00c57 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:41:51.886251 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-f9db4037-5699-4d27-b19a-fb2b07c00c57 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 5e68206c-24dc-4ec9-b907-bf233d27d550] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:41:51.894846 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-f9db4037-5699-4d27-b19a-fb2b07c00c57 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:51.895392 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-f9db4037-5699-4d27-b19a-fb2b07c00c57 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:51.896245 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-f9db4037-5699-4d27-b19a-fb2b07c00c57 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:51.896742 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-f9db4037-5699-4d27-b19a-fb2b07c00c57 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:52.124991 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-f9db4037-5699-4d27-b19a-fb2b07c00c57 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:41:52.136431 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-f9db4037-5699-4d27-b19a-fb2b07c00c57 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:41:52.138429 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-f9db4037-5699-4d27-b19a-fb2b07c00c57 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:41:52.139836 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-f9db4037-5699-4d27-b19a-fb2b07c00c57 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "GET /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550" status: 200 len: 1722 microversion: 2.20 time: 0.259356 Feb 17 04:41:52.140608 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 822/1551] 10.222.0.78 () {60 vars in 1267 bytes} [Wed Feb 17 04:41:51 2021] GET /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550 => generated 1722 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 17 04:41:53.160461 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-204d0efb-4d27-4081-a7ca-cfb2840f5ff7 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:41:53.161920 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-204d0efb-4d27-4081-a7ca-cfb2840f5ff7 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 5e68206c-24dc-4ec9-b907-bf233d27d550] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:41:53.169944 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-204d0efb-4d27-4081-a7ca-cfb2840f5ff7 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:53.170459 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-204d0efb-4d27-4081-a7ca-cfb2840f5ff7 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:53.171469 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-204d0efb-4d27-4081-a7ca-cfb2840f5ff7 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:53.171979 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-204d0efb-4d27-4081-a7ca-cfb2840f5ff7 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:53.402518 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-204d0efb-4d27-4081-a7ca-cfb2840f5ff7 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:41:53.412248 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-204d0efb-4d27-4081-a7ca-cfb2840f5ff7 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:41:53.413816 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-204d0efb-4d27-4081-a7ca-cfb2840f5ff7 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:41:53.415118 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-204d0efb-4d27-4081-a7ca-cfb2840f5ff7 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "GET /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550" status: 200 len: 1722 microversion: 2.20 time: 0.259325 Feb 17 04:41:53.415926 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 730/1552] 10.222.0.78 () {60 vars in 1267 bytes} [Wed Feb 17 04:41:53 2021] GET /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550 => generated 1722 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:41:54.435344 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-eb5fd048-1715-433e-b448-53b3c267729b tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:41:54.436022 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-eb5fd048-1715-433e-b448-53b3c267729b tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 5e68206c-24dc-4ec9-b907-bf233d27d550] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:41:54.444163 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-eb5fd048-1715-433e-b448-53b3c267729b tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:54.444678 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-eb5fd048-1715-433e-b448-53b3c267729b tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:54.445526 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-eb5fd048-1715-433e-b448-53b3c267729b tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:54.446020 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-eb5fd048-1715-433e-b448-53b3c267729b tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:54.667282 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-eb5fd048-1715-433e-b448-53b3c267729b tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:41:54.678033 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-eb5fd048-1715-433e-b448-53b3c267729b tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:41:54.679734 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-eb5fd048-1715-433e-b448-53b3c267729b tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:41:54.680909 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-eb5fd048-1715-433e-b448-53b3c267729b tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "GET /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550" status: 200 len: 1665 microversion: 2.20 time: 0.249780 Feb 17 04:41:54.681494 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 823/1553] 10.222.0.78 () {60 vars in 1267 bytes} [Wed Feb 17 04:41:54 2021] GET /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550 => generated 1665 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:41:54.700250 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-f5fdc626-51d2-4ff5-b321-56792c921053 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c2c43bf4-3ca3-4b79-88c0-e6deadd76403"}} {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:41:54.701466 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-f5fdc626-51d2-4ff5-b321-56792c921053 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 5e68206c-24dc-4ec9-b907-bf233d27d550] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:41:54.709369 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-f5fdc626-51d2-4ff5-b321-56792c921053 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:54.709887 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-f5fdc626-51d2-4ff5-b321-56792c921053 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:54.710725 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-f5fdc626-51d2-4ff5-b321-56792c921053 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:54.711262 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-f5fdc626-51d2-4ff5-b321-56792c921053 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:55.147777 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-f5fdc626-51d2-4ff5-b321-56792c921053 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "POST /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.451663 Feb 17 04:41:55.148453 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 731/1554] 10.222.0.78 () {62 vars in 1354 bytes} [Wed Feb 17 04:41:54 2021] POST /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550/os-volume_attachments => generated 188 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 04:41:55.263471 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-d7133c88-1f3f-40f5-b9de-1ace48dd9b81 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:41:55.264017 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-d7133c88-1f3f-40f5-b9de-1ace48dd9b81 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 5e68206c-24dc-4ec9-b907-bf233d27d550] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:41:55.272022 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-d7133c88-1f3f-40f5-b9de-1ace48dd9b81 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:55.272573 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-d7133c88-1f3f-40f5-b9de-1ace48dd9b81 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:55.273439 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-d7133c88-1f3f-40f5-b9de-1ace48dd9b81 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:55.273931 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-d7133c88-1f3f-40f5-b9de-1ace48dd9b81 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:55.617258 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [req-f6fbcbb7-843f-4049-9107-9ba9c10d2f69 req-4009d7d1-cd30-4c7f-bea4-cd8987fda392 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e68206c-24dc-4ec9-b907-bf233d27d550", "name": "network-vif-unplugged", "status": "completed", "tag": "11791c9e-fcaf-4d11-8104-b4270f0591a6"}]} {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:41:55.619060 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:41:55.619060 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: warnings.warn(msg) Feb 17 04:41:55.628648 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [req-f6fbcbb7-843f-4049-9107-9ba9c10d2f69 req-4009d7d1-cd30-4c7f-bea4-cd8987fda392 service nova] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:55.629144 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [req-f6fbcbb7-843f-4049-9107-9ba9c10d2f69 req-4009d7d1-cd30-4c7f-bea4-cd8987fda392 service nova] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:55.655358 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.compute.server_external_events [req-f6fbcbb7-843f-4049-9107-9ba9c10d2f69 req-4009d7d1-cd30-4c7f-bea4-cd8987fda392 service nova] Unable to find a host for instance 5e68206c-24dc-4ec9-b907-bf233d27d550. Dropping event network-vif-unplugged {{(pid=98178) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:141}} Feb 17 04:41:55.655949 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [req-f6fbcbb7-843f-4049-9107-9ba9c10d2f69 req-4009d7d1-cd30-4c7f-bea4-cd8987fda392 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.043106 Feb 17 04:41:55.656781 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 732/1555] 10.222.0.78 () {64 vars in 1308 bytes} [Wed Feb 17 04:41:55 2021] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 44 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Feb 17 04:41:55.758716 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-d7133c88-1f3f-40f5-b9de-1ace48dd9b81 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "DELETE /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550/os-volume_attachments/c2c43bf4-3ca3-4b79-88c0-e6deadd76403" status: 202 len: 0 microversion: 2.20 time: 0.499185 Feb 17 04:41:55.759489 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 824/1556] 10.222.0.78 () {60 vars in 1447 bytes} [Wed Feb 17 04:41:55 2021] DELETE /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550/os-volume_attachments/c2c43bf4-3ca3-4b79-88c0-e6deadd76403 => generated 0 bytes in 501 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Feb 17 04:41:55.864817 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-56888768-624c-42e8-9188-9e9f4031e3b2 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:41:55.865436 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-56888768-624c-42e8-9188-9e9f4031e3b2 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 5e68206c-24dc-4ec9-b907-bf233d27d550] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:41:55.873256 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-56888768-624c-42e8-9188-9e9f4031e3b2 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:55.873770 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-56888768-624c-42e8-9188-9e9f4031e3b2 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:55.874604 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-56888768-624c-42e8-9188-9e9f4031e3b2 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:55.875122 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-56888768-624c-42e8-9188-9e9f4031e3b2 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:56.034306 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-56888768-624c-42e8-9188-9e9f4031e3b2 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "POST /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550/action" status: 202 len: 0 microversion: 2.20 time: 0.173453 Feb 17 04:41:56.035256 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 733/1557] 10.222.0.78 () {62 vars in 1309 bytes} [Wed Feb 17 04:41:55 2021] POST /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550/action => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Feb 17 04:41:56.043750 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-4475e393-a3be-4d23-8d37-687075f03a35 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:41:56.044518 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-4475e393-a3be-4d23-8d37-687075f03a35 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 5e68206c-24dc-4ec9-b907-bf233d27d550] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:41:56.053076 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-4475e393-a3be-4d23-8d37-687075f03a35 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:56.053669 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-4475e393-a3be-4d23-8d37-687075f03a35 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:56.054606 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-4475e393-a3be-4d23-8d37-687075f03a35 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:56.055127 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-4475e393-a3be-4d23-8d37-687075f03a35 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:56.278005 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-4475e393-a3be-4d23-8d37-687075f03a35 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:41:56.287987 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-4475e393-a3be-4d23-8d37-687075f03a35 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:41:56.289497 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-4475e393-a3be-4d23-8d37-687075f03a35 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:41:56.290671 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-4475e393-a3be-4d23-8d37-687075f03a35 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "GET /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550" status: 200 len: 1673 microversion: 2.20 time: 0.250990 Feb 17 04:41:56.291292 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 825/1558] 10.222.0.78 () {60 vars in 1267 bytes} [Wed Feb 17 04:41:56 2021] GET /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550 => generated 1673 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:41:57.311727 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-d2d6a999-d66f-4118-85a0-7c4004811f34 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:41:57.312312 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-d2d6a999-d66f-4118-85a0-7c4004811f34 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 5e68206c-24dc-4ec9-b907-bf233d27d550] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:41:57.320858 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-d2d6a999-d66f-4118-85a0-7c4004811f34 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:57.321376 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-d2d6a999-d66f-4118-85a0-7c4004811f34 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:57.322244 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-d2d6a999-d66f-4118-85a0-7c4004811f34 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:57.322746 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-d2d6a999-d66f-4118-85a0-7c4004811f34 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:57.700022 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-d2d6a999-d66f-4118-85a0-7c4004811f34 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:41:57.712157 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-d2d6a999-d66f-4118-85a0-7c4004811f34 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:41:57.713756 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-d2d6a999-d66f-4118-85a0-7c4004811f34 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:41:57.715114 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-d2d6a999-d66f-4118-85a0-7c4004811f34 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "GET /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550" status: 200 len: 1675 microversion: 2.20 time: 0.407594 Feb 17 04:41:57.715718 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 734/1559] 10.222.0.78 () {60 vars in 1267 bytes} [Wed Feb 17 04:41:57 2021] GET /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550 => generated 1675 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:41:58.734119 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-87f712d1-f1fb-4f57-9886-7581fde2dd45 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:41:58.734835 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-87f712d1-f1fb-4f57-9886-7581fde2dd45 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 5e68206c-24dc-4ec9-b907-bf233d27d550] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:41:58.743283 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-87f712d1-f1fb-4f57-9886-7581fde2dd45 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:58.743855 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-87f712d1-f1fb-4f57-9886-7581fde2dd45 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:58.744865 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-87f712d1-f1fb-4f57-9886-7581fde2dd45 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:58.745357 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-87f712d1-f1fb-4f57-9886-7581fde2dd45 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:58.973132 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-87f712d1-f1fb-4f57-9886-7581fde2dd45 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:41:58.982929 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-87f712d1-f1fb-4f57-9886-7581fde2dd45 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:41:58.984604 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-87f712d1-f1fb-4f57-9886-7581fde2dd45 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:41:58.985782 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-87f712d1-f1fb-4f57-9886-7581fde2dd45 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "GET /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550" status: 200 len: 1731 microversion: 2.20 time: 0.255967 Feb 17 04:41:58.986368 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 826/1560] 10.222.0.78 () {60 vars in 1267 bytes} [Wed Feb 17 04:41:58 2021] GET /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550 => generated 1731 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:42:00.005753 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-6837077b-69ed-4ed3-8622-53843daf1564 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:42:00.006409 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-6837077b-69ed-4ed3-8622-53843daf1564 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 5e68206c-24dc-4ec9-b907-bf233d27d550] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:42:00.015216 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-6837077b-69ed-4ed3-8622-53843daf1564 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:00.015777 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-6837077b-69ed-4ed3-8622-53843daf1564 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:00.016731 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-6837077b-69ed-4ed3-8622-53843daf1564 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:00.017161 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-6837077b-69ed-4ed3-8622-53843daf1564 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:00.270637 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-6837077b-69ed-4ed3-8622-53843daf1564 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:42:00.280404 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-6837077b-69ed-4ed3-8622-53843daf1564 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:42:00.281992 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-6837077b-69ed-4ed3-8622-53843daf1564 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:42:00.283228 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-6837077b-69ed-4ed3-8622-53843daf1564 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "GET /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550" status: 200 len: 1731 microversion: 2.20 time: 0.281909 Feb 17 04:42:00.283817 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 735/1561] 10.222.0.78 () {60 vars in 1267 bytes} [Wed Feb 17 04:42:00 2021] GET /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550 => generated 1731 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:42:01.304180 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-27746525-ad6b-46cc-a60d-05111cf050b4 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:42:01.304860 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-27746525-ad6b-46cc-a60d-05111cf050b4 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 5e68206c-24dc-4ec9-b907-bf233d27d550] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:42:01.312995 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-27746525-ad6b-46cc-a60d-05111cf050b4 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:01.313509 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-27746525-ad6b-46cc-a60d-05111cf050b4 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:01.314396 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-27746525-ad6b-46cc-a60d-05111cf050b4 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:01.314897 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-27746525-ad6b-46cc-a60d-05111cf050b4 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:01.562490 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-27746525-ad6b-46cc-a60d-05111cf050b4 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:42:01.573649 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-27746525-ad6b-46cc-a60d-05111cf050b4 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:42:01.575477 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-27746525-ad6b-46cc-a60d-05111cf050b4 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:42:01.577078 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-27746525-ad6b-46cc-a60d-05111cf050b4 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "GET /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550" status: 200 len: 1731 microversion: 2.20 time: 0.277021 Feb 17 04:42:01.577668 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 827/1562] 10.222.0.78 () {60 vars in 1267 bytes} [Wed Feb 17 04:42:01 2021] GET /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550 => generated 1731 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 17 04:42:02.598877 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-8a2adfa5-319d-442f-83d6-1285aac97311 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:42:02.599741 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-8a2adfa5-319d-442f-83d6-1285aac97311 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 5e68206c-24dc-4ec9-b907-bf233d27d550] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:42:02.617629 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-8a2adfa5-319d-442f-83d6-1285aac97311 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:02.618151 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-8a2adfa5-319d-442f-83d6-1285aac97311 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:02.619233 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-8a2adfa5-319d-442f-83d6-1285aac97311 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:02.619743 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-8a2adfa5-319d-442f-83d6-1285aac97311 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:02.858347 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-8a2adfa5-319d-442f-83d6-1285aac97311 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:42:02.867922 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-8a2adfa5-319d-442f-83d6-1285aac97311 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:42:02.869524 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-8a2adfa5-319d-442f-83d6-1285aac97311 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:42:02.870705 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-8a2adfa5-319d-442f-83d6-1285aac97311 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "GET /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550" status: 200 len: 1731 microversion: 2.20 time: 0.276783 Feb 17 04:42:02.871430 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 736/1563] 10.222.0.78 () {60 vars in 1267 bytes} [Wed Feb 17 04:42:02 2021] GET /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550 => generated 1731 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:42:03.891108 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-bf856158-5125-4b4e-b14d-afa8eb1360e7 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:42:03.891700 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-bf856158-5125-4b4e-b14d-afa8eb1360e7 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 5e68206c-24dc-4ec9-b907-bf233d27d550] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:42:03.899581 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-bf856158-5125-4b4e-b14d-afa8eb1360e7 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:03.900093 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-bf856158-5125-4b4e-b14d-afa8eb1360e7 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:03.900929 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-bf856158-5125-4b4e-b14d-afa8eb1360e7 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:03.901424 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-bf856158-5125-4b4e-b14d-afa8eb1360e7 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:04.145415 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-bf856158-5125-4b4e-b14d-afa8eb1360e7 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:42:04.154807 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-bf856158-5125-4b4e-b14d-afa8eb1360e7 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:42:04.156571 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-bf856158-5125-4b4e-b14d-afa8eb1360e7 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:42:04.157774 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-bf856158-5125-4b4e-b14d-afa8eb1360e7 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "GET /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550" status: 200 len: 1731 microversion: 2.20 time: 0.270795 Feb 17 04:42:04.158794 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 828/1564] 10.222.0.78 () {60 vars in 1267 bytes} [Wed Feb 17 04:42:03 2021] GET /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550 => generated 1731 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:42:05.178294 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-9b799550-c477-4ca0-a5d3-8e96da02f1ef tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:42:05.178988 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-9b799550-c477-4ca0-a5d3-8e96da02f1ef tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 5e68206c-24dc-4ec9-b907-bf233d27d550] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:42:05.187652 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-9b799550-c477-4ca0-a5d3-8e96da02f1ef tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:05.188252 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-9b799550-c477-4ca0-a5d3-8e96da02f1ef tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:05.189181 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-9b799550-c477-4ca0-a5d3-8e96da02f1ef tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:05.189754 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-9b799550-c477-4ca0-a5d3-8e96da02f1ef tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:05.416316 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-9b799550-c477-4ca0-a5d3-8e96da02f1ef tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:42:05.425870 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-9b799550-c477-4ca0-a5d3-8e96da02f1ef tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:42:05.428128 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-9b799550-c477-4ca0-a5d3-8e96da02f1ef tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:42:05.429374 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-9b799550-c477-4ca0-a5d3-8e96da02f1ef tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "GET /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550" status: 200 len: 1731 microversion: 2.20 time: 0.255276 Feb 17 04:42:05.429930 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 737/1565] 10.222.0.78 () {60 vars in 1267 bytes} [Wed Feb 17 04:42:05 2021] GET /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550 => generated 1731 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:42:06.453679 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-68657b61-4120-48cc-9903-d7eeed91935c tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:42:06.454809 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-68657b61-4120-48cc-9903-d7eeed91935c tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 5e68206c-24dc-4ec9-b907-bf233d27d550] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:42:06.469663 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-68657b61-4120-48cc-9903-d7eeed91935c tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:06.470244 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-68657b61-4120-48cc-9903-d7eeed91935c tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:06.471307 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-68657b61-4120-48cc-9903-d7eeed91935c tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:06.471993 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-68657b61-4120-48cc-9903-d7eeed91935c tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:06.718442 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-68657b61-4120-48cc-9903-d7eeed91935c tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:42:06.727854 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-68657b61-4120-48cc-9903-d7eeed91935c tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:42:06.729475 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-68657b61-4120-48cc-9903-d7eeed91935c tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:42:06.730648 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-68657b61-4120-48cc-9903-d7eeed91935c tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "GET /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550" status: 200 len: 1731 microversion: 2.20 time: 0.284901 Feb 17 04:42:06.731521 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 829/1566] 10.222.0.78 () {60 vars in 1267 bytes} [Wed Feb 17 04:42:06 2021] GET /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550 => generated 1731 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 17 04:42:07.752691 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-00e6c8c3-74a5-4319-8855-8dae8bb70588 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:42:07.753565 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-00e6c8c3-74a5-4319-8855-8dae8bb70588 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 5e68206c-24dc-4ec9-b907-bf233d27d550] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:42:07.762816 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-00e6c8c3-74a5-4319-8855-8dae8bb70588 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:07.763409 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-00e6c8c3-74a5-4319-8855-8dae8bb70588 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:07.764325 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-00e6c8c3-74a5-4319-8855-8dae8bb70588 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:07.764897 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-00e6c8c3-74a5-4319-8855-8dae8bb70588 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:07.999655 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-00e6c8c3-74a5-4319-8855-8dae8bb70588 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:42:08.009747 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-00e6c8c3-74a5-4319-8855-8dae8bb70588 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:42:08.011401 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-00e6c8c3-74a5-4319-8855-8dae8bb70588 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:42:08.012613 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-00e6c8c3-74a5-4319-8855-8dae8bb70588 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "GET /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550" status: 200 len: 1731 microversion: 2.20 time: 0.264786 Feb 17 04:42:08.019067 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 738/1567] 10.222.0.78 () {60 vars in 1267 bytes} [Wed Feb 17 04:42:07 2021] GET /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550 => generated 1731 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:42:09.032299 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-b492b120-10aa-41fb-bbc8-6e6a38f031dc tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:42:09.032973 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-b492b120-10aa-41fb-bbc8-6e6a38f031dc tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 5e68206c-24dc-4ec9-b907-bf233d27d550] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:42:09.042575 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-b492b120-10aa-41fb-bbc8-6e6a38f031dc tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:09.043279 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-b492b120-10aa-41fb-bbc8-6e6a38f031dc tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:09.044255 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-b492b120-10aa-41fb-bbc8-6e6a38f031dc tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:09.044861 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-b492b120-10aa-41fb-bbc8-6e6a38f031dc tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:09.299636 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-b492b120-10aa-41fb-bbc8-6e6a38f031dc tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:42:09.311514 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-b492b120-10aa-41fb-bbc8-6e6a38f031dc tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:42:09.313310 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-b492b120-10aa-41fb-bbc8-6e6a38f031dc tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:42:09.314722 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-b492b120-10aa-41fb-bbc8-6e6a38f031dc tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "GET /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550" status: 200 len: 1731 microversion: 2.20 time: 0.286394 Feb 17 04:42:09.315610 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 830/1568] 10.222.0.78 () {60 vars in 1267 bytes} [Wed Feb 17 04:42:09 2021] GET /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550 => generated 1731 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:42:10.336773 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-1d710020-c892-41d1-9371-b31f9fb7c9b7 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:42:10.337370 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-1d710020-c892-41d1-9371-b31f9fb7c9b7 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 5e68206c-24dc-4ec9-b907-bf233d27d550] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:42:10.345291 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-1d710020-c892-41d1-9371-b31f9fb7c9b7 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:10.345801 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-1d710020-c892-41d1-9371-b31f9fb7c9b7 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:10.346642 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-1d710020-c892-41d1-9371-b31f9fb7c9b7 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:10.347166 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-1d710020-c892-41d1-9371-b31f9fb7c9b7 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:10.570447 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-1d710020-c892-41d1-9371-b31f9fb7c9b7 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:42:10.579687 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-1d710020-c892-41d1-9371-b31f9fb7c9b7 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:42:10.581276 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-1d710020-c892-41d1-9371-b31f9fb7c9b7 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:42:10.582668 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-1d710020-c892-41d1-9371-b31f9fb7c9b7 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "GET /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550" status: 200 len: 1731 microversion: 2.20 time: 0.250735 Feb 17 04:42:10.583284 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 739/1569] 10.222.0.78 () {60 vars in 1267 bytes} [Wed Feb 17 04:42:10 2021] GET /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550 => generated 1731 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:42:11.602570 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-42cc5a33-ab1a-46d0-9c81-6a8a65fab1ee tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:42:11.603381 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-42cc5a33-ab1a-46d0-9c81-6a8a65fab1ee tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 5e68206c-24dc-4ec9-b907-bf233d27d550] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:42:11.611513 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-42cc5a33-ab1a-46d0-9c81-6a8a65fab1ee tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:11.612022 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-42cc5a33-ab1a-46d0-9c81-6a8a65fab1ee tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:11.612860 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-42cc5a33-ab1a-46d0-9c81-6a8a65fab1ee tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:11.613402 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-42cc5a33-ab1a-46d0-9c81-6a8a65fab1ee tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:11.876773 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-42cc5a33-ab1a-46d0-9c81-6a8a65fab1ee tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:42:11.886255 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-42cc5a33-ab1a-46d0-9c81-6a8a65fab1ee tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:42:11.887911 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-42cc5a33-ab1a-46d0-9c81-6a8a65fab1ee tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:42:11.889098 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-42cc5a33-ab1a-46d0-9c81-6a8a65fab1ee tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "GET /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550" status: 200 len: 1731 microversion: 2.20 time: 0.290989 Feb 17 04:42:11.889692 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 831/1570] 10.222.0.78 () {60 vars in 1267 bytes} [Wed Feb 17 04:42:11 2021] GET /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550 => generated 1731 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:42:12.908923 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-120a0b9b-ccda-4101-bf3b-2e6cc53cb793 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:42:12.909598 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-120a0b9b-ccda-4101-bf3b-2e6cc53cb793 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 5e68206c-24dc-4ec9-b907-bf233d27d550] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:42:12.917833 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-120a0b9b-ccda-4101-bf3b-2e6cc53cb793 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:12.918347 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-120a0b9b-ccda-4101-bf3b-2e6cc53cb793 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:12.919214 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-120a0b9b-ccda-4101-bf3b-2e6cc53cb793 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:12.919713 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-120a0b9b-ccda-4101-bf3b-2e6cc53cb793 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:13.133224 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-120a0b9b-ccda-4101-bf3b-2e6cc53cb793 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:42:13.142877 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-120a0b9b-ccda-4101-bf3b-2e6cc53cb793 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:42:13.144506 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-120a0b9b-ccda-4101-bf3b-2e6cc53cb793 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:42:13.145722 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-120a0b9b-ccda-4101-bf3b-2e6cc53cb793 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "GET /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550" status: 200 len: 1731 microversion: 2.20 time: 0.240926 Feb 17 04:42:13.146313 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 740/1571] 10.222.0.78 () {60 vars in 1267 bytes} [Wed Feb 17 04:42:12 2021] GET /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550 => generated 1731 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:42:14.166003 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-4fd27474-546f-4da2-a523-c967fa6ac393 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:42:14.166669 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-4fd27474-546f-4da2-a523-c967fa6ac393 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 5e68206c-24dc-4ec9-b907-bf233d27d550] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:42:14.174603 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-4fd27474-546f-4da2-a523-c967fa6ac393 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:14.175128 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-4fd27474-546f-4da2-a523-c967fa6ac393 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:14.176541 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-4fd27474-546f-4da2-a523-c967fa6ac393 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:14.177127 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-4fd27474-546f-4da2-a523-c967fa6ac393 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:14.387363 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-4fd27474-546f-4da2-a523-c967fa6ac393 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:42:14.396953 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-4fd27474-546f-4da2-a523-c967fa6ac393 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:42:14.398521 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-4fd27474-546f-4da2-a523-c967fa6ac393 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:42:14.399717 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-4fd27474-546f-4da2-a523-c967fa6ac393 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "GET /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550" status: 200 len: 1731 microversion: 2.20 time: 0.237957 Feb 17 04:42:14.400307 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 832/1572] 10.222.0.78 () {60 vars in 1267 bytes} [Wed Feb 17 04:42:14 2021] GET /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550 => generated 1731 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:42:15.419612 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-b72189a3-a9c9-4ed0-a00f-f3ec8e5708c3 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:42:15.420278 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-b72189a3-a9c9-4ed0-a00f-f3ec8e5708c3 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 5e68206c-24dc-4ec9-b907-bf233d27d550] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:42:15.428780 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-b72189a3-a9c9-4ed0-a00f-f3ec8e5708c3 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:15.429282 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-b72189a3-a9c9-4ed0-a00f-f3ec8e5708c3 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:15.430132 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-b72189a3-a9c9-4ed0-a00f-f3ec8e5708c3 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:15.430594 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-b72189a3-a9c9-4ed0-a00f-f3ec8e5708c3 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:15.646980 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-b72189a3-a9c9-4ed0-a00f-f3ec8e5708c3 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:42:15.657252 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-b72189a3-a9c9-4ed0-a00f-f3ec8e5708c3 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:42:15.659091 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-b72189a3-a9c9-4ed0-a00f-f3ec8e5708c3 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:42:15.661002 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-b72189a3-a9c9-4ed0-a00f-f3ec8e5708c3 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "GET /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550" status: 200 len: 1731 microversion: 2.20 time: 0.244670 Feb 17 04:42:15.661601 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 741/1573] 10.222.0.78 () {60 vars in 1267 bytes} [Wed Feb 17 04:42:15 2021] GET /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550 => generated 1731 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:42:16.681147 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-93a666dd-2ebb-4357-aacf-93e31a4bd150 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:42:16.681819 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-93a666dd-2ebb-4357-aacf-93e31a4bd150 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 5e68206c-24dc-4ec9-b907-bf233d27d550] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:42:16.689916 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-93a666dd-2ebb-4357-aacf-93e31a4bd150 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:16.690627 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-93a666dd-2ebb-4357-aacf-93e31a4bd150 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:16.691278 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-93a666dd-2ebb-4357-aacf-93e31a4bd150 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:16.692363 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-93a666dd-2ebb-4357-aacf-93e31a4bd150 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:16.909122 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-93a666dd-2ebb-4357-aacf-93e31a4bd150 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:42:16.919145 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-93a666dd-2ebb-4357-aacf-93e31a4bd150 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:42:16.920729 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-93a666dd-2ebb-4357-aacf-93e31a4bd150 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:42:16.921911 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-93a666dd-2ebb-4357-aacf-93e31a4bd150 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "GET /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550" status: 200 len: 1731 microversion: 2.20 time: 0.244968 Feb 17 04:42:16.922496 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 833/1574] 10.222.0.78 () {60 vars in 1267 bytes} [Wed Feb 17 04:42:16 2021] GET /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550 => generated 1731 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:42:17.943102 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-efd89227-508b-4c67-b745-94251d91683e tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:42:17.943876 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-efd89227-508b-4c67-b745-94251d91683e tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 5e68206c-24dc-4ec9-b907-bf233d27d550] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:42:17.951835 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-efd89227-508b-4c67-b745-94251d91683e tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:17.952348 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-efd89227-508b-4c67-b745-94251d91683e tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:17.953193 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-efd89227-508b-4c67-b745-94251d91683e tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:17.953698 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-efd89227-508b-4c67-b745-94251d91683e tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:18.169468 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-efd89227-508b-4c67-b745-94251d91683e tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:42:18.179847 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-efd89227-508b-4c67-b745-94251d91683e tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:42:18.181429 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-efd89227-508b-4c67-b745-94251d91683e tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:42:18.182624 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-efd89227-508b-4c67-b745-94251d91683e tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "GET /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550" status: 200 len: 1731 microversion: 2.20 time: 0.244587 Feb 17 04:42:18.183244 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 742/1575] 10.222.0.78 () {60 vars in 1267 bytes} [Wed Feb 17 04:42:17 2021] GET /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550 => generated 1731 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:42:19.202739 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-f6a984b9-2c79-44ea-99fd-a351292c35f6 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:42:19.203437 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-f6a984b9-2c79-44ea-99fd-a351292c35f6 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 5e68206c-24dc-4ec9-b907-bf233d27d550] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:42:19.211514 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-f6a984b9-2c79-44ea-99fd-a351292c35f6 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:19.212019 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-f6a984b9-2c79-44ea-99fd-a351292c35f6 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:19.212864 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-f6a984b9-2c79-44ea-99fd-a351292c35f6 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:19.213331 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-f6a984b9-2c79-44ea-99fd-a351292c35f6 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:19.426893 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-f6a984b9-2c79-44ea-99fd-a351292c35f6 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:42:19.436252 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-f6a984b9-2c79-44ea-99fd-a351292c35f6 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:42:19.437804 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-f6a984b9-2c79-44ea-99fd-a351292c35f6 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:42:19.438984 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-f6a984b9-2c79-44ea-99fd-a351292c35f6 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "GET /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550" status: 200 len: 1731 microversion: 2.20 time: 0.240278 Feb 17 04:42:19.439620 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 834/1576] 10.222.0.78 () {60 vars in 1267 bytes} [Wed Feb 17 04:42:19 2021] GET /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550 => generated 1731 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:42:20.459618 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-b4931740-3fac-40d2-b2ae-95d931ba1f80 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:42:20.460281 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-b4931740-3fac-40d2-b2ae-95d931ba1f80 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 5e68206c-24dc-4ec9-b907-bf233d27d550] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:42:20.468134 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-b4931740-3fac-40d2-b2ae-95d931ba1f80 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:20.468638 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-b4931740-3fac-40d2-b2ae-95d931ba1f80 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:20.469471 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-b4931740-3fac-40d2-b2ae-95d931ba1f80 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:20.469963 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-b4931740-3fac-40d2-b2ae-95d931ba1f80 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:20.682067 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-b4931740-3fac-40d2-b2ae-95d931ba1f80 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:42:20.691446 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-b4931740-3fac-40d2-b2ae-95d931ba1f80 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:42:20.693040 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-b4931740-3fac-40d2-b2ae-95d931ba1f80 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:42:20.694240 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-b4931740-3fac-40d2-b2ae-95d931ba1f80 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "GET /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550" status: 200 len: 1731 microversion: 2.20 time: 0.239297 Feb 17 04:42:20.694830 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 743/1577] 10.222.0.78 () {60 vars in 1267 bytes} [Wed Feb 17 04:42:20 2021] GET /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550 => generated 1731 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:42:21.714355 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-facdb73e-4767-49a9-b7a5-c2324b7bc91f tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:42:21.715023 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-facdb73e-4767-49a9-b7a5-c2324b7bc91f tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 5e68206c-24dc-4ec9-b907-bf233d27d550] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:42:21.722986 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-facdb73e-4767-49a9-b7a5-c2324b7bc91f tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:21.723555 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-facdb73e-4767-49a9-b7a5-c2324b7bc91f tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:21.724392 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-facdb73e-4767-49a9-b7a5-c2324b7bc91f tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:21.724883 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-facdb73e-4767-49a9-b7a5-c2324b7bc91f tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:21.934798 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-facdb73e-4767-49a9-b7a5-c2324b7bc91f tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:42:21.944307 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-facdb73e-4767-49a9-b7a5-c2324b7bc91f tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:42:21.945901 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-facdb73e-4767-49a9-b7a5-c2324b7bc91f tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:42:21.947129 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-facdb73e-4767-49a9-b7a5-c2324b7bc91f tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "GET /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550" status: 200 len: 1731 microversion: 2.20 time: 0.236797 Feb 17 04:42:21.947726 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 835/1578] 10.222.0.78 () {60 vars in 1267 bytes} [Wed Feb 17 04:42:21 2021] GET /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550 => generated 1731 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:42:22.967250 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-38b05f9b-24c7-4fda-95c5-87d14b065cbe tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:42:22.967975 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-38b05f9b-24c7-4fda-95c5-87d14b065cbe tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 5e68206c-24dc-4ec9-b907-bf233d27d550] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:42:22.976596 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-38b05f9b-24c7-4fda-95c5-87d14b065cbe tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:22.977101 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-38b05f9b-24c7-4fda-95c5-87d14b065cbe tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:22.977943 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-38b05f9b-24c7-4fda-95c5-87d14b065cbe tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:22.978440 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-38b05f9b-24c7-4fda-95c5-87d14b065cbe tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:23.194117 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-38b05f9b-24c7-4fda-95c5-87d14b065cbe tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:42:23.203555 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-38b05f9b-24c7-4fda-95c5-87d14b065cbe tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:42:23.205128 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-38b05f9b-24c7-4fda-95c5-87d14b065cbe tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:42:23.206312 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-38b05f9b-24c7-4fda-95c5-87d14b065cbe tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "GET /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550" status: 200 len: 1731 microversion: 2.20 time: 0.243206 Feb 17 04:42:23.207678 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 744/1579] 10.222.0.78 () {60 vars in 1267 bytes} [Wed Feb 17 04:42:22 2021] GET /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550 => generated 1731 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:42:24.226033 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-d1a4d43e-e167-4cb4-8931-6e7b9e31c0d4 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:42:24.226699 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-d1a4d43e-e167-4cb4-8931-6e7b9e31c0d4 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 5e68206c-24dc-4ec9-b907-bf233d27d550] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:42:24.235920 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-d1a4d43e-e167-4cb4-8931-6e7b9e31c0d4 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:24.236433 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-d1a4d43e-e167-4cb4-8931-6e7b9e31c0d4 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:24.237282 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-d1a4d43e-e167-4cb4-8931-6e7b9e31c0d4 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:24.237778 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-d1a4d43e-e167-4cb4-8931-6e7b9e31c0d4 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:24.458917 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-d1a4d43e-e167-4cb4-8931-6e7b9e31c0d4 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:42:24.468568 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-d1a4d43e-e167-4cb4-8931-6e7b9e31c0d4 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:42:24.470352 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-d1a4d43e-e167-4cb4-8931-6e7b9e31c0d4 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:42:24.471593 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-d1a4d43e-e167-4cb4-8931-6e7b9e31c0d4 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "GET /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550" status: 200 len: 1731 microversion: 2.20 time: 0.249712 Feb 17 04:42:24.472193 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 836/1580] 10.222.0.78 () {60 vars in 1267 bytes} [Wed Feb 17 04:42:24 2021] GET /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550 => generated 1731 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:42:24.570778 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [req-e3278784-2861-4ac9-97d0-c7feed6dac07 req-0c5a2fc3-60bf-42dc-9fd5-a5978eae1e81 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e68206c-24dc-4ec9-b907-bf233d27d550", "name": "network-vif-plugged", "status": "completed", "tag": "11791c9e-fcaf-4d11-8104-b4270f0591a6"}]} {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:42:24.572458 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:42:24.572458 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: warnings.warn(msg) Feb 17 04:42:24.581423 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [req-e3278784-2861-4ac9-97d0-c7feed6dac07 req-0c5a2fc3-60bf-42dc-9fd5-a5978eae1e81 service nova] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:24.581933 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [req-e3278784-2861-4ac9-97d0-c7feed6dac07 req-0c5a2fc3-60bf-42dc-9fd5-a5978eae1e81 service nova] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:24.600077 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.compute.server_external_events [req-e3278784-2861-4ac9-97d0-c7feed6dac07 req-0c5a2fc3-60bf-42dc-9fd5-a5978eae1e81 service nova] Creating event network-vif-plugged:11791c9e-fcaf-4d11-8104-b4270f0591a6 for instance 5e68206c-24dc-4ec9-b907-bf233d27d550 on hv-cinder-75998 Feb 17 04:42:24.605268 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [req-e3278784-2861-4ac9-97d0-c7feed6dac07 req-0c5a2fc3-60bf-42dc-9fd5-a5978eae1e81 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039086 Feb 17 04:42:24.605925 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 745/1581] 10.222.0.78 () {64 vars in 1308 bytes} [Wed Feb 17 04:42:24 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:42:25.492038 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-852858d6-a5f7-4aa1-8eb9-42725acb8cd9 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:42:25.492715 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-852858d6-a5f7-4aa1-8eb9-42725acb8cd9 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 5e68206c-24dc-4ec9-b907-bf233d27d550] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:42:25.500437 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-852858d6-a5f7-4aa1-8eb9-42725acb8cd9 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:25.500953 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-852858d6-a5f7-4aa1-8eb9-42725acb8cd9 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:25.501805 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-852858d6-a5f7-4aa1-8eb9-42725acb8cd9 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:25.502299 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-852858d6-a5f7-4aa1-8eb9-42725acb8cd9 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:25.723192 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-852858d6-a5f7-4aa1-8eb9-42725acb8cd9 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:42:25.732977 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-852858d6-a5f7-4aa1-8eb9-42725acb8cd9 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:42:25.734565 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-852858d6-a5f7-4aa1-8eb9-42725acb8cd9 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:42:25.735784 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-852858d6-a5f7-4aa1-8eb9-42725acb8cd9 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "GET /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550" status: 200 len: 1731 microversion: 2.20 time: 0.248565 Feb 17 04:42:25.736381 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 837/1582] 10.222.0.78 () {60 vars in 1267 bytes} [Wed Feb 17 04:42:25 2021] GET /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550 => generated 1731 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 17 04:42:26.757157 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-09e44ec9-accc-4b81-ad3b-6f7c441edf24 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:42:26.757865 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-09e44ec9-accc-4b81-ad3b-6f7c441edf24 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 5e68206c-24dc-4ec9-b907-bf233d27d550] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:42:26.765964 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-09e44ec9-accc-4b81-ad3b-6f7c441edf24 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:26.766483 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-09e44ec9-accc-4b81-ad3b-6f7c441edf24 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:26.767389 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-09e44ec9-accc-4b81-ad3b-6f7c441edf24 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:26.767890 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-09e44ec9-accc-4b81-ad3b-6f7c441edf24 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:27.330081 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-09e44ec9-accc-4b81-ad3b-6f7c441edf24 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:42:27.339798 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-09e44ec9-accc-4b81-ad3b-6f7c441edf24 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:42:27.341383 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-09e44ec9-accc-4b81-ad3b-6f7c441edf24 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:42:27.342575 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-09e44ec9-accc-4b81-ad3b-6f7c441edf24 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "GET /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550" status: 200 len: 1731 microversion: 2.20 time: 0.590099 Feb 17 04:42:27.343189 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 746/1583] 10.222.0.78 () {60 vars in 1267 bytes} [Wed Feb 17 04:42:26 2021] GET /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550 => generated 1731 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:42:28.363130 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-132fcfb4-aa6e-465d-89ab-e0b3cf258d15 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:42:28.364518 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-132fcfb4-aa6e-465d-89ab-e0b3cf258d15 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 5e68206c-24dc-4ec9-b907-bf233d27d550] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:42:28.372715 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-132fcfb4-aa6e-465d-89ab-e0b3cf258d15 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:28.373224 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-132fcfb4-aa6e-465d-89ab-e0b3cf258d15 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:28.374059 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-132fcfb4-aa6e-465d-89ab-e0b3cf258d15 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:28.374558 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-132fcfb4-aa6e-465d-89ab-e0b3cf258d15 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:28.588577 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-132fcfb4-aa6e-465d-89ab-e0b3cf258d15 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:42:28.597907 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-132fcfb4-aa6e-465d-89ab-e0b3cf258d15 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:42:28.599664 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-132fcfb4-aa6e-465d-89ab-e0b3cf258d15 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:42:28.600851 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-132fcfb4-aa6e-465d-89ab-e0b3cf258d15 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "GET /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550" status: 200 len: 1731 microversion: 2.20 time: 0.241922 Feb 17 04:42:28.601438 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 838/1584] 10.222.0.78 () {60 vars in 1267 bytes} [Wed Feb 17 04:42:28 2021] GET /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550 => generated 1731 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:42:29.621205 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-bd0a5a74-9ca3-41af-a8b2-33209867fec8 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:42:29.621865 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-bd0a5a74-9ca3-41af-a8b2-33209867fec8 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 5e68206c-24dc-4ec9-b907-bf233d27d550] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:42:29.630946 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-bd0a5a74-9ca3-41af-a8b2-33209867fec8 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:29.631503 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-bd0a5a74-9ca3-41af-a8b2-33209867fec8 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:29.632335 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-bd0a5a74-9ca3-41af-a8b2-33209867fec8 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:29.632822 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-bd0a5a74-9ca3-41af-a8b2-33209867fec8 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:29.842674 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-bd0a5a74-9ca3-41af-a8b2-33209867fec8 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:42:29.852305 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-bd0a5a74-9ca3-41af-a8b2-33209867fec8 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:42:29.853938 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-bd0a5a74-9ca3-41af-a8b2-33209867fec8 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:42:29.855077 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-bd0a5a74-9ca3-41af-a8b2-33209867fec8 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "GET /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550" status: 200 len: 1731 microversion: 2.20 time: 0.238035 Feb 17 04:42:29.855681 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 747/1585] 10.222.0.78 () {60 vars in 1267 bytes} [Wed Feb 17 04:42:29 2021] GET /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550 => generated 1731 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:42:30.875999 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-21eb86c3-8b66-4791-a26e-cde2b229e70c tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:42:30.876781 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-21eb86c3-8b66-4791-a26e-cde2b229e70c tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 5e68206c-24dc-4ec9-b907-bf233d27d550] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:42:30.887552 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-21eb86c3-8b66-4791-a26e-cde2b229e70c tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:30.888127 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-21eb86c3-8b66-4791-a26e-cde2b229e70c tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:30.889474 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-21eb86c3-8b66-4791-a26e-cde2b229e70c tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:30.891591 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-21eb86c3-8b66-4791-a26e-cde2b229e70c tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:31.149905 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-21eb86c3-8b66-4791-a26e-cde2b229e70c tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:42:31.168648 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-21eb86c3-8b66-4791-a26e-cde2b229e70c tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:42:31.170710 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-21eb86c3-8b66-4791-a26e-cde2b229e70c tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:42:31.172404 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-21eb86c3-8b66-4791-a26e-cde2b229e70c tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "GET /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550" status: 200 len: 1731 microversion: 2.20 time: 0.301497 Feb 17 04:42:31.173514 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 839/1586] 10.222.0.78 () {60 vars in 1267 bytes} [Wed Feb 17 04:42:30 2021] GET /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550 => generated 1731 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:42:32.192733 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-2ed48766-0d76-421d-a22f-e53a77801c0d tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:42:32.193427 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-2ed48766-0d76-421d-a22f-e53a77801c0d tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 5e68206c-24dc-4ec9-b907-bf233d27d550] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:42:32.201473 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-2ed48766-0d76-421d-a22f-e53a77801c0d tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:32.201985 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-2ed48766-0d76-421d-a22f-e53a77801c0d tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:32.202835 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-2ed48766-0d76-421d-a22f-e53a77801c0d tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:32.203359 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-2ed48766-0d76-421d-a22f-e53a77801c0d tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:32.419457 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-2ed48766-0d76-421d-a22f-e53a77801c0d tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:42:32.429770 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-2ed48766-0d76-421d-a22f-e53a77801c0d tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:42:32.431424 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-2ed48766-0d76-421d-a22f-e53a77801c0d tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:42:32.432559 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-2ed48766-0d76-421d-a22f-e53a77801c0d tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "GET /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550" status: 200 len: 1718 microversion: 2.20 time: 0.244597 Feb 17 04:42:32.433152 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 748/1587] 10.222.0.78 () {60 vars in 1267 bytes} [Wed Feb 17 04:42:32 2021] GET /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550 => generated 1718 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:43:28.170523 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-6c4f1605-90c9-41c2-a458-dc8016d9daa0 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Action: 'create', calling method: .version_select at 0x7f57c86fdbf8>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1695173271"}} {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:43:28.194041 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.quota [None req-6c4f1605-90c9-41c2-a458-dc8016d9daa0 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Getting quotas for project 9a3a6cbbd6d14db5bf2f631af62262de. Resources: {'key_pairs'} {{(pid=98179) _get_quotas /opt/stack/nova/nova/quota.py:388}} Feb 17 04:43:28.198797 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.quota [None req-6c4f1605-90c9-41c2-a458-dc8016d9daa0 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Getting quotas for user f5b5a6c15a7c4228a0f94762b8b7b4a5 and project 9a3a6cbbd6d14db5bf2f631af62262de. Resources: {'key_pairs'} {{(pid=98179) _get_quotas /opt/stack/nova/nova/quota.py:380}} Feb 17 04:43:28.392994 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.quota [None req-6c4f1605-90c9-41c2-a458-dc8016d9daa0 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Getting quotas for project 9a3a6cbbd6d14db5bf2f631af62262de. Resources: {'key_pairs'} {{(pid=98179) _get_quotas /opt/stack/nova/nova/quota.py:388}} Feb 17 04:43:28.396952 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.quota [None req-6c4f1605-90c9-41c2-a458-dc8016d9daa0 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Getting quotas for user f5b5a6c15a7c4228a0f94762b8b7b4a5 and project 9a3a6cbbd6d14db5bf2f631af62262de. Resources: {'key_pairs'} {{(pid=98179) _get_quotas /opt/stack/nova/nova/quota.py:380}} Feb 17 04:43:28.410945 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-6c4f1605-90c9-41c2-a458-dc8016d9daa0 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 2315 microversion: 2.1 time: 0.469331 Feb 17 04:43:28.411627 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 840/1588] 10.222.0.78 () {60 vars in 1148 bytes} [Wed Feb 17 04:43:27 2021] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:43:28.422148 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-fd568794-7803-41b4-9876-885797080f37 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Action: 'create', calling method: .version_select at 0x7f57c8721a60>, body: {"security_group": {"name": "tempest-TestVolumeBootPattern-2120696101", "description": "tempest-TestVolumeBootPattern-2120696101 description"}} {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:43:28.632848 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-fd568794-7803-41b4-9876-885797080f37 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] 10.222.0.78 "POST /compute/v2.1/os-security-groups" status: 200 len: 251 microversion: 2.1 time: 0.214654 Feb 17 04:43:28.634658 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 749/1589] 10.222.0.78 () {60 vars in 1170 bytes} [Wed Feb 17 04:43:28 2021] POST /compute/v2.1/os-security-groups => generated 251 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:43:28.647212 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-64470ea2-6cf3-4e25-930b-b4a4cab1b199 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Action: 'create', calling method: .version_select at 0x7f57c86fd620>, body: {"security_group_rule": {"parent_group_id": "10b648c5-8db3-4c58-befb-5d716c01da5c", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "cidr": "0.0.0.0/0"}} {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:43:28.987393 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-64470ea2-6cf3-4e25-930b-b4a4cab1b199 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] 10.222.0.78 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.344016 Feb 17 04:43:28.988179 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 841/1590] 10.222.0.78 () {60 vars in 1185 bytes} [Wed Feb 17 04:43:28 2021] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:43:29.000411 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-94cdc3ca-2a53-4e72-8c71-4eedee3d9cf6 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Action: 'create', calling method: .version_select at 0x7f57c93f4e18>, body: {"security_group_rule": {"parent_group_id": "10b648c5-8db3-4c58-befb-5d716c01da5c", "ip_protocol": "icmp", "from_port": -1, "to_port": -1, "cidr": "0.0.0.0/0"}} {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:43:29.233366 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-94cdc3ca-2a53-4e72-8c71-4eedee3d9cf6 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] 10.222.0.78 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 233 microversion: 2.1 time: 0.237714 Feb 17 04:43:29.234573 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 750/1591] 10.222.0.78 () {60 vars in 1185 bytes} [Wed Feb 17 04:43:28 2021] POST /compute/v2.1/os-security-group-rules => generated 233 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:43:36.759706 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 17 04:43:36.760261 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: Wed Feb 17 04:43:36 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 17 04:43:39.711274 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-e9ae557a-b07a-4ce5-a0c0-0151645768a5 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:43:39.711902 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-e9ae557a-b07a-4ce5-a0c0-0151645768a5 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 5e68206c-24dc-4ec9-b907-bf233d27d550] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:43:39.720272 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-e9ae557a-b07a-4ce5-a0c0-0151645768a5 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:43:39.720785 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-e9ae557a-b07a-4ce5-a0c0-0151645768a5 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:43:39.721629 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-e9ae557a-b07a-4ce5-a0c0-0151645768a5 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:43:39.722133 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-e9ae557a-b07a-4ce5-a0c0-0151645768a5 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:43:39.787524 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-e9ae557a-b07a-4ce5-a0c0-0151645768a5 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 5e68206c-24dc-4ec9-b907-bf233d27d550] Going to try to terminate instance {{(pid=98179) delete /opt/stack/nova/nova/compute/api.py:2540}} Feb 17 04:43:39.909310 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-e9ae557a-b07a-4ce5-a0c0-0151645768a5 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "DELETE /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550" status: 204 len: 0 microversion: 2.20 time: 0.201630 Feb 17 04:43:39.909990 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 842/1592] 10.222.0.78 () {60 vars in 1270 bytes} [Wed Feb 17 04:43:39 2021] DELETE /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Feb 17 04:43:39.916116 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: ERROR oslo.messaging._drivers.impl_rabbit [-] [74073561-5d49-4824-899c-58d1d7a4dfc3] AMQP server on 10.222.0.78:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Feb 17 04:43:39.920425 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-c8d68dbd-cc3b-4c9d-8c5c-fbf52bd52c6e tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:43:39.921097 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-c8d68dbd-cc3b-4c9d-8c5c-fbf52bd52c6e tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 5e68206c-24dc-4ec9-b907-bf233d27d550] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:43:39.930177 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-c8d68dbd-cc3b-4c9d-8c5c-fbf52bd52c6e tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:43:39.930693 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-c8d68dbd-cc3b-4c9d-8c5c-fbf52bd52c6e tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:43:39.931589 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-c8d68dbd-cc3b-4c9d-8c5c-fbf52bd52c6e tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:43:39.932091 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-c8d68dbd-cc3b-4c9d-8c5c-fbf52bd52c6e tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:43:40.149276 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-c8d68dbd-cc3b-4c9d-8c5c-fbf52bd52c6e tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:43:40.160012 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-c8d68dbd-cc3b-4c9d-8c5c-fbf52bd52c6e tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:43:40.162003 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-c8d68dbd-cc3b-4c9d-8c5c-fbf52bd52c6e tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:43:40.163262 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-c8d68dbd-cc3b-4c9d-8c5c-fbf52bd52c6e tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "GET /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550" status: 200 len: 1724 microversion: 2.20 time: 0.248619 Feb 17 04:43:40.163861 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 751/1593] 10.222.0.78 () {60 vars in 1267 bytes} [Wed Feb 17 04:43:39 2021] GET /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550 => generated 1724 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:43:41.185225 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-cda3ce74-c1b2-421e-bc47-1744b34faeb1 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:43:41.186048 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-cda3ce74-c1b2-421e-bc47-1744b34faeb1 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 5e68206c-24dc-4ec9-b907-bf233d27d550] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:43:41.194098 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-cda3ce74-c1b2-421e-bc47-1744b34faeb1 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:43:41.194606 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-cda3ce74-c1b2-421e-bc47-1744b34faeb1 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:43:41.195499 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-cda3ce74-c1b2-421e-bc47-1744b34faeb1 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:43:41.195994 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-cda3ce74-c1b2-421e-bc47-1744b34faeb1 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:43:41.419795 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-cda3ce74-c1b2-421e-bc47-1744b34faeb1 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:43:41.429908 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-cda3ce74-c1b2-421e-bc47-1744b34faeb1 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:43:41.431509 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-cda3ce74-c1b2-421e-bc47-1744b34faeb1 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:43:41.432742 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-cda3ce74-c1b2-421e-bc47-1744b34faeb1 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "GET /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550" status: 200 len: 1724 microversion: 2.20 time: 0.252043 Feb 17 04:43:41.433282 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 843/1594] 10.222.0.78 () {60 vars in 1267 bytes} [Wed Feb 17 04:43:41 2021] GET /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550 => generated 1724 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:43:42.453829 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-7c51fa90-47e3-43a8-bc71-e66255e0a933 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:43:42.456188 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [req-568d3fd1-f954-4f64-a4d4-cefe4e60380b req-0dbcfa2b-6f16-4342-867b-07143b897868 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e68206c-24dc-4ec9-b907-bf233d27d550", "name": "network-vif-unplugged", "status": "completed", "tag": "11791c9e-fcaf-4d11-8104-b4270f0591a6"}]} {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:43:42.457186 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-7c51fa90-47e3-43a8-bc71-e66255e0a933 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 5e68206c-24dc-4ec9-b907-bf233d27d550] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:43:42.462823 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:43:42.462823 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: warnings.warn(msg) Feb 17 04:43:42.465617 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-7c51fa90-47e3-43a8-bc71-e66255e0a933 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:43:42.465756 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-7c51fa90-47e3-43a8-bc71-e66255e0a933 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:43:42.466603 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-7c51fa90-47e3-43a8-bc71-e66255e0a933 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:43:42.467674 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-7c51fa90-47e3-43a8-bc71-e66255e0a933 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:43:42.485062 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [req-568d3fd1-f954-4f64-a4d4-cefe4e60380b req-0dbcfa2b-6f16-4342-867b-07143b897868 service nova] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:43:42.485560 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [req-568d3fd1-f954-4f64-a4d4-cefe4e60380b req-0dbcfa2b-6f16-4342-867b-07143b897868 service nova] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:43:42.507785 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO oslo.messaging._drivers.impl_rabbit [-] [74073561-5d49-4824-899c-58d1d7a4dfc3] Reconnected to AMQP server on 10.222.0.78:5672 via [amqp] client with port 33214. Feb 17 04:43:42.510353 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.compute.server_external_events [req-568d3fd1-f954-4f64-a4d4-cefe4e60380b req-0dbcfa2b-6f16-4342-867b-07143b897868 service nova] Creating event network-vif-unplugged:11791c9e-fcaf-4d11-8104-b4270f0591a6 for instance 5e68206c-24dc-4ec9-b907-bf233d27d550 on hv-cinder-75998 Feb 17 04:43:42.516222 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [req-568d3fd1-f954-4f64-a4d4-cefe4e60380b req-0dbcfa2b-6f16-4342-867b-07143b897868 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.071585 Feb 17 04:43:42.517027 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 752/1595] 10.222.0.78 () {64 vars in 1308 bytes} [Wed Feb 17 04:43:42 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:43:42.689149 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-7c51fa90-47e3-43a8-bc71-e66255e0a933 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:43:42.698793 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-7c51fa90-47e3-43a8-bc71-e66255e0a933 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:43:42.700395 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-7c51fa90-47e3-43a8-bc71-e66255e0a933 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:43:42.701692 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-7c51fa90-47e3-43a8-bc71-e66255e0a933 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "GET /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550" status: 200 len: 1724 microversion: 2.20 time: 0.252497 Feb 17 04:43:42.702317 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 844/1596] 10.222.0.78 () {60 vars in 1267 bytes} [Wed Feb 17 04:43:42 2021] GET /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550 => generated 1724 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:43:43.723192 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-6cd4afe5-5e4a-48bc-8927-49b675589325 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:43:43.724014 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-6cd4afe5-5e4a-48bc-8927-49b675589325 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 5e68206c-24dc-4ec9-b907-bf233d27d550] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:43:43.732731 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-6cd4afe5-5e4a-48bc-8927-49b675589325 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:43:43.733370 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-6cd4afe5-5e4a-48bc-8927-49b675589325 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:43:43.734210 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-6cd4afe5-5e4a-48bc-8927-49b675589325 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:43:43.734705 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-6cd4afe5-5e4a-48bc-8927-49b675589325 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:43:44.264781 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-6cd4afe5-5e4a-48bc-8927-49b675589325 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:43:44.275478 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-6cd4afe5-5e4a-48bc-8927-49b675589325 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:43:44.277668 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-6cd4afe5-5e4a-48bc-8927-49b675589325 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:43:44.278458 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-6cd4afe5-5e4a-48bc-8927-49b675589325 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "GET /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550" status: 200 len: 1724 microversion: 2.20 time: 0.559944 Feb 17 04:43:44.279865 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 753/1597] 10.222.0.78 () {60 vars in 1267 bytes} [Wed Feb 17 04:43:43 2021] GET /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550 => generated 1724 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:43:45.033777 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [req-d418e526-b349-4a14-8525-4497b25a2063 req-49b9cb47-4842-44f2-8543-911bd82bb2fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e68206c-24dc-4ec9-b907-bf233d27d550", "name": "network-vif-deleted", "tag": "11791c9e-fcaf-4d11-8104-b4270f0591a6"}]} {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:43:45.036524 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:43:45.036524 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: warnings.warn(msg) Feb 17 04:43:45.047550 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [req-d418e526-b349-4a14-8525-4497b25a2063 req-49b9cb47-4842-44f2-8543-911bd82bb2fa service nova] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:43:45.048353 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [req-d418e526-b349-4a14-8525-4497b25a2063 req-49b9cb47-4842-44f2-8543-911bd82bb2fa service nova] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:43:45.075945 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.compute.server_external_events [req-d418e526-b349-4a14-8525-4497b25a2063 req-49b9cb47-4842-44f2-8543-911bd82bb2fa service nova] Creating event network-vif-deleted:11791c9e-fcaf-4d11-8104-b4270f0591a6 for instance 5e68206c-24dc-4ec9-b907-bf233d27d550 on hv-cinder-75998 Feb 17 04:43:45.082120 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [req-d418e526-b349-4a14-8525-4497b25a2063 req-49b9cb47-4842-44f2-8543-911bd82bb2fa service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052243 Feb 17 04:43:45.082776 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 845/1598] 10.222.0.78 () {64 vars in 1308 bytes} [Wed Feb 17 04:43:45 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:43:45.299109 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-e1493417-e5cb-470f-8a6c-59fc13eb3c00 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:43:45.299697 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-e1493417-e5cb-470f-8a6c-59fc13eb3c00 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 5e68206c-24dc-4ec9-b907-bf233d27d550] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:43:45.307693 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-e1493417-e5cb-470f-8a6c-59fc13eb3c00 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:43:45.308220 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-e1493417-e5cb-470f-8a6c-59fc13eb3c00 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:43:45.309236 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-e1493417-e5cb-470f-8a6c-59fc13eb3c00 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:43:45.309920 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-e1493417-e5cb-470f-8a6c-59fc13eb3c00 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:43:45.385133 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-e1493417-e5cb-470f-8a6c-59fc13eb3c00 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:43:45.385652 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-e1493417-e5cb-470f-8a6c-59fc13eb3c00 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:43:45.386172 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.objects.instance [None req-e1493417-e5cb-470f-8a6c-59fc13eb3c00 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lazy-loading 'fault' on Instance uuid 5e68206c-24dc-4ec9-b907-bf233d27d550 {{(pid=98178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Feb 17 04:43:45.469475 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-e1493417-e5cb-470f-8a6c-59fc13eb3c00 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:43:45.479206 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-e1493417-e5cb-470f-8a6c-59fc13eb3c00 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:43:45.481101 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-e1493417-e5cb-470f-8a6c-59fc13eb3c00 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1ae36a432a24019803fac4d68061a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc99fc094d4c3fb38cad060f2dc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:43:45.482345 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-e1493417-e5cb-470f-8a6c-59fc13eb3c00 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "GET /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550" status: 200 len: 1371 microversion: 2.20 time: 0.188175 Feb 17 04:43:45.483763 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 754/1599] 10.222.0.78 () {60 vars in 1267 bytes} [Wed Feb 17 04:43:45 2021] GET /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550 => generated 1371 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:43:46.502838 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-164a0d02-6339-48c9-8637-6e9fcd5ff117 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:43:46.503958 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-164a0d02-6339-48c9-8637-6e9fcd5ff117 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 5e68206c-24dc-4ec9-b907-bf233d27d550] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:43:46.512170 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-164a0d02-6339-48c9-8637-6e9fcd5ff117 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:43:46.512675 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-164a0d02-6339-48c9-8637-6e9fcd5ff117 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:43:46.513552 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-164a0d02-6339-48c9-8637-6e9fcd5ff117 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:43:46.514149 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-164a0d02-6339-48c9-8637-6e9fcd5ff117 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:43:46.568401 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.wsgi [None req-164a0d02-6339-48c9-8637-6e9fcd5ff117 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] HTTP exception thrown: Instance 5e68206c-24dc-4ec9-b907-bf233d27d550 could not be found. Feb 17 04:43:46.569081 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-164a0d02-6339-48c9-8637-6e9fcd5ff117 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Returning 404 to user: Instance 5e68206c-24dc-4ec9-b907-bf233d27d550 could not be found. {{(pid=98179) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 17 04:43:46.569980 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-164a0d02-6339-48c9-8637-6e9fcd5ff117 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "GET /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550" status: 404 len: 111 microversion: 2.20 time: 0.071813 Feb 17 04:43:46.570818 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 846/1600] 10.222.0.78 () {60 vars in 1267 bytes} [Wed Feb 17 04:43:46 2021] GET /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Feb 17 04:43:46.580885 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-c2c7df7e-2550-481c-a807-fdb31f4b5258 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Calling method '.version_select at 0x7f57c8af59d8>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:43:46.605199 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-c2c7df7e-2550-481c-a807-fdb31f4b5258 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1077625448" status: 204 len: 0 microversion: 2.20 time: 0.029395 Feb 17 04:43:46.606503 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 755/1601] 10.222.0.78 () {60 vars in 1252 bytes} [Wed Feb 17 04:43:46 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1077625448 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Feb 17 04:43:49.050406 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-672c2101-98cb-4eed-bc7a-1c771f031272 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:43:49.050961 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-672c2101-98cb-4eed-bc7a-1c771f031272 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 5e68206c-24dc-4ec9-b907-bf233d27d550] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:43:49.058833 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-672c2101-98cb-4eed-bc7a-1c771f031272 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:43:49.059371 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-672c2101-98cb-4eed-bc7a-1c771f031272 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:43:49.060212 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-672c2101-98cb-4eed-bc7a-1c771f031272 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:43:49.061411 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-672c2101-98cb-4eed-bc7a-1c771f031272 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:43:49.116868 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.wsgi [None req-672c2101-98cb-4eed-bc7a-1c771f031272 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] HTTP exception thrown: Instance 5e68206c-24dc-4ec9-b907-bf233d27d550 could not be found. Feb 17 04:43:49.117528 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-672c2101-98cb-4eed-bc7a-1c771f031272 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Returning 404 to user: Instance 5e68206c-24dc-4ec9-b907-bf233d27d550 could not be found. {{(pid=98179) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 17 04:43:49.118417 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-672c2101-98cb-4eed-bc7a-1c771f031272 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "DELETE /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550" status: 404 len: 111 microversion: 2.1 time: 0.072011 Feb 17 04:43:49.119009 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 847/1602] 10.222.0.78 () {58 vars in 1229 bytes} [Wed Feb 17 04:43:49 2021] DELETE /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 17 04:43:49.127625 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-3582f07b-9446-4300-a6eb-3f9004ade020 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:43:49.128331 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-3582f07b-9446-4300-a6eb-3f9004ade020 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 5e68206c-24dc-4ec9-b907-bf233d27d550] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:43:49.136962 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-3582f07b-9446-4300-a6eb-3f9004ade020 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:43:49.137475 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-3582f07b-9446-4300-a6eb-3f9004ade020 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:43:49.138341 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-3582f07b-9446-4300-a6eb-3f9004ade020 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:43:49.139548 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-3582f07b-9446-4300-a6eb-3f9004ade020 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:43:49.196492 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.wsgi [None req-3582f07b-9446-4300-a6eb-3f9004ade020 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] HTTP exception thrown: Instance 5e68206c-24dc-4ec9-b907-bf233d27d550 could not be found. Feb 17 04:43:49.197158 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-3582f07b-9446-4300-a6eb-3f9004ade020 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Returning 404 to user: Instance 5e68206c-24dc-4ec9-b907-bf233d27d550 could not be found. {{(pid=98178) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 17 04:43:49.198065 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-3582f07b-9446-4300-a6eb-3f9004ade020 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "GET /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550" status: 404 len: 111 microversion: 2.1 time: 0.074621 Feb 17 04:43:49.198675 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 756/1603] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:43:49 2021] GET /compute/v2.1/servers/5e68206c-24dc-4ec9-b907-bf233d27d550 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 17 04:43:50.443864 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-ce00e19c-5e93-449c-a15d-1c0be30bd548 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:43:50.444422 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-ce00e19c-5e93-449c-a15d-1c0be30bd548 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:43:50.453011 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-ce00e19c-5e93-449c-a15d-1c0be30bd548 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:43:50.453522 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-ce00e19c-5e93-449c-a15d-1c0be30bd548 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:43:50.454369 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-ce00e19c-5e93-449c-a15d-1c0be30bd548 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:43:50.454869 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-ce00e19c-5e93-449c-a15d-1c0be30bd548 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:43:50.508233 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.wsgi [None req-ce00e19c-5e93-449c-a15d-1c0be30bd548 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] HTTP exception thrown: Instance 8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9 could not be found. Feb 17 04:43:50.508896 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-ce00e19c-5e93-449c-a15d-1c0be30bd548 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Returning 404 to user: Instance 8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9 could not be found. {{(pid=98179) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 17 04:43:50.509787 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-ce00e19c-5e93-449c-a15d-1c0be30bd548 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "DELETE /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9" status: 404 len: 111 microversion: 2.1 time: 0.069987 Feb 17 04:43:50.510389 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 848/1604] 10.222.0.78 () {58 vars in 1229 bytes} [Wed Feb 17 04:43:50 2021] DELETE /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 17 04:43:50.519685 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-bd4ddc5e-50af-49c6-a64a-53f7c2676a11 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:43:50.520362 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-bd4ddc5e-50af-49c6-a64a-53f7c2676a11 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] [instance: 8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:43:50.528153 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-bd4ddc5e-50af-49c6-a64a-53f7c2676a11 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:43:50.528658 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-bd4ddc5e-50af-49c6-a64a-53f7c2676a11 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:43:50.530212 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-bd4ddc5e-50af-49c6-a64a-53f7c2676a11 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:43:50.530767 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-bd4ddc5e-50af-49c6-a64a-53f7c2676a11 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:43:50.583564 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.wsgi [None req-bd4ddc5e-50af-49c6-a64a-53f7c2676a11 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] HTTP exception thrown: Instance 8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9 could not be found. Feb 17 04:43:50.584225 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-bd4ddc5e-50af-49c6-a64a-53f7c2676a11 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] Returning 404 to user: Instance 8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9 could not be found. {{(pid=98178) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 17 04:43:50.585112 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-bd4ddc5e-50af-49c6-a64a-53f7c2676a11 tempest-AttachVolumeShelveTestJSON-891510115 tempest-AttachVolumeShelveTestJSON-891510115-project] 10.222.0.78 "GET /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9" status: 404 len: 111 microversion: 2.1 time: 0.069473 Feb 17 04:43:50.585715 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 757/1605] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:43:50 2021] GET /compute/v2.1/servers/8a6f7856-dae5-4b10-97ee-da0b2ec1f3f9 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 17 04:43:54.383388 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-deed870d-1234-4444-93c4-cdc7d9316f02 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-688039978", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1695173271", "security_groups": [{"name": "tempest-TestVolumeBootPattern-2120696101"}], "block_device_mapping_v2": [{"uuid": "a6aa005e-b0ad-4b4e-89b9-082d1045abb1", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "f6965ef8-6afe-410e-82fc-d80ca8d91ef7"}]}} {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:43:54.581965 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.network.neutron [None req-deed870d-1234-4444-93c4-cdc7d9316f02 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] validate_networks() for [('f6965ef8-6afe-410e-82fc-d80ca8d91ef7', None, None, None)] {{(pid=98179) validate_networks /opt/stack/nova/nova/network/neutron.py:2345}} Feb 17 04:43:55.284422 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.virt.hardware [None req-deed870d-1234-4444-93c4-cdc7d9316f02 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Flavor limits 0:0:0 {{(pid=98179) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 17 04:43:55.284909 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.virt.hardware [None req-deed870d-1234-4444-93c4-cdc7d9316f02 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Image limits 0:0:0 {{(pid=98179) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Feb 17 04:43:55.285458 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.virt.hardware [None req-deed870d-1234-4444-93c4-cdc7d9316f02 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Flavor pref 0:0:0 {{(pid=98179) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 17 04:43:55.286209 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.virt.hardware [None req-deed870d-1234-4444-93c4-cdc7d9316f02 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Image pref 0:0:0 {{(pid=98179) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Feb 17 04:43:55.287066 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.virt.hardware [None req-deed870d-1234-4444-93c4-cdc7d9316f02 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98179) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Feb 17 04:43:55.298700 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-deed870d-1234-4444-93c4-cdc7d9316f02 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:43:55.299252 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-deed870d-1234-4444-93c4-cdc7d9316f02 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:43:55.300135 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-deed870d-1234-4444-93c4-cdc7d9316f02 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:43:55.300637 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-deed870d-1234-4444-93c4-cdc7d9316f02 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:43:55.323967 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.quota [None req-deed870d-1234-4444-93c4-cdc7d9316f02 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Getting quotas for project 9a3a6cbbd6d14db5bf2f631af62262de. Resources: {'ram', 'cores', 'instances'} {{(pid=98179) _get_quotas /opt/stack/nova/nova/quota.py:388}} Feb 17 04:43:55.328645 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.quota [None req-deed870d-1234-4444-93c4-cdc7d9316f02 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Getting quotas for user f5b5a6c15a7c4228a0f94762b8b7b4a5 and project 9a3a6cbbd6d14db5bf2f631af62262de. Resources: {'ram', 'cores', 'instances'} {{(pid=98179) _get_quotas /opt/stack/nova/nova/quota.py:380}} Feb 17 04:43:55.444500 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-deed870d-1234-4444-93c4-cdc7d9316f02 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Going to run 1 instances... {{(pid=98179) _provision_instances /opt/stack/nova/nova/compute/api.py:1264}} Feb 17 04:43:55.446895 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-deed870d-1234-4444-93c4-cdc7d9316f02 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] [instance: 6cfbe354-bb33-4741-93e8-f09b3610df7a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='a6aa005e-b0ad-4b4e-89b9-082d1045abb1',volume_size=None,volume_type=None)] {{(pid=98179) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1666}} Feb 17 04:43:55.638196 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-deed870d-1234-4444-93c4-cdc7d9316f02 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 413 microversion: 2.1 time: 1.258897 Feb 17 04:43:55.639651 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 849/1606] 10.222.0.78 () {60 vars in 1137 bytes} [Wed Feb 17 04:43:54 2021] POST /compute/v2.1/servers => generated 413 bytes in 1261 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 17 04:43:55.650686 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-d939f4b4-3744-466e-988d-ea2b58862b37 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:43:55.651705 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-d939f4b4-3744-466e-988d-ea2b58862b37 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] [instance: 6cfbe354-bb33-4741-93e8-f09b3610df7a] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:43:55.946447 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-d939f4b4-3744-466e-988d-ea2b58862b37 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b5a6c15a7c4228a0f94762b8b7b4a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a3a6cbbd6d14db5bf2f631af62262de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:43:55.955439 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-d939f4b4-3744-466e-988d-ea2b58862b37 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] 10.222.0.78 "GET /compute/v2.1/servers/6cfbe354-bb33-4741-93e8-f09b3610df7a" status: 200 len: 1094 microversion: 2.1 time: 0.308651 Feb 17 04:43:55.956501 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 758/1607] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:43:55 2021] GET /compute/v2.1/servers/6cfbe354-bb33-4741-93e8-f09b3610df7a => generated 1094 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:43:56.974151 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-6a332879-6da9-4da1-a037-97d86ae52cd8 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:43:56.975129 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-6a332879-6da9-4da1-a037-97d86ae52cd8 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] [instance: 6cfbe354-bb33-4741-93e8-f09b3610df7a] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:43:56.984432 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-6a332879-6da9-4da1-a037-97d86ae52cd8 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:43:56.985245 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-6a332879-6da9-4da1-a037-97d86ae52cd8 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:43:56.986084 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-6a332879-6da9-4da1-a037-97d86ae52cd8 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:43:56.986818 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-6a332879-6da9-4da1-a037-97d86ae52cd8 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:43:57.120465 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-6a332879-6da9-4da1-a037-97d86ae52cd8 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b5a6c15a7c4228a0f94762b8b7b4a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a3a6cbbd6d14db5bf2f631af62262de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:43:57.130309 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-6a332879-6da9-4da1-a037-97d86ae52cd8 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] 10.222.0.78 "GET /compute/v2.1/servers/6cfbe354-bb33-4741-93e8-f09b3610df7a" status: 200 len: 1210 microversion: 2.1 time: 0.160253 Feb 17 04:43:57.131994 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 850/1608] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:43:56 2021] GET /compute/v2.1/servers/6cfbe354-bb33-4741-93e8-f09b3610df7a => generated 1210 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:43:58.150516 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-794f8a8e-d4e3-4162-8524-8c1561bd9310 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:43:58.152302 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-794f8a8e-d4e3-4162-8524-8c1561bd9310 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] [instance: 6cfbe354-bb33-4741-93e8-f09b3610df7a] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:43:58.161769 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-794f8a8e-d4e3-4162-8524-8c1561bd9310 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:43:58.162283 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-794f8a8e-d4e3-4162-8524-8c1561bd9310 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:43:58.163684 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-794f8a8e-d4e3-4162-8524-8c1561bd9310 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:43:58.164182 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-794f8a8e-d4e3-4162-8524-8c1561bd9310 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:43:58.379566 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-794f8a8e-d4e3-4162-8524-8c1561bd9310 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b5a6c15a7c4228a0f94762b8b7b4a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a3a6cbbd6d14db5bf2f631af62262de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:43:58.388521 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-794f8a8e-d4e3-4162-8524-8c1561bd9310 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] 10.222.0.78 "GET /compute/v2.1/servers/6cfbe354-bb33-4741-93e8-f09b3610df7a" status: 200 len: 1198 microversion: 2.1 time: 0.241916 Feb 17 04:43:58.390014 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 759/1609] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:43:58 2021] GET /compute/v2.1/servers/6cfbe354-bb33-4741-93e8-f09b3610df7a => generated 1198 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:43:59.407790 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-858724ff-f2fb-4dbf-be4f-d1deb033aec7 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:43:59.408436 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-858724ff-f2fb-4dbf-be4f-d1deb033aec7 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] [instance: 6cfbe354-bb33-4741-93e8-f09b3610df7a] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:43:59.412145 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: ERROR oslo.messaging._drivers.impl_rabbit [-] [5a9ab647-45d8-4916-a9a5-b6477356342d] AMQP server on 10.222.0.78:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Feb 17 04:43:59.417928 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-858724ff-f2fb-4dbf-be4f-d1deb033aec7 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:43:59.418506 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-858724ff-f2fb-4dbf-be4f-d1deb033aec7 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:43:59.420554 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-858724ff-f2fb-4dbf-be4f-d1deb033aec7 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:43:59.421260 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-858724ff-f2fb-4dbf-be4f-d1deb033aec7 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:43:59.914428 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-858724ff-f2fb-4dbf-be4f-d1deb033aec7 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b5a6c15a7c4228a0f94762b8b7b4a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a3a6cbbd6d14db5bf2f631af62262de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:43:59.924776 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-858724ff-f2fb-4dbf-be4f-d1deb033aec7 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] 10.222.0.78 "GET /compute/v2.1/servers/6cfbe354-bb33-4741-93e8-f09b3610df7a" status: 200 len: 1273 microversion: 2.1 time: 0.520870 Feb 17 04:43:59.925400 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 851/1610] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:43:59 2021] GET /compute/v2.1/servers/6cfbe354-bb33-4741-93e8-f09b3610df7a => generated 1273 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:44:00.758441 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [req-d7d3314f-6aad-4b63-80ff-19b08089e9ab req-b05fae6e-28e3-4550-bdd5-31bf0709cfe0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6cfbe354-bb33-4741-93e8-f09b3610df7a", "tag": "f1ef9bfd-24ad-4155-bf62-437714279e88"}]} {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:44:00.761017 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:44:00.761017 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: warnings.warn(msg) Feb 17 04:44:00.772658 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [req-d7d3314f-6aad-4b63-80ff-19b08089e9ab req-b05fae6e-28e3-4550-bdd5-31bf0709cfe0 service nova] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:44:00.773644 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [req-d7d3314f-6aad-4b63-80ff-19b08089e9ab req-b05fae6e-28e3-4550-bdd5-31bf0709cfe0 service nova] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:44:00.802031 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.compute.server_external_events [req-d7d3314f-6aad-4b63-80ff-19b08089e9ab req-b05fae6e-28e3-4550-bdd5-31bf0709cfe0 service nova] Creating event network-changed:f1ef9bfd-24ad-4155-bf62-437714279e88 for instance 6cfbe354-bb33-4741-93e8-f09b3610df7a on hv-cinder-75998 Feb 17 04:44:00.807663 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [req-d7d3314f-6aad-4b63-80ff-19b08089e9ab req-b05fae6e-28e3-4550-bdd5-31bf0709cfe0 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061425 Feb 17 04:44:00.808888 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 760/1611] 10.222.0.78 () {64 vars in 1308 bytes} [Wed Feb 17 04:44:00 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:44:00.943636 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-b3ef2234-4d50-4dd8-8104-3a0940a5b0ec tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:44:00.944740 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-b3ef2234-4d50-4dd8-8104-3a0940a5b0ec tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] [instance: 6cfbe354-bb33-4741-93e8-f09b3610df7a] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:44:00.965261 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-b3ef2234-4d50-4dd8-8104-3a0940a5b0ec tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:44:00.965261 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-b3ef2234-4d50-4dd8-8104-3a0940a5b0ec tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:44:00.966793 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-b3ef2234-4d50-4dd8-8104-3a0940a5b0ec tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:44:00.967439 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-b3ef2234-4d50-4dd8-8104-3a0940a5b0ec tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:44:01.032986 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO oslo.messaging._drivers.impl_rabbit [-] [5a9ab647-45d8-4916-a9a5-b6477356342d] Reconnected to AMQP server on 10.222.0.78:5672 via [amqp] client with port 33388. Feb 17 04:44:01.402323 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-b3ef2234-4d50-4dd8-8104-3a0940a5b0ec tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b5a6c15a7c4228a0f94762b8b7b4a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a3a6cbbd6d14db5bf2f631af62262de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:44:01.412728 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-b3ef2234-4d50-4dd8-8104-3a0940a5b0ec tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] 10.222.0.78 "GET /compute/v2.1/servers/6cfbe354-bb33-4741-93e8-f09b3610df7a" status: 200 len: 1273 microversion: 2.1 time: 0.473429 Feb 17 04:44:01.425146 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 852/1612] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:44:00 2021] GET /compute/v2.1/servers/6cfbe354-bb33-4741-93e8-f09b3610df7a => generated 1273 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:44:02.433384 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-25ae064c-3aff-433c-ab33-5dd0d1368661 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:44:02.434153 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-25ae064c-3aff-433c-ab33-5dd0d1368661 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] [instance: 6cfbe354-bb33-4741-93e8-f09b3610df7a] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:44:02.443144 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-25ae064c-3aff-433c-ab33-5dd0d1368661 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:44:02.443648 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-25ae064c-3aff-433c-ab33-5dd0d1368661 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:44:02.444520 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-25ae064c-3aff-433c-ab33-5dd0d1368661 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:44:02.444960 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-25ae064c-3aff-433c-ab33-5dd0d1368661 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:44:02.677844 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-25ae064c-3aff-433c-ab33-5dd0d1368661 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b5a6c15a7c4228a0f94762b8b7b4a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a3a6cbbd6d14db5bf2f631af62262de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:44:02.697501 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-25ae064c-3aff-433c-ab33-5dd0d1368661 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] 10.222.0.78 "GET /compute/v2.1/servers/6cfbe354-bb33-4741-93e8-f09b3610df7a" status: 200 len: 1273 microversion: 2.1 time: 0.268509 Feb 17 04:44:02.698182 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 761/1613] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:44:02 2021] GET /compute/v2.1/servers/6cfbe354-bb33-4741-93e8-f09b3610df7a => generated 1273 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:44:03.717429 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-d9799ae5-74eb-4aed-911a-abe1f9e564fd tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:44:03.718850 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-d9799ae5-74eb-4aed-911a-abe1f9e564fd tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] [instance: 6cfbe354-bb33-4741-93e8-f09b3610df7a] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:44:03.726945 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-d9799ae5-74eb-4aed-911a-abe1f9e564fd tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:44:03.727493 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-d9799ae5-74eb-4aed-911a-abe1f9e564fd tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:44:03.728400 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-d9799ae5-74eb-4aed-911a-abe1f9e564fd tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:44:03.728911 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-d9799ae5-74eb-4aed-911a-abe1f9e564fd tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:44:04.126389 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-d9799ae5-74eb-4aed-911a-abe1f9e564fd tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b5a6c15a7c4228a0f94762b8b7b4a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a3a6cbbd6d14db5bf2f631af62262de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:44:04.135451 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-d9799ae5-74eb-4aed-911a-abe1f9e564fd tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] 10.222.0.78 "GET /compute/v2.1/servers/6cfbe354-bb33-4741-93e8-f09b3610df7a" status: 200 len: 1273 microversion: 2.1 time: 0.422417 Feb 17 04:44:04.136350 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 853/1614] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:44:03 2021] GET /compute/v2.1/servers/6cfbe354-bb33-4741-93e8-f09b3610df7a => generated 1273 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:44:05.155846 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-d3b7f3ce-4d2c-414a-9229-df18878b13b1 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:44:05.156483 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-d3b7f3ce-4d2c-414a-9229-df18878b13b1 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] [instance: 6cfbe354-bb33-4741-93e8-f09b3610df7a] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:44:05.164689 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-d3b7f3ce-4d2c-414a-9229-df18878b13b1 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:44:05.165192 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-d3b7f3ce-4d2c-414a-9229-df18878b13b1 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:44:05.166037 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-d3b7f3ce-4d2c-414a-9229-df18878b13b1 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:44:05.166527 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-d3b7f3ce-4d2c-414a-9229-df18878b13b1 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:44:05.389014 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-d3b7f3ce-4d2c-414a-9229-df18878b13b1 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b5a6c15a7c4228a0f94762b8b7b4a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a3a6cbbd6d14db5bf2f631af62262de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:44:05.398273 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-d3b7f3ce-4d2c-414a-9229-df18878b13b1 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] 10.222.0.78 "GET /compute/v2.1/servers/6cfbe354-bb33-4741-93e8-f09b3610df7a" status: 200 len: 1273 microversion: 2.1 time: 0.247013 Feb 17 04:44:05.398890 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 762/1615] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:44:05 2021] GET /compute/v2.1/servers/6cfbe354-bb33-4741-93e8-f09b3610df7a => generated 1273 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:44:06.417646 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-43a0507b-7ff6-4160-930b-186cd8eabb2e tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:44:06.418235 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-43a0507b-7ff6-4160-930b-186cd8eabb2e tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] [instance: 6cfbe354-bb33-4741-93e8-f09b3610df7a] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:44:06.426944 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-43a0507b-7ff6-4160-930b-186cd8eabb2e tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:44:06.427481 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-43a0507b-7ff6-4160-930b-186cd8eabb2e tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:44:06.428310 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-43a0507b-7ff6-4160-930b-186cd8eabb2e tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:44:06.428797 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-43a0507b-7ff6-4160-930b-186cd8eabb2e tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:44:06.936757 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-43a0507b-7ff6-4160-930b-186cd8eabb2e tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b5a6c15a7c4228a0f94762b8b7b4a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a3a6cbbd6d14db5bf2f631af62262de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:44:06.945640 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-43a0507b-7ff6-4160-930b-186cd8eabb2e tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] 10.222.0.78 "GET /compute/v2.1/servers/6cfbe354-bb33-4741-93e8-f09b3610df7a" status: 200 len: 1273 microversion: 2.1 time: 0.532097 Feb 17 04:44:06.946255 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 854/1616] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:44:06 2021] GET /compute/v2.1/servers/6cfbe354-bb33-4741-93e8-f09b3610df7a => generated 1273 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:44:07.968660 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-817f0ca2-dc50-437e-b357-701d887152be tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:44:07.969337 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-817f0ca2-dc50-437e-b357-701d887152be tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] [instance: 6cfbe354-bb33-4741-93e8-f09b3610df7a] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:44:07.977187 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-817f0ca2-dc50-437e-b357-701d887152be tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:44:07.977689 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-817f0ca2-dc50-437e-b357-701d887152be tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:44:07.978528 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-817f0ca2-dc50-437e-b357-701d887152be tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:44:07.979024 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-817f0ca2-dc50-437e-b357-701d887152be tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:44:08.199921 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-817f0ca2-dc50-437e-b357-701d887152be tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b5a6c15a7c4228a0f94762b8b7b4a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a3a6cbbd6d14db5bf2f631af62262de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:44:08.209063 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-817f0ca2-dc50-437e-b357-701d887152be tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] 10.222.0.78 "GET /compute/v2.1/servers/6cfbe354-bb33-4741-93e8-f09b3610df7a" status: 200 len: 1273 microversion: 2.1 time: 0.247279 Feb 17 04:44:08.209674 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 763/1617] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:44:07 2021] GET /compute/v2.1/servers/6cfbe354-bb33-4741-93e8-f09b3610df7a => generated 1273 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:44:09.228289 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-668a7316-4b8c-43a3-969d-259c26027670 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:44:09.228967 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-668a7316-4b8c-43a3-969d-259c26027670 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] [instance: 6cfbe354-bb33-4741-93e8-f09b3610df7a] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:44:09.237361 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-668a7316-4b8c-43a3-969d-259c26027670 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:44:09.237873 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-668a7316-4b8c-43a3-969d-259c26027670 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:44:09.238722 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-668a7316-4b8c-43a3-969d-259c26027670 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:44:09.239249 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-668a7316-4b8c-43a3-969d-259c26027670 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:44:09.458183 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-668a7316-4b8c-43a3-969d-259c26027670 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b5a6c15a7c4228a0f94762b8b7b4a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a3a6cbbd6d14db5bf2f631af62262de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:44:09.468426 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-668a7316-4b8c-43a3-969d-259c26027670 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] 10.222.0.78 "GET /compute/v2.1/servers/6cfbe354-bb33-4741-93e8-f09b3610df7a" status: 200 len: 1273 microversion: 2.1 time: 0.244403 Feb 17 04:44:09.469053 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 855/1618] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:44:09 2021] GET /compute/v2.1/servers/6cfbe354-bb33-4741-93e8-f09b3610df7a => generated 1273 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:44:10.486445 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-34ed0353-710c-47e6-85ac-3367f7d9f37d tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:44:10.487891 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-34ed0353-710c-47e6-85ac-3367f7d9f37d tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] [instance: 6cfbe354-bb33-4741-93e8-f09b3610df7a] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:44:10.495225 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-34ed0353-710c-47e6-85ac-3367f7d9f37d tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:44:10.495742 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-34ed0353-710c-47e6-85ac-3367f7d9f37d tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:44:10.496595 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-34ed0353-710c-47e6-85ac-3367f7d9f37d tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:44:10.497089 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-34ed0353-710c-47e6-85ac-3367f7d9f37d tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:44:10.721998 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-34ed0353-710c-47e6-85ac-3367f7d9f37d tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b5a6c15a7c4228a0f94762b8b7b4a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a3a6cbbd6d14db5bf2f631af62262de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:44:10.731261 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-34ed0353-710c-47e6-85ac-3367f7d9f37d tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] 10.222.0.78 "GET /compute/v2.1/servers/6cfbe354-bb33-4741-93e8-f09b3610df7a" status: 200 len: 1273 microversion: 2.1 time: 0.249052 Feb 17 04:44:10.731839 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 764/1619] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:44:10 2021] GET /compute/v2.1/servers/6cfbe354-bb33-4741-93e8-f09b3610df7a => generated 1273 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:44:11.529395 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [req-36d3eab8-0611-4139-a6db-fb10885cb5a5 req-b6bf55ba-db66-491c-9d4a-79691e12940f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6cfbe354-bb33-4741-93e8-f09b3610df7a", "name": "network-vif-plugged", "status": "completed", "tag": "f1ef9bfd-24ad-4155-bf62-437714279e88"}]} {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:44:11.531363 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:44:11.531363 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: warnings.warn(msg) Feb 17 04:44:11.540224 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [req-36d3eab8-0611-4139-a6db-fb10885cb5a5 req-b6bf55ba-db66-491c-9d4a-79691e12940f service nova] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:44:11.540941 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [req-36d3eab8-0611-4139-a6db-fb10885cb5a5 req-b6bf55ba-db66-491c-9d4a-79691e12940f service nova] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:44:11.559940 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.compute.server_external_events [req-36d3eab8-0611-4139-a6db-fb10885cb5a5 req-b6bf55ba-db66-491c-9d4a-79691e12940f service nova] Creating event network-vif-plugged:f1ef9bfd-24ad-4155-bf62-437714279e88 for instance 6cfbe354-bb33-4741-93e8-f09b3610df7a on hv-cinder-75998 Feb 17 04:44:11.566075 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [req-36d3eab8-0611-4139-a6db-fb10885cb5a5 req-b6bf55ba-db66-491c-9d4a-79691e12940f service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040543 Feb 17 04:44:11.566999 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 856/1620] 10.222.0.78 () {64 vars in 1308 bytes} [Wed Feb 17 04:44:11 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:44:11.750311 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-30e6cf7a-d6db-46e9-8717-9bd8c40ad18b tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:44:11.751061 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-30e6cf7a-d6db-46e9-8717-9bd8c40ad18b tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] [instance: 6cfbe354-bb33-4741-93e8-f09b3610df7a] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:44:11.759061 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-30e6cf7a-d6db-46e9-8717-9bd8c40ad18b tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:44:11.759575 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-30e6cf7a-d6db-46e9-8717-9bd8c40ad18b tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:44:11.760438 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-30e6cf7a-d6db-46e9-8717-9bd8c40ad18b tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:44:11.760967 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-30e6cf7a-d6db-46e9-8717-9bd8c40ad18b tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:44:12.119942 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-30e6cf7a-d6db-46e9-8717-9bd8c40ad18b tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b5a6c15a7c4228a0f94762b8b7b4a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a3a6cbbd6d14db5bf2f631af62262de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:44:12.129824 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-30e6cf7a-d6db-46e9-8717-9bd8c40ad18b tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] 10.222.0.78 "GET /compute/v2.1/servers/6cfbe354-bb33-4741-93e8-f09b3610df7a" status: 200 len: 1273 microversion: 2.1 time: 0.383751 Feb 17 04:44:12.130442 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 765/1621] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:44:11 2021] GET /compute/v2.1/servers/6cfbe354-bb33-4741-93e8-f09b3610df7a => generated 1273 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:44:13.151401 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-74bd3e3a-cc1c-459c-95e8-beb13fb9643d tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:44:13.156047 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-74bd3e3a-cc1c-459c-95e8-beb13fb9643d tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] [instance: 6cfbe354-bb33-4741-93e8-f09b3610df7a] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:44:13.165942 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-74bd3e3a-cc1c-459c-95e8-beb13fb9643d tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:44:13.166842 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-74bd3e3a-cc1c-459c-95e8-beb13fb9643d tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:44:13.167882 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-74bd3e3a-cc1c-459c-95e8-beb13fb9643d tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:44:13.168536 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-74bd3e3a-cc1c-459c-95e8-beb13fb9643d tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:44:13.412256 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-74bd3e3a-cc1c-459c-95e8-beb13fb9643d tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b5a6c15a7c4228a0f94762b8b7b4a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a3a6cbbd6d14db5bf2f631af62262de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:44:13.422172 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-74bd3e3a-cc1c-459c-95e8-beb13fb9643d tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] 10.222.0.78 "GET /compute/v2.1/servers/6cfbe354-bb33-4741-93e8-f09b3610df7a" status: 200 len: 1273 microversion: 2.1 time: 0.277317 Feb 17 04:44:13.422993 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 857/1622] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:44:13 2021] GET /compute/v2.1/servers/6cfbe354-bb33-4741-93e8-f09b3610df7a => generated 1273 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:44:14.441430 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-3f84bea2-8457-431f-9a34-2afe7d98d519 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:44:14.442115 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-3f84bea2-8457-431f-9a34-2afe7d98d519 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] [instance: 6cfbe354-bb33-4741-93e8-f09b3610df7a] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:44:14.449989 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-3f84bea2-8457-431f-9a34-2afe7d98d519 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:44:14.450552 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-3f84bea2-8457-431f-9a34-2afe7d98d519 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:44:14.451692 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-3f84bea2-8457-431f-9a34-2afe7d98d519 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:44:14.452084 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-3f84bea2-8457-431f-9a34-2afe7d98d519 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:44:14.663718 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-3f84bea2-8457-431f-9a34-2afe7d98d519 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b5a6c15a7c4228a0f94762b8b7b4a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a3a6cbbd6d14db5bf2f631af62262de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:44:14.673304 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-3f84bea2-8457-431f-9a34-2afe7d98d519 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] 10.222.0.78 "GET /compute/v2.1/servers/6cfbe354-bb33-4741-93e8-f09b3610df7a" status: 200 len: 1460 microversion: 2.1 time: 0.235800 Feb 17 04:44:14.673965 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 766/1623] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:44:14 2021] GET /compute/v2.1/servers/6cfbe354-bb33-4741-93e8-f09b3610df7a => generated 1460 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:44:14.690760 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-a32b4b27-399b-4600-b246-fe1bb7fde539 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:44:14.691497 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-a32b4b27-399b-4600-b246-fe1bb7fde539 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] [instance: 6cfbe354-bb33-4741-93e8-f09b3610df7a] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:44:14.699215 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-a32b4b27-399b-4600-b246-fe1bb7fde539 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:44:14.699723 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-a32b4b27-399b-4600-b246-fe1bb7fde539 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:44:14.700666 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-a32b4b27-399b-4600-b246-fe1bb7fde539 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:44:14.701197 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-a32b4b27-399b-4600-b246-fe1bb7fde539 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:44:14.922761 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-a32b4b27-399b-4600-b246-fe1bb7fde539 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b5a6c15a7c4228a0f94762b8b7b4a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a3a6cbbd6d14db5bf2f631af62262de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:44:14.931724 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-a32b4b27-399b-4600-b246-fe1bb7fde539 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] 10.222.0.78 "GET /compute/v2.1/servers/6cfbe354-bb33-4741-93e8-f09b3610df7a" status: 200 len: 1460 microversion: 2.1 time: 0.244869 Feb 17 04:44:14.932329 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 858/1624] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:44:14 2021] GET /compute/v2.1/servers/6cfbe354-bb33-4741-93e8-f09b3610df7a => generated 1460 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:44:14.950322 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-f9374530-3d66-4319-8bbe-5e7ee0727de7 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Action: 'create', calling method: .version_select at 0x7f57c8980a60>, body: {"pool": null} {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:44:17.257261 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-f9374530-3d66-4319-8bbe-5e7ee0727de7 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] 10.222.0.78 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.311005 Feb 17 04:44:17.257912 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 767/1625] 10.222.0.78 () {60 vars in 1160 bytes} [Wed Feb 17 04:44:14 2021] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2312 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:44:17.270055 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-0d09807b-3006-41a1-936f-cdf28fcb60dc tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.27.1.253"}} {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:44:17.271303 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-0d09807b-3006-41a1-936f-cdf28fcb60dc tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] [instance: 6cfbe354-bb33-4741-93e8-f09b3610df7a] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:44:17.279751 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-0d09807b-3006-41a1-936f-cdf28fcb60dc tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:44:17.280259 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-0d09807b-3006-41a1-936f-cdf28fcb60dc tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:44:17.281105 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-0d09807b-3006-41a1-936f-cdf28fcb60dc tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:44:17.281599 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-0d09807b-3006-41a1-936f-cdf28fcb60dc tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:44:17.346675 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-0d09807b-3006-41a1-936f-cdf28fcb60dc tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Acquired lock "refresh_cache-6cfbe354-bb33-4741-93e8-f09b3610df7a" {{(pid=98179) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:266}} Feb 17 04:44:19.432392 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.network.neutron [None req-0d09807b-3006-41a1-936f-cdf28fcb60dc tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] [instance: 6cfbe354-bb33-4741-93e8-f09b3610df7a] Building network info cache for instance {{(pid=98179) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1836}} Feb 17 04:44:19.448265 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [req-d651d4f4-e752-4751-bde1-28bd4d427c9b req-df08c8b8-036c-4a84-89d8-e4fa0b117809 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6cfbe354-bb33-4741-93e8-f09b3610df7a", "tag": "f1ef9bfd-24ad-4155-bf62-437714279e88"}]} {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:44:19.451137 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:44:19.451137 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: warnings.warn(msg) Feb 17 04:44:19.464598 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [req-d651d4f4-e752-4751-bde1-28bd4d427c9b req-df08c8b8-036c-4a84-89d8-e4fa0b117809 service nova] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:44:19.465241 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [req-d651d4f4-e752-4751-bde1-28bd4d427c9b req-df08c8b8-036c-4a84-89d8-e4fa0b117809 service nova] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:44:19.483821 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.compute.server_external_events [req-d651d4f4-e752-4751-bde1-28bd4d427c9b req-df08c8b8-036c-4a84-89d8-e4fa0b117809 service nova] Creating event network-changed:f1ef9bfd-24ad-4155-bf62-437714279e88 for instance 6cfbe354-bb33-4741-93e8-f09b3610df7a on hv-cinder-75998 Feb 17 04:44:19.489101 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [req-d651d4f4-e752-4751-bde1-28bd4d427c9b req-df08c8b8-036c-4a84-89d8-e4fa0b117809 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044895 Feb 17 04:44:19.489746 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 768/1626] 10.222.0.78 () {64 vars in 1308 bytes} [Wed Feb 17 04:44:19 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 17 04:44:20.602550 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.network.neutron [None req-0d09807b-3006-41a1-936f-cdf28fcb60dc tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] [instance: 6cfbe354-bb33-4741-93e8-f09b3610df7a] Updating instance_info_cache with network_info: [{"id": "f1ef9bfd-24ad-4155-bf62-437714279e88", "address": "fa:16:3e:4e:34:f2", "network": {"id": "f6965ef8-6afe-410e-82fc-d80ca8d91ef7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1360287644-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.27.1.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "9a3a6cbbd6d14db5bf2f631af62262de", "mtu": 1450, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, "devname": "tapf1ef9bfd-24", "ovs_interfaceid": "f1ef9bfd-24ad-4155-bf62-437714279e88", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "meta": {}}] {{(pid=98179) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Feb 17 04:44:20.611891 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-0d09807b-3006-41a1-936f-cdf28fcb60dc tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Releasing lock "refresh_cache-6cfbe354-bb33-4741-93e8-f09b3610df7a" {{(pid=98179) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:282}} Feb 17 04:44:20.612945 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-0d09807b-3006-41a1-936f-cdf28fcb60dc tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] 10.222.0.78 "POST /compute/v2.1/servers/6cfbe354-bb33-4741-93e8-f09b3610df7a/action" status: 202 len: 0 microversion: 2.1 time: 3.346991 Feb 17 04:44:20.613679 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 859/1627] 10.222.0.78 () {60 vars in 1268 bytes} [Wed Feb 17 04:44:17 2021] POST /compute/v2.1/servers/6cfbe354-bb33-4741-93e8-f09b3610df7a/action => generated 0 bytes in 3348 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Feb 17 04:45:06.909847 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 17 04:45:06.910468 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: Wed Feb 17 04:45:06 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 17 04:46:30.741708 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 17 04:46:30.742325 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: Wed Feb 17 04:46:30 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 17 04:46:33.912362 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: ERROR oslo.messaging._drivers.impl_rabbit [-] [74073561-5d49-4824-899c-58d1d7a4dfc3] AMQP server on 10.222.0.78:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Feb 17 04:46:33.916416 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-745906cf-79ab-4335-a25e-0f621cbaf575 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:46:33.917055 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-745906cf-79ab-4335-a25e-0f621cbaf575 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] [instance: 6cfbe354-bb33-4741-93e8-f09b3610df7a] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:46:33.925707 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-745906cf-79ab-4335-a25e-0f621cbaf575 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:46:33.926217 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-745906cf-79ab-4335-a25e-0f621cbaf575 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:46:33.927068 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-745906cf-79ab-4335-a25e-0f621cbaf575 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:46:33.927573 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-745906cf-79ab-4335-a25e-0f621cbaf575 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:46:33.992501 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-745906cf-79ab-4335-a25e-0f621cbaf575 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] [instance: 6cfbe354-bb33-4741-93e8-f09b3610df7a] Going to try to terminate instance {{(pid=98178) delete /opt/stack/nova/nova/compute/api.py:2540}} Feb 17 04:46:34.106397 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-745906cf-79ab-4335-a25e-0f621cbaf575 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] 10.222.0.78 "DELETE /compute/v2.1/servers/6cfbe354-bb33-4741-93e8-f09b3610df7a" status: 204 len: 0 microversion: 2.1 time: 0.195492 Feb 17 04:46:34.107159 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 769/1628] 10.222.0.78 () {58 vars in 1229 bytes} [Wed Feb 17 04:46:33 2021] DELETE /compute/v2.1/servers/6cfbe354-bb33-4741-93e8-f09b3610df7a => generated 0 bytes in 198 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 17 04:46:34.117927 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-59c75d1c-3377-4bc8-939e-0f99e386c42a tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:46:34.118616 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-59c75d1c-3377-4bc8-939e-0f99e386c42a tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] [instance: 6cfbe354-bb33-4741-93e8-f09b3610df7a] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:46:34.126679 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-59c75d1c-3377-4bc8-939e-0f99e386c42a tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:46:34.127225 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-59c75d1c-3377-4bc8-939e-0f99e386c42a tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:46:34.128225 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-59c75d1c-3377-4bc8-939e-0f99e386c42a tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:46:34.129247 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-59c75d1c-3377-4bc8-939e-0f99e386c42a tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:46:34.358940 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-59c75d1c-3377-4bc8-939e-0f99e386c42a tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b5a6c15a7c4228a0f94762b8b7b4a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a3a6cbbd6d14db5bf2f631af62262de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:46:34.368062 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-59c75d1c-3377-4bc8-939e-0f99e386c42a tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] 10.222.0.78 "GET /compute/v2.1/servers/6cfbe354-bb33-4741-93e8-f09b3610df7a" status: 200 len: 1585 microversion: 2.1 time: 0.256081 Feb 17 04:46:34.368659 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 860/1629] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:46:34 2021] GET /compute/v2.1/servers/6cfbe354-bb33-4741-93e8-f09b3610df7a => generated 1585 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:46:35.388227 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-cc086945-5aeb-4051-969b-f407d0bc5b4f tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:46:35.389008 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-cc086945-5aeb-4051-969b-f407d0bc5b4f tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] [instance: 6cfbe354-bb33-4741-93e8-f09b3610df7a] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:46:35.408503 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-cc086945-5aeb-4051-969b-f407d0bc5b4f tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:46:35.409015 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-cc086945-5aeb-4051-969b-f407d0bc5b4f tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:46:35.410975 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-cc086945-5aeb-4051-969b-f407d0bc5b4f tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:46:35.411498 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-cc086945-5aeb-4051-969b-f407d0bc5b4f tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:46:35.448628 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO oslo.messaging._drivers.impl_rabbit [-] [74073561-5d49-4824-899c-58d1d7a4dfc3] Reconnected to AMQP server on 10.222.0.78:5672 via [amqp] client with port 33986. Feb 17 04:46:35.635770 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-cc086945-5aeb-4051-969b-f407d0bc5b4f tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b5a6c15a7c4228a0f94762b8b7b4a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a3a6cbbd6d14db5bf2f631af62262de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:46:35.644974 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-cc086945-5aeb-4051-969b-f407d0bc5b4f tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] 10.222.0.78 "GET /compute/v2.1/servers/6cfbe354-bb33-4741-93e8-f09b3610df7a" status: 200 len: 1585 microversion: 2.1 time: 0.261277 Feb 17 04:46:35.645569 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 770/1630] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:46:35 2021] GET /compute/v2.1/servers/6cfbe354-bb33-4741-93e8-f09b3610df7a => generated 1585 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:46:36.663662 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-22ec6361-eace-45f5-ba05-c8d81cfd033e tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:46:36.664341 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-22ec6361-eace-45f5-ba05-c8d81cfd033e tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] [instance: 6cfbe354-bb33-4741-93e8-f09b3610df7a] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:46:36.672396 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-22ec6361-eace-45f5-ba05-c8d81cfd033e tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:46:36.672914 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-22ec6361-eace-45f5-ba05-c8d81cfd033e tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:46:36.673765 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-22ec6361-eace-45f5-ba05-c8d81cfd033e tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:46:36.674259 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-22ec6361-eace-45f5-ba05-c8d81cfd033e tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:46:36.890903 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-22ec6361-eace-45f5-ba05-c8d81cfd033e tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b5a6c15a7c4228a0f94762b8b7b4a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a3a6cbbd6d14db5bf2f631af62262de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:46:36.900166 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-22ec6361-eace-45f5-ba05-c8d81cfd033e tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] 10.222.0.78 "GET /compute/v2.1/servers/6cfbe354-bb33-4741-93e8-f09b3610df7a" status: 200 len: 1585 microversion: 2.1 time: 0.240693 Feb 17 04:46:36.900781 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 861/1631] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:46:36 2021] GET /compute/v2.1/servers/6cfbe354-bb33-4741-93e8-f09b3610df7a => generated 1585 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:46:37.920018 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-76ce2679-447e-401e-8226-c0b74da310cb tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:46:37.921323 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-76ce2679-447e-401e-8226-c0b74da310cb tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] [instance: 6cfbe354-bb33-4741-93e8-f09b3610df7a] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:46:37.931326 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-76ce2679-447e-401e-8226-c0b74da310cb tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:46:37.931923 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-76ce2679-447e-401e-8226-c0b74da310cb tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:46:37.938166 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [req-11d07656-ce9c-4969-8084-822a4f5df966 req-1aa1d812-c428-4746-ab43-959d6d7372fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6cfbe354-bb33-4741-93e8-f09b3610df7a", "name": "network-vif-deleted", "tag": "f1ef9bfd-24ad-4155-bf62-437714279e88"}]} {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:46:37.938326 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-76ce2679-447e-401e-8226-c0b74da310cb tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:46:37.938780 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-76ce2679-447e-401e-8226-c0b74da310cb tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:46:37.939924 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:46:37.939924 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: warnings.warn(msg) Feb 17 04:46:37.949599 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [req-11d07656-ce9c-4969-8084-822a4f5df966 req-1aa1d812-c428-4746-ab43-959d6d7372fe service nova] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:46:37.950111 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [req-11d07656-ce9c-4969-8084-822a4f5df966 req-1aa1d812-c428-4746-ab43-959d6d7372fe service nova] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:46:37.967733 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.compute.server_external_events [req-11d07656-ce9c-4969-8084-822a4f5df966 req-1aa1d812-c428-4746-ab43-959d6d7372fe service nova] Creating event network-vif-deleted:f1ef9bfd-24ad-4155-bf62-437714279e88 for instance 6cfbe354-bb33-4741-93e8-f09b3610df7a on hv-cinder-75998 Feb 17 04:46:37.973441 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [req-11d07656-ce9c-4969-8084-822a4f5df966 req-1aa1d812-c428-4746-ab43-959d6d7372fe service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.265378 Feb 17 04:46:37.974310 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 771/1632] 10.222.0.78 () {64 vars in 1308 bytes} [Wed Feb 17 04:46:37 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:46:38.070362 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-76ce2679-447e-401e-8226-c0b74da310cb tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b5a6c15a7c4228a0f94762b8b7b4a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a3a6cbbd6d14db5bf2f631af62262de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:46:38.079443 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-76ce2679-447e-401e-8226-c0b74da310cb tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] 10.222.0.78 "GET /compute/v2.1/servers/6cfbe354-bb33-4741-93e8-f09b3610df7a" status: 200 len: 1225 microversion: 2.1 time: 0.165420 Feb 17 04:46:38.080048 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 862/1633] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:46:37 2021] GET /compute/v2.1/servers/6cfbe354-bb33-4741-93e8-f09b3610df7a => generated 1225 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:46:39.098718 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-f328b1d4-8e8b-4983-9178-747af995fb8a tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:46:39.099503 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-f328b1d4-8e8b-4983-9178-747af995fb8a tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] [instance: 6cfbe354-bb33-4741-93e8-f09b3610df7a] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:46:39.107939 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-f328b1d4-8e8b-4983-9178-747af995fb8a tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:46:39.108445 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-f328b1d4-8e8b-4983-9178-747af995fb8a tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:46:39.109280 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-f328b1d4-8e8b-4983-9178-747af995fb8a tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:46:39.109773 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-f328b1d4-8e8b-4983-9178-747af995fb8a tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:46:39.164647 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.wsgi [None req-f328b1d4-8e8b-4983-9178-747af995fb8a tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] HTTP exception thrown: Instance 6cfbe354-bb33-4741-93e8-f09b3610df7a could not be found. Feb 17 04:46:39.165312 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-f328b1d4-8e8b-4983-9178-747af995fb8a tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Returning 404 to user: Instance 6cfbe354-bb33-4741-93e8-f09b3610df7a could not be found. {{(pid=98178) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 17 04:46:39.166215 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-f328b1d4-8e8b-4983-9178-747af995fb8a tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] 10.222.0.78 "GET /compute/v2.1/servers/6cfbe354-bb33-4741-93e8-f09b3610df7a" status: 404 len: 111 microversion: 2.1 time: 0.072145 Feb 17 04:46:39.166840 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 772/1634] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:46:39 2021] GET /compute/v2.1/servers/6cfbe354-bb33-4741-93e8-f09b3610df7a => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 17 04:46:39.281309 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-7f67a738-b8a9-41da-96ec-72ab8ed4b515 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1968076445", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1695173271", "security_groups": [{"name": "tempest-TestVolumeBootPattern-2120696101"}], "block_device_mapping_v2": [{"uuid": "a6aa005e-b0ad-4b4e-89b9-082d1045abb1", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "f6965ef8-6afe-410e-82fc-d80ca8d91ef7"}]}} {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:46:39.460637 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.network.neutron [None req-7f67a738-b8a9-41da-96ec-72ab8ed4b515 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] validate_networks() for [('f6965ef8-6afe-410e-82fc-d80ca8d91ef7', None, None, None)] {{(pid=98179) validate_networks /opt/stack/nova/nova/network/neutron.py:2345}} Feb 17 04:46:40.033696 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.virt.hardware [None req-7f67a738-b8a9-41da-96ec-72ab8ed4b515 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Flavor limits 0:0:0 {{(pid=98179) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 17 04:46:40.034274 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.virt.hardware [None req-7f67a738-b8a9-41da-96ec-72ab8ed4b515 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Image limits 0:0:0 {{(pid=98179) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Feb 17 04:46:40.035011 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.virt.hardware [None req-7f67a738-b8a9-41da-96ec-72ab8ed4b515 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Flavor pref 0:0:0 {{(pid=98179) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 17 04:46:40.035506 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.virt.hardware [None req-7f67a738-b8a9-41da-96ec-72ab8ed4b515 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Image pref 0:0:0 {{(pid=98179) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Feb 17 04:46:40.035983 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.virt.hardware [None req-7f67a738-b8a9-41da-96ec-72ab8ed4b515 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98179) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Feb 17 04:46:40.044811 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-7f67a738-b8a9-41da-96ec-72ab8ed4b515 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:46:40.045326 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-7f67a738-b8a9-41da-96ec-72ab8ed4b515 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:46:40.046215 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-7f67a738-b8a9-41da-96ec-72ab8ed4b515 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:46:40.046718 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-7f67a738-b8a9-41da-96ec-72ab8ed4b515 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:46:40.067145 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.quota [None req-7f67a738-b8a9-41da-96ec-72ab8ed4b515 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Getting quotas for project 9a3a6cbbd6d14db5bf2f631af62262de. Resources: {'ram', 'cores', 'instances'} {{(pid=98179) _get_quotas /opt/stack/nova/nova/quota.py:388}} Feb 17 04:46:40.071424 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.quota [None req-7f67a738-b8a9-41da-96ec-72ab8ed4b515 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Getting quotas for user f5b5a6c15a7c4228a0f94762b8b7b4a5 and project 9a3a6cbbd6d14db5bf2f631af62262de. Resources: {'ram', 'cores', 'instances'} {{(pid=98179) _get_quotas /opt/stack/nova/nova/quota.py:380}} Feb 17 04:46:40.179364 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-7f67a738-b8a9-41da-96ec-72ab8ed4b515 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Going to run 1 instances... {{(pid=98179) _provision_instances /opt/stack/nova/nova/compute/api.py:1264}} Feb 17 04:46:40.181774 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-7f67a738-b8a9-41da-96ec-72ab8ed4b515 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] [instance: d7de8213-4471-4db7-85fa-5281594fb263] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='a6aa005e-b0ad-4b4e-89b9-082d1045abb1',volume_size=None,volume_type=None)] {{(pid=98179) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1666}} Feb 17 04:46:40.358209 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-7f67a738-b8a9-41da-96ec-72ab8ed4b515 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 413 microversion: 2.1 time: 1.080827 Feb 17 04:46:40.358915 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 863/1635] 10.222.0.78 () {60 vars in 1137 bytes} [Wed Feb 17 04:46:39 2021] POST /compute/v2.1/servers => generated 413 bytes in 1082 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 17 04:46:40.369882 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-09aa4318-2910-482a-88e1-886d29413abb tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:46:40.370650 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-09aa4318-2910-482a-88e1-886d29413abb tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] [instance: d7de8213-4471-4db7-85fa-5281594fb263] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:46:40.485909 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-09aa4318-2910-482a-88e1-886d29413abb tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b5a6c15a7c4228a0f94762b8b7b4a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a3a6cbbd6d14db5bf2f631af62262de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:46:40.494516 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-09aa4318-2910-482a-88e1-886d29413abb tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] 10.222.0.78 "GET /compute/v2.1/servers/d7de8213-4471-4db7-85fa-5281594fb263" status: 200 len: 1095 microversion: 2.1 time: 0.128629 Feb 17 04:46:40.495137 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 773/1636] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:46:40 2021] GET /compute/v2.1/servers/d7de8213-4471-4db7-85fa-5281594fb263 => generated 1095 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:46:41.514814 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-47dbd48e-19af-461c-ae37-94a7efdba381 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:46:41.515638 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-47dbd48e-19af-461c-ae37-94a7efdba381 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] [instance: d7de8213-4471-4db7-85fa-5281594fb263] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:46:41.526595 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-47dbd48e-19af-461c-ae37-94a7efdba381 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:46:41.527241 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-47dbd48e-19af-461c-ae37-94a7efdba381 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:46:41.528190 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-47dbd48e-19af-461c-ae37-94a7efdba381 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:46:41.528763 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-47dbd48e-19af-461c-ae37-94a7efdba381 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:46:41.663124 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-47dbd48e-19af-461c-ae37-94a7efdba381 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b5a6c15a7c4228a0f94762b8b7b4a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a3a6cbbd6d14db5bf2f631af62262de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:46:41.671948 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-47dbd48e-19af-461c-ae37-94a7efdba381 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] 10.222.0.78 "GET /compute/v2.1/servers/d7de8213-4471-4db7-85fa-5281594fb263" status: 200 len: 1211 microversion: 2.1 time: 0.162095 Feb 17 04:46:41.672544 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 864/1637] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:46:41 2021] GET /compute/v2.1/servers/d7de8213-4471-4db7-85fa-5281594fb263 => generated 1211 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:46:42.691602 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-0c13a895-7056-4971-8068-ddb9b4136d14 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:46:42.692232 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-0c13a895-7056-4971-8068-ddb9b4136d14 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] [instance: d7de8213-4471-4db7-85fa-5281594fb263] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:46:42.701247 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-0c13a895-7056-4971-8068-ddb9b4136d14 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:46:42.701748 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-0c13a895-7056-4971-8068-ddb9b4136d14 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:46:42.702832 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-0c13a895-7056-4971-8068-ddb9b4136d14 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:46:42.703399 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-0c13a895-7056-4971-8068-ddb9b4136d14 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:46:43.184179 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-0c13a895-7056-4971-8068-ddb9b4136d14 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b5a6c15a7c4228a0f94762b8b7b4a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a3a6cbbd6d14db5bf2f631af62262de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:46:43.198155 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-0c13a895-7056-4971-8068-ddb9b4136d14 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] 10.222.0.78 "GET /compute/v2.1/servers/d7de8213-4471-4db7-85fa-5281594fb263" status: 200 len: 1274 microversion: 2.1 time: 0.510782 Feb 17 04:46:43.198896 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 774/1638] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:46:42 2021] GET /compute/v2.1/servers/d7de8213-4471-4db7-85fa-5281594fb263 => generated 1274 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:46:44.217416 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-6a9420fd-a2ee-40d3-81bf-ceb0ef080947 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:46:44.218099 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-6a9420fd-a2ee-40d3-81bf-ceb0ef080947 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] [instance: d7de8213-4471-4db7-85fa-5281594fb263] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:46:44.226771 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-6a9420fd-a2ee-40d3-81bf-ceb0ef080947 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:46:44.227260 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-6a9420fd-a2ee-40d3-81bf-ceb0ef080947 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:46:44.228111 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-6a9420fd-a2ee-40d3-81bf-ceb0ef080947 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:46:44.228876 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-6a9420fd-a2ee-40d3-81bf-ceb0ef080947 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:46:44.440314 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [req-a8a7ae55-8e57-4102-b733-acfd4404987d req-0af2ad6b-ba3d-44ef-a769-dffe9f6b9bd2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d7de8213-4471-4db7-85fa-5281594fb263", "tag": "2480c767-ef46-4401-82a3-4df91eb9e7d4"}]} {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:46:44.443527 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:46:44.443527 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: warnings.warn(msg) Feb 17 04:46:44.454612 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [req-a8a7ae55-8e57-4102-b733-acfd4404987d req-0af2ad6b-ba3d-44ef-a769-dffe9f6b9bd2 service nova] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:46:44.455142 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [req-a8a7ae55-8e57-4102-b733-acfd4404987d req-0af2ad6b-ba3d-44ef-a769-dffe9f6b9bd2 service nova] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:46:44.459850 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-6a9420fd-a2ee-40d3-81bf-ceb0ef080947 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b5a6c15a7c4228a0f94762b8b7b4a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a3a6cbbd6d14db5bf2f631af62262de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:46:44.469537 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-6a9420fd-a2ee-40d3-81bf-ceb0ef080947 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] 10.222.0.78 "GET /compute/v2.1/servers/d7de8213-4471-4db7-85fa-5281594fb263" status: 200 len: 1274 microversion: 2.1 time: 0.256013 Feb 17 04:46:44.470133 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 865/1639] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:46:44 2021] GET /compute/v2.1/servers/d7de8213-4471-4db7-85fa-5281594fb263 => generated 1274 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:46:44.484293 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.compute.server_external_events [req-a8a7ae55-8e57-4102-b733-acfd4404987d req-0af2ad6b-ba3d-44ef-a769-dffe9f6b9bd2 service nova] Creating event network-changed:2480c767-ef46-4401-82a3-4df91eb9e7d4 for instance d7de8213-4471-4db7-85fa-5281594fb263 on hv-cinder-75998 Feb 17 04:46:44.490454 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [req-a8a7ae55-8e57-4102-b733-acfd4404987d req-0af2ad6b-ba3d-44ef-a769-dffe9f6b9bd2 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053950 Feb 17 04:46:44.491323 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 775/1640] 10.222.0.78 () {64 vars in 1308 bytes} [Wed Feb 17 04:46:44 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:46:45.488735 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-6b7f236d-d743-4340-a4be-d50323477d80 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:46:45.489425 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-6b7f236d-d743-4340-a4be-d50323477d80 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] [instance: d7de8213-4471-4db7-85fa-5281594fb263] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:46:45.497232 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-6b7f236d-d743-4340-a4be-d50323477d80 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:46:45.497736 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-6b7f236d-d743-4340-a4be-d50323477d80 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:46:45.498569 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-6b7f236d-d743-4340-a4be-d50323477d80 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:46:45.499086 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-6b7f236d-d743-4340-a4be-d50323477d80 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:46:45.959814 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-6b7f236d-d743-4340-a4be-d50323477d80 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b5a6c15a7c4228a0f94762b8b7b4a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a3a6cbbd6d14db5bf2f631af62262de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:46:45.968754 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-6b7f236d-d743-4340-a4be-d50323477d80 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] 10.222.0.78 "GET /compute/v2.1/servers/d7de8213-4471-4db7-85fa-5281594fb263" status: 200 len: 1274 microversion: 2.1 time: 0.484445 Feb 17 04:46:45.969359 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 866/1641] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:46:45 2021] GET /compute/v2.1/servers/d7de8213-4471-4db7-85fa-5281594fb263 => generated 1274 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:46:46.989090 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-c883b25f-0e75-4750-acbd-ac305eea116c tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:46:46.989913 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-c883b25f-0e75-4750-acbd-ac305eea116c tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] [instance: d7de8213-4471-4db7-85fa-5281594fb263] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:46:46.998109 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-c883b25f-0e75-4750-acbd-ac305eea116c tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:46:46.998625 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-c883b25f-0e75-4750-acbd-ac305eea116c tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:46:46.999496 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-c883b25f-0e75-4750-acbd-ac305eea116c tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:46:46.999997 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-c883b25f-0e75-4750-acbd-ac305eea116c tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:46:47.225094 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-c883b25f-0e75-4750-acbd-ac305eea116c tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b5a6c15a7c4228a0f94762b8b7b4a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a3a6cbbd6d14db5bf2f631af62262de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:46:47.234459 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-c883b25f-0e75-4750-acbd-ac305eea116c tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] 10.222.0.78 "GET /compute/v2.1/servers/d7de8213-4471-4db7-85fa-5281594fb263" status: 200 len: 1274 microversion: 2.1 time: 0.250580 Feb 17 04:46:47.235082 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 776/1642] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:46:46 2021] GET /compute/v2.1/servers/d7de8213-4471-4db7-85fa-5281594fb263 => generated 1274 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:46:48.253303 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-58b690a9-3b97-41ab-b96f-72c17f37bb69 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:46:48.253985 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-58b690a9-3b97-41ab-b96f-72c17f37bb69 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] [instance: d7de8213-4471-4db7-85fa-5281594fb263] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:46:48.261931 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-58b690a9-3b97-41ab-b96f-72c17f37bb69 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:46:48.262446 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-58b690a9-3b97-41ab-b96f-72c17f37bb69 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:46:48.263315 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-58b690a9-3b97-41ab-b96f-72c17f37bb69 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:46:48.263817 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-58b690a9-3b97-41ab-b96f-72c17f37bb69 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:46:48.484189 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-58b690a9-3b97-41ab-b96f-72c17f37bb69 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b5a6c15a7c4228a0f94762b8b7b4a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a3a6cbbd6d14db5bf2f631af62262de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:46:48.494001 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-58b690a9-3b97-41ab-b96f-72c17f37bb69 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] 10.222.0.78 "GET /compute/v2.1/servers/d7de8213-4471-4db7-85fa-5281594fb263" status: 200 len: 1274 microversion: 2.1 time: 0.244908 Feb 17 04:46:48.494605 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 867/1643] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:46:48 2021] GET /compute/v2.1/servers/d7de8213-4471-4db7-85fa-5281594fb263 => generated 1274 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:46:49.511861 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-494d60ce-0486-4731-bb2e-ba6821984f12 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:46:49.512531 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-494d60ce-0486-4731-bb2e-ba6821984f12 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] [instance: d7de8213-4471-4db7-85fa-5281594fb263] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:46:49.521195 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-494d60ce-0486-4731-bb2e-ba6821984f12 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:46:49.521711 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-494d60ce-0486-4731-bb2e-ba6821984f12 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:46:49.522562 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-494d60ce-0486-4731-bb2e-ba6821984f12 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:46:49.523081 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-494d60ce-0486-4731-bb2e-ba6821984f12 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:46:49.734043 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-494d60ce-0486-4731-bb2e-ba6821984f12 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b5a6c15a7c4228a0f94762b8b7b4a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a3a6cbbd6d14db5bf2f631af62262de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:46:49.744105 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-494d60ce-0486-4731-bb2e-ba6821984f12 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] 10.222.0.78 "GET /compute/v2.1/servers/d7de8213-4471-4db7-85fa-5281594fb263" status: 200 len: 1274 microversion: 2.1 time: 0.236306 Feb 17 04:46:49.744710 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 777/1644] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:46:49 2021] GET /compute/v2.1/servers/d7de8213-4471-4db7-85fa-5281594fb263 => generated 1274 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:46:50.763205 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-e4a619cc-d7a4-4f91-8b6f-18024bfcf24e tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:46:50.763885 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-e4a619cc-d7a4-4f91-8b6f-18024bfcf24e tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] [instance: d7de8213-4471-4db7-85fa-5281594fb263] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:46:50.772347 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-e4a619cc-d7a4-4f91-8b6f-18024bfcf24e tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:46:50.772862 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-e4a619cc-d7a4-4f91-8b6f-18024bfcf24e tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:46:50.773701 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-e4a619cc-d7a4-4f91-8b6f-18024bfcf24e tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:46:50.774200 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-e4a619cc-d7a4-4f91-8b6f-18024bfcf24e tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:46:50.988882 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-e4a619cc-d7a4-4f91-8b6f-18024bfcf24e tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b5a6c15a7c4228a0f94762b8b7b4a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a3a6cbbd6d14db5bf2f631af62262de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:46:50.997815 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-e4a619cc-d7a4-4f91-8b6f-18024bfcf24e tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] 10.222.0.78 "GET /compute/v2.1/servers/d7de8213-4471-4db7-85fa-5281594fb263" status: 200 len: 1274 microversion: 2.1 time: 0.238744 Feb 17 04:46:50.998414 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 868/1645] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:46:50 2021] GET /compute/v2.1/servers/d7de8213-4471-4db7-85fa-5281594fb263 => generated 1274 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:46:52.016284 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-f681084a-c24e-4faa-80c0-c8035cbd20ff tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:46:52.016959 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-f681084a-c24e-4faa-80c0-c8035cbd20ff tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] [instance: d7de8213-4471-4db7-85fa-5281594fb263] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:46:52.024873 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-f681084a-c24e-4faa-80c0-c8035cbd20ff tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:46:52.025388 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-f681084a-c24e-4faa-80c0-c8035cbd20ff tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:46:52.026247 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-f681084a-c24e-4faa-80c0-c8035cbd20ff tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:46:52.026750 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-f681084a-c24e-4faa-80c0-c8035cbd20ff tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:46:52.242062 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-f681084a-c24e-4faa-80c0-c8035cbd20ff tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b5a6c15a7c4228a0f94762b8b7b4a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a3a6cbbd6d14db5bf2f631af62262de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:46:52.250958 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-f681084a-c24e-4faa-80c0-c8035cbd20ff tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] 10.222.0.78 "GET /compute/v2.1/servers/d7de8213-4471-4db7-85fa-5281594fb263" status: 200 len: 1274 microversion: 2.1 time: 0.238726 Feb 17 04:46:52.251591 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 778/1646] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:46:52 2021] GET /compute/v2.1/servers/d7de8213-4471-4db7-85fa-5281594fb263 => generated 1274 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:46:53.271627 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-9de21ab1-95e5-41e8-8b56-782f69bfefc7 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:46:53.272293 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-9de21ab1-95e5-41e8-8b56-782f69bfefc7 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] [instance: d7de8213-4471-4db7-85fa-5281594fb263] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:46:53.280109 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-9de21ab1-95e5-41e8-8b56-782f69bfefc7 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:46:53.280611 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-9de21ab1-95e5-41e8-8b56-782f69bfefc7 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:46:53.281434 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-9de21ab1-95e5-41e8-8b56-782f69bfefc7 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:46:53.281929 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-9de21ab1-95e5-41e8-8b56-782f69bfefc7 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:46:53.495546 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-9de21ab1-95e5-41e8-8b56-782f69bfefc7 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b5a6c15a7c4228a0f94762b8b7b4a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a3a6cbbd6d14db5bf2f631af62262de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:46:53.504954 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-9de21ab1-95e5-41e8-8b56-782f69bfefc7 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] 10.222.0.78 "GET /compute/v2.1/servers/d7de8213-4471-4db7-85fa-5281594fb263" status: 200 len: 1274 microversion: 2.1 time: 0.238163 Feb 17 04:46:53.505553 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 869/1647] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:46:53 2021] GET /compute/v2.1/servers/d7de8213-4471-4db7-85fa-5281594fb263 => generated 1274 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:46:54.523572 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-5e74eab1-d085-471b-aae2-1e92f79d088f tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:46:54.524241 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-5e74eab1-d085-471b-aae2-1e92f79d088f tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] [instance: d7de8213-4471-4db7-85fa-5281594fb263] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:46:54.532233 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-5e74eab1-d085-471b-aae2-1e92f79d088f tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:46:54.532735 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-5e74eab1-d085-471b-aae2-1e92f79d088f tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:46:54.533568 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-5e74eab1-d085-471b-aae2-1e92f79d088f tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:46:54.536377 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-5e74eab1-d085-471b-aae2-1e92f79d088f tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:46:54.766631 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-5e74eab1-d085-471b-aae2-1e92f79d088f tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b5a6c15a7c4228a0f94762b8b7b4a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a3a6cbbd6d14db5bf2f631af62262de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:46:54.777291 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-5e74eab1-d085-471b-aae2-1e92f79d088f tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] 10.222.0.78 "GET /compute/v2.1/servers/d7de8213-4471-4db7-85fa-5281594fb263" status: 200 len: 1274 microversion: 2.1 time: 0.257869 Feb 17 04:46:54.777850 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 779/1648] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:46:54 2021] GET /compute/v2.1/servers/d7de8213-4471-4db7-85fa-5281594fb263 => generated 1274 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:46:55.046235 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [req-ddf87024-059d-4e54-bbf6-5ffd3cda261b req-3744cad5-1853-4d9d-8e19-3aae2c46f7d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7de8213-4471-4db7-85fa-5281594fb263", "name": "network-vif-plugged", "status": "completed", "tag": "2480c767-ef46-4401-82a3-4df91eb9e7d4"}]} {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:46:55.048180 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:46:55.048180 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: warnings.warn(msg) Feb 17 04:46:55.057374 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [req-ddf87024-059d-4e54-bbf6-5ffd3cda261b req-3744cad5-1853-4d9d-8e19-3aae2c46f7d9 service nova] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:46:55.057968 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [req-ddf87024-059d-4e54-bbf6-5ffd3cda261b req-3744cad5-1853-4d9d-8e19-3aae2c46f7d9 service nova] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:46:55.075270 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.compute.server_external_events [req-ddf87024-059d-4e54-bbf6-5ffd3cda261b req-3744cad5-1853-4d9d-8e19-3aae2c46f7d9 service nova] Creating event network-vif-plugged:2480c767-ef46-4401-82a3-4df91eb9e7d4 for instance d7de8213-4471-4db7-85fa-5281594fb263 on hv-cinder-75998 Feb 17 04:46:55.078993 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: ERROR oslo.messaging._drivers.impl_rabbit [req-ddf87024-059d-4e54-bbf6-5ffd3cda261b req-3744cad5-1853-4d9d-8e19-3aae2c46f7d9 service nova] [9abf4fb4-5057-4ae8-843e-3f410f686152] AMQP server on 10.222.0.78:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Feb 17 04:46:55.796262 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-c3b79fb8-7395-45d0-be9a-37f86cbe7a04 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:46:55.797030 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-c3b79fb8-7395-45d0-be9a-37f86cbe7a04 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] [instance: d7de8213-4471-4db7-85fa-5281594fb263] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:46:55.805162 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-c3b79fb8-7395-45d0-be9a-37f86cbe7a04 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:46:55.805682 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-c3b79fb8-7395-45d0-be9a-37f86cbe7a04 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:46:55.806535 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-c3b79fb8-7395-45d0-be9a-37f86cbe7a04 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:46:55.807080 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-c3b79fb8-7395-45d0-be9a-37f86cbe7a04 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:46:56.019743 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-c3b79fb8-7395-45d0-be9a-37f86cbe7a04 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b5a6c15a7c4228a0f94762b8b7b4a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a3a6cbbd6d14db5bf2f631af62262de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:46:56.028823 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-c3b79fb8-7395-45d0-be9a-37f86cbe7a04 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] 10.222.0.78 "GET /compute/v2.1/servers/d7de8213-4471-4db7-85fa-5281594fb263" status: 200 len: 1274 microversion: 2.1 time: 0.236981 Feb 17 04:46:56.029434 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 780/1649] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:46:55 2021] GET /compute/v2.1/servers/d7de8213-4471-4db7-85fa-5281594fb263 => generated 1274 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:46:56.096061 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO oslo.messaging._drivers.impl_rabbit [req-ddf87024-059d-4e54-bbf6-5ffd3cda261b req-3744cad5-1853-4d9d-8e19-3aae2c46f7d9 service nova] [9abf4fb4-5057-4ae8-843e-3f410f686152] Reconnected to AMQP server on 10.222.0.78:5672 via [amqp] client with port 34050. Feb 17 04:46:56.099719 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [req-ddf87024-059d-4e54-bbf6-5ffd3cda261b req-3744cad5-1853-4d9d-8e19-3aae2c46f7d9 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 1.117660 Feb 17 04:46:56.100434 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 870/1650] 10.222.0.78 () {64 vars in 1308 bytes} [Wed Feb 17 04:46:54 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 1119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:46:56.776868 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 17 04:46:56.777113 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: Wed Feb 17 04:46:56 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 17 04:46:57.046699 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-37a4d60b-c6ad-4e06-b45b-c6d261cc4ed8 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:46:57.047358 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-37a4d60b-c6ad-4e06-b45b-c6d261cc4ed8 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] [instance: d7de8213-4471-4db7-85fa-5281594fb263] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:46:57.056321 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-37a4d60b-c6ad-4e06-b45b-c6d261cc4ed8 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:46:57.056829 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-37a4d60b-c6ad-4e06-b45b-c6d261cc4ed8 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:46:57.057661 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-37a4d60b-c6ad-4e06-b45b-c6d261cc4ed8 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:46:57.058151 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-37a4d60b-c6ad-4e06-b45b-c6d261cc4ed8 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:46:57.275876 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-37a4d60b-c6ad-4e06-b45b-c6d261cc4ed8 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b5a6c15a7c4228a0f94762b8b7b4a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a3a6cbbd6d14db5bf2f631af62262de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:46:57.286053 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-37a4d60b-c6ad-4e06-b45b-c6d261cc4ed8 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] 10.222.0.78 "GET /compute/v2.1/servers/d7de8213-4471-4db7-85fa-5281594fb263" status: 200 len: 1274 microversion: 2.1 time: 0.243464 Feb 17 04:46:57.286672 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 781/1651] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:46:57 2021] GET /compute/v2.1/servers/d7de8213-4471-4db7-85fa-5281594fb263 => generated 1274 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:46:58.304994 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-3982f663-2647-4ae9-983c-839f083ead37 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:46:58.305767 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-3982f663-2647-4ae9-983c-839f083ead37 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] [instance: d7de8213-4471-4db7-85fa-5281594fb263] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:46:58.313877 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-3982f663-2647-4ae9-983c-839f083ead37 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:46:58.314386 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-3982f663-2647-4ae9-983c-839f083ead37 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:46:58.316009 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-3982f663-2647-4ae9-983c-839f083ead37 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:46:58.316299 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-3982f663-2647-4ae9-983c-839f083ead37 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:46:58.538616 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-3982f663-2647-4ae9-983c-839f083ead37 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b5a6c15a7c4228a0f94762b8b7b4a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a3a6cbbd6d14db5bf2f631af62262de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:46:58.547547 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-3982f663-2647-4ae9-983c-839f083ead37 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] 10.222.0.78 "GET /compute/v2.1/servers/d7de8213-4471-4db7-85fa-5281594fb263" status: 200 len: 1462 microversion: 2.1 time: 0.247045 Feb 17 04:46:58.548147 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 871/1652] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:46:58 2021] GET /compute/v2.1/servers/d7de8213-4471-4db7-85fa-5281594fb263 => generated 1462 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:46:58.566662 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-95e73f90-ce62-4ec6-b0da-f1f09cf2ca63 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:46:58.567374 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-95e73f90-ce62-4ec6-b0da-f1f09cf2ca63 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] [instance: d7de8213-4471-4db7-85fa-5281594fb263] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:46:58.575242 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-95e73f90-ce62-4ec6-b0da-f1f09cf2ca63 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:46:58.575761 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-95e73f90-ce62-4ec6-b0da-f1f09cf2ca63 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:46:58.576615 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-95e73f90-ce62-4ec6-b0da-f1f09cf2ca63 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:46:58.577112 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-95e73f90-ce62-4ec6-b0da-f1f09cf2ca63 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:46:58.792927 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-95e73f90-ce62-4ec6-b0da-f1f09cf2ca63 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b5a6c15a7c4228a0f94762b8b7b4a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a3a6cbbd6d14db5bf2f631af62262de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:46:58.802936 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-95e73f90-ce62-4ec6-b0da-f1f09cf2ca63 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] 10.222.0.78 "GET /compute/v2.1/servers/d7de8213-4471-4db7-85fa-5281594fb263" status: 200 len: 1462 microversion: 2.1 time: 0.241353 Feb 17 04:46:58.803565 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 782/1653] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:46:58 2021] GET /compute/v2.1/servers/d7de8213-4471-4db7-85fa-5281594fb263 => generated 1462 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:46:58.821302 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-b3c7b11b-8746-4e4e-b1cb-600020b2a8ec tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Action: 'create', calling method: .version_select at 0x7f57c9429598>, body: {"pool": null} {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:47:00.888418 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-b3c7b11b-8746-4e4e-b1cb-600020b2a8ec tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] 10.222.0.78 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.070987 Feb 17 04:47:00.889078 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 872/1654] 10.222.0.78 () {60 vars in 1160 bytes} [Wed Feb 17 04:46:58 2021] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2072 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:47:00.900713 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-ab4c25c1-b65b-4ccf-a7b5-eb102c3f4182 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.27.1.159"}} {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:47:00.901932 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-ab4c25c1-b65b-4ccf-a7b5-eb102c3f4182 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] [instance: d7de8213-4471-4db7-85fa-5281594fb263] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:47:00.910271 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-ab4c25c1-b65b-4ccf-a7b5-eb102c3f4182 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:47:00.910785 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-ab4c25c1-b65b-4ccf-a7b5-eb102c3f4182 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:47:00.911667 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-ab4c25c1-b65b-4ccf-a7b5-eb102c3f4182 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:47:00.912168 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-ab4c25c1-b65b-4ccf-a7b5-eb102c3f4182 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:47:00.976652 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-ab4c25c1-b65b-4ccf-a7b5-eb102c3f4182 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Acquired lock "refresh_cache-d7de8213-4471-4db7-85fa-5281594fb263" {{(pid=98178) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:266}} Feb 17 04:47:02.960587 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.network.neutron [None req-ab4c25c1-b65b-4ccf-a7b5-eb102c3f4182 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] [instance: d7de8213-4471-4db7-85fa-5281594fb263] Building network info cache for instance {{(pid=98178) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1836}} Feb 17 04:47:02.966562 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: ERROR oslo.messaging._drivers.impl_rabbit [-] [5a9ab647-45d8-4916-a9a5-b6477356342d] AMQP server on 10.222.0.78:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Feb 17 04:47:02.970371 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [req-d839a4d7-fe5c-4602-b6e3-8d150d0bdc4e req-775e3538-1040-4fd4-b73e-f997c0426c8e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d7de8213-4471-4db7-85fa-5281594fb263", "tag": "2480c767-ef46-4401-82a3-4df91eb9e7d4"}]} {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:47:02.972778 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:47:02.972778 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: warnings.warn(msg) Feb 17 04:47:02.983319 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [req-d839a4d7-fe5c-4602-b6e3-8d150d0bdc4e req-775e3538-1040-4fd4-b73e-f997c0426c8e service nova] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:47:02.983937 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [req-d839a4d7-fe5c-4602-b6e3-8d150d0bdc4e req-775e3538-1040-4fd4-b73e-f997c0426c8e service nova] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:47:03.002040 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.compute.server_external_events [req-d839a4d7-fe5c-4602-b6e3-8d150d0bdc4e req-775e3538-1040-4fd4-b73e-f997c0426c8e service nova] Creating event network-changed:2480c767-ef46-4401-82a3-4df91eb9e7d4 for instance d7de8213-4471-4db7-85fa-5281594fb263 on hv-cinder-75998 Feb 17 04:47:03.008604 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [req-d839a4d7-fe5c-4602-b6e3-8d150d0bdc4e req-775e3538-1040-4fd4-b73e-f997c0426c8e service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043325 Feb 17 04:47:03.009493 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 873/1655] 10.222.0.78 () {64 vars in 1308 bytes} [Wed Feb 17 04:47:02 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:47:04.823269 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.network.neutron [None req-ab4c25c1-b65b-4ccf-a7b5-eb102c3f4182 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] [instance: d7de8213-4471-4db7-85fa-5281594fb263] Updating instance_info_cache with network_info: [{"id": "2480c767-ef46-4401-82a3-4df91eb9e7d4", "address": "fa:16:3e:08:79:a4", "network": {"id": "f6965ef8-6afe-410e-82fc-d80ca8d91ef7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1360287644-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.27.1.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "9a3a6cbbd6d14db5bf2f631af62262de", "mtu": 1450, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, "devname": "tap2480c767-ef", "ovs_interfaceid": "2480c767-ef46-4401-82a3-4df91eb9e7d4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "meta": {}}] {{(pid=98178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Feb 17 04:47:04.834495 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-ab4c25c1-b65b-4ccf-a7b5-eb102c3f4182 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Releasing lock "refresh_cache-d7de8213-4471-4db7-85fa-5281594fb263" {{(pid=98178) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:282}} Feb 17 04:47:04.835454 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-ab4c25c1-b65b-4ccf-a7b5-eb102c3f4182 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] 10.222.0.78 "POST /compute/v2.1/servers/d7de8213-4471-4db7-85fa-5281594fb263/action" status: 202 len: 0 microversion: 2.1 time: 3.938770 Feb 17 04:47:04.836288 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 783/1656] 10.222.0.78 () {60 vars in 1268 bytes} [Wed Feb 17 04:47:00 2021] POST /compute/v2.1/servers/d7de8213-4471-4db7-85fa-5281594fb263/action => generated 0 bytes in 3940 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Feb 17 04:48:26.926315 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 17 04:48:26.926995 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: Wed Feb 17 04:48:26 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 17 04:49:03.867024 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-3d8d7917-e323-4c76-af18-b5bfad4a323b tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-169182931", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1695173271", "security_groups": [{"name": "tempest-TestVolumeBootPattern-2120696101"}], "block_device_mapping_v2": [{"uuid": "7265d0f9-28c6-4b88-99c9-8de220cbb1ea", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "f6965ef8-6afe-410e-82fc-d80ca8d91ef7"}]}} {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:49:03.912671 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO oslo.messaging._drivers.impl_rabbit [-] [5a9ab647-45d8-4916-a9a5-b6477356342d] Reconnected to AMQP server on 10.222.0.78:5672 via [amqp] client with port 34138. Feb 17 04:49:04.110443 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.network.neutron [None req-3d8d7917-e323-4c76-af18-b5bfad4a323b tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] validate_networks() for [('f6965ef8-6afe-410e-82fc-d80ca8d91ef7', None, None, None)] {{(pid=98179) validate_networks /opt/stack/nova/nova/network/neutron.py:2345}} Feb 17 04:49:04.742975 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.virt.hardware [None req-3d8d7917-e323-4c76-af18-b5bfad4a323b tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Flavor limits 0:0:0 {{(pid=98179) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 17 04:49:04.743516 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.virt.hardware [None req-3d8d7917-e323-4c76-af18-b5bfad4a323b tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Image limits 0:0:0 {{(pid=98179) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Feb 17 04:49:04.744069 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.virt.hardware [None req-3d8d7917-e323-4c76-af18-b5bfad4a323b tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Flavor pref 0:0:0 {{(pid=98179) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 17 04:49:04.744590 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.virt.hardware [None req-3d8d7917-e323-4c76-af18-b5bfad4a323b tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Image pref 0:0:0 {{(pid=98179) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Feb 17 04:49:04.745063 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.virt.hardware [None req-3d8d7917-e323-4c76-af18-b5bfad4a323b tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98179) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Feb 17 04:49:04.754670 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-3d8d7917-e323-4c76-af18-b5bfad4a323b tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:49:04.755235 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-3d8d7917-e323-4c76-af18-b5bfad4a323b tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:49:04.756124 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-3d8d7917-e323-4c76-af18-b5bfad4a323b tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:49:04.756630 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-3d8d7917-e323-4c76-af18-b5bfad4a323b tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:49:04.775898 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.quota [None req-3d8d7917-e323-4c76-af18-b5bfad4a323b tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Getting quotas for project 9a3a6cbbd6d14db5bf2f631af62262de. Resources: {'ram', 'cores', 'instances'} {{(pid=98179) _get_quotas /opt/stack/nova/nova/quota.py:388}} Feb 17 04:49:04.780206 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.quota [None req-3d8d7917-e323-4c76-af18-b5bfad4a323b tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Getting quotas for user f5b5a6c15a7c4228a0f94762b8b7b4a5 and project 9a3a6cbbd6d14db5bf2f631af62262de. Resources: {'ram', 'cores', 'instances'} {{(pid=98179) _get_quotas /opt/stack/nova/nova/quota.py:380}} Feb 17 04:49:04.886088 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-3d8d7917-e323-4c76-af18-b5bfad4a323b tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Going to run 1 instances... {{(pid=98179) _provision_instances /opt/stack/nova/nova/compute/api.py:1264}} Feb 17 04:49:04.888644 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-3d8d7917-e323-4c76-af18-b5bfad4a323b tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] [instance: b6686a99-4b41-4cf6-8ff1-e629873aa237] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='7265d0f9-28c6-4b88-99c9-8de220cbb1ea',volume_size=None,volume_type=None)] {{(pid=98179) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1666}} Feb 17 04:49:05.069827 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-3d8d7917-e323-4c76-af18-b5bfad4a323b tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 413 microversion: 2.1 time: 1.207208 Feb 17 04:49:05.070543 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 874/1657] 10.222.0.78 () {60 vars in 1137 bytes} [Wed Feb 17 04:49:03 2021] POST /compute/v2.1/servers => generated 413 bytes in 1209 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 17 04:49:05.081722 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-f0a6127f-88d9-4794-bc2f-e24063cd428a tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:49:05.082407 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-f0a6127f-88d9-4794-bc2f-e24063cd428a tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] [instance: b6686a99-4b41-4cf6-8ff1-e629873aa237] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:49:05.227665 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-f0a6127f-88d9-4794-bc2f-e24063cd428a tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b5a6c15a7c4228a0f94762b8b7b4a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a3a6cbbd6d14db5bf2f631af62262de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:49:05.235712 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-f0a6127f-88d9-4794-bc2f-e24063cd428a tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] 10.222.0.78 "GET /compute/v2.1/servers/b6686a99-4b41-4cf6-8ff1-e629873aa237" status: 200 len: 1094 microversion: 2.1 time: 0.158398 Feb 17 04:49:05.236985 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 784/1658] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:49:05 2021] GET /compute/v2.1/servers/b6686a99-4b41-4cf6-8ff1-e629873aa237 => generated 1094 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:49:06.255404 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-7da7ba0a-bbda-452f-8f28-007d67a5a435 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:49:06.256964 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-7da7ba0a-bbda-452f-8f28-007d67a5a435 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] [instance: b6686a99-4b41-4cf6-8ff1-e629873aa237] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:49:06.266759 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-7da7ba0a-bbda-452f-8f28-007d67a5a435 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:49:06.267338 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-7da7ba0a-bbda-452f-8f28-007d67a5a435 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:49:06.268792 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-7da7ba0a-bbda-452f-8f28-007d67a5a435 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:49:06.269480 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-7da7ba0a-bbda-452f-8f28-007d67a5a435 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:49:06.405110 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-7da7ba0a-bbda-452f-8f28-007d67a5a435 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b5a6c15a7c4228a0f94762b8b7b4a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a3a6cbbd6d14db5bf2f631af62262de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:49:06.414779 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-7da7ba0a-bbda-452f-8f28-007d67a5a435 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] 10.222.0.78 "GET /compute/v2.1/servers/b6686a99-4b41-4cf6-8ff1-e629873aa237" status: 200 len: 1200 microversion: 2.1 time: 0.164489 Feb 17 04:49:06.415659 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 875/1659] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:49:06 2021] GET /compute/v2.1/servers/b6686a99-4b41-4cf6-8ff1-e629873aa237 => generated 1200 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:49:07.434053 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-e0d1b864-19a0-448e-9618-9c04bdf29ecd tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:49:07.434726 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-e0d1b864-19a0-448e-9618-9c04bdf29ecd tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] [instance: b6686a99-4b41-4cf6-8ff1-e629873aa237] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:49:07.444378 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-e0d1b864-19a0-448e-9618-9c04bdf29ecd tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:49:07.444890 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-e0d1b864-19a0-448e-9618-9c04bdf29ecd tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:49:07.445741 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-e0d1b864-19a0-448e-9618-9c04bdf29ecd tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:49:07.446237 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-e0d1b864-19a0-448e-9618-9c04bdf29ecd tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:49:07.942940 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-e0d1b864-19a0-448e-9618-9c04bdf29ecd tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b5a6c15a7c4228a0f94762b8b7b4a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a3a6cbbd6d14db5bf2f631af62262de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:49:07.957624 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-e0d1b864-19a0-448e-9618-9c04bdf29ecd tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] 10.222.0.78 "GET /compute/v2.1/servers/b6686a99-4b41-4cf6-8ff1-e629873aa237" status: 200 len: 1273 microversion: 2.1 time: 0.527427 Feb 17 04:49:07.958344 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 785/1660] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:49:07 2021] GET /compute/v2.1/servers/b6686a99-4b41-4cf6-8ff1-e629873aa237 => generated 1273 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:49:08.976490 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-e7bde9b2-aabe-4f82-a8a2-b7bde3303a87 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:49:08.978670 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-e7bde9b2-aabe-4f82-a8a2-b7bde3303a87 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] [instance: b6686a99-4b41-4cf6-8ff1-e629873aa237] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:49:08.987402 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-e7bde9b2-aabe-4f82-a8a2-b7bde3303a87 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:49:08.988047 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-e7bde9b2-aabe-4f82-a8a2-b7bde3303a87 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:49:08.988888 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-e7bde9b2-aabe-4f82-a8a2-b7bde3303a87 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:49:08.989380 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-e7bde9b2-aabe-4f82-a8a2-b7bde3303a87 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:49:09.210958 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-e7bde9b2-aabe-4f82-a8a2-b7bde3303a87 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b5a6c15a7c4228a0f94762b8b7b4a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a3a6cbbd6d14db5bf2f631af62262de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:49:09.219893 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-e7bde9b2-aabe-4f82-a8a2-b7bde3303a87 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] 10.222.0.78 "GET /compute/v2.1/servers/b6686a99-4b41-4cf6-8ff1-e629873aa237" status: 200 len: 1273 microversion: 2.1 time: 0.247343 Feb 17 04:49:09.220542 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 876/1661] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:49:08 2021] GET /compute/v2.1/servers/b6686a99-4b41-4cf6-8ff1-e629873aa237 => generated 1273 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:49:09.311384 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [req-80509dc7-8232-4df6-ae1b-3c36f1cb6292 req-f83a3651-822a-4eb0-8919-80bc05bce52e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b6686a99-4b41-4cf6-8ff1-e629873aa237", "tag": "d69d10d7-eabf-4be7-a0bb-db6bcbde9af7"}]} {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:49:09.314824 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:49:09.314824 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: warnings.warn(msg) Feb 17 04:49:09.324793 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [req-80509dc7-8232-4df6-ae1b-3c36f1cb6292 req-f83a3651-822a-4eb0-8919-80bc05bce52e service nova] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:49:09.325290 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [req-80509dc7-8232-4df6-ae1b-3c36f1cb6292 req-f83a3651-822a-4eb0-8919-80bc05bce52e service nova] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:49:09.345756 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.compute.server_external_events [req-80509dc7-8232-4df6-ae1b-3c36f1cb6292 req-f83a3651-822a-4eb0-8919-80bc05bce52e service nova] Creating event network-changed:d69d10d7-eabf-4be7-a0bb-db6bcbde9af7 for instance b6686a99-4b41-4cf6-8ff1-e629873aa237 on hv-cinder-75998 Feb 17 04:49:09.351441 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [req-80509dc7-8232-4df6-ae1b-3c36f1cb6292 req-f83a3651-822a-4eb0-8919-80bc05bce52e service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043935 Feb 17 04:49:09.352386 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 786/1662] 10.222.0.78 () {64 vars in 1308 bytes} [Wed Feb 17 04:49:09 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:49:10.238415 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-4d2472ae-8d37-4826-8b15-b21eb99353d1 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:49:10.239105 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-4d2472ae-8d37-4826-8b15-b21eb99353d1 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] [instance: b6686a99-4b41-4cf6-8ff1-e629873aa237] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:49:10.247300 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-4d2472ae-8d37-4826-8b15-b21eb99353d1 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:49:10.247742 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-4d2472ae-8d37-4826-8b15-b21eb99353d1 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:49:10.248576 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-4d2472ae-8d37-4826-8b15-b21eb99353d1 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:49:10.249063 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-4d2472ae-8d37-4826-8b15-b21eb99353d1 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:49:10.461760 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-4d2472ae-8d37-4826-8b15-b21eb99353d1 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b5a6c15a7c4228a0f94762b8b7b4a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a3a6cbbd6d14db5bf2f631af62262de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:49:10.471395 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-4d2472ae-8d37-4826-8b15-b21eb99353d1 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] 10.222.0.78 "GET /compute/v2.1/servers/b6686a99-4b41-4cf6-8ff1-e629873aa237" status: 200 len: 1273 microversion: 2.1 time: 0.237288 Feb 17 04:49:10.472007 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 877/1663] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:49:10 2021] GET /compute/v2.1/servers/b6686a99-4b41-4cf6-8ff1-e629873aa237 => generated 1273 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:49:11.491355 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-5ea14681-f994-467b-a744-92d3cd1cf1b4 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:49:11.492163 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-5ea14681-f994-467b-a744-92d3cd1cf1b4 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] [instance: b6686a99-4b41-4cf6-8ff1-e629873aa237] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:49:11.500330 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-5ea14681-f994-467b-a744-92d3cd1cf1b4 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:49:11.500837 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-5ea14681-f994-467b-a744-92d3cd1cf1b4 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:49:11.501759 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-5ea14681-f994-467b-a744-92d3cd1cf1b4 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:49:11.502259 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-5ea14681-f994-467b-a744-92d3cd1cf1b4 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:49:11.733648 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-5ea14681-f994-467b-a744-92d3cd1cf1b4 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b5a6c15a7c4228a0f94762b8b7b4a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a3a6cbbd6d14db5bf2f631af62262de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:49:11.742483 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-5ea14681-f994-467b-a744-92d3cd1cf1b4 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] 10.222.0.78 "GET /compute/v2.1/servers/b6686a99-4b41-4cf6-8ff1-e629873aa237" status: 200 len: 1273 microversion: 2.1 time: 0.256496 Feb 17 04:49:11.743097 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 787/1664] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:49:11 2021] GET /compute/v2.1/servers/b6686a99-4b41-4cf6-8ff1-e629873aa237 => generated 1273 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:49:12.760119 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-8a99ac4f-c859-472c-a67f-6632696ff48f tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:49:12.760788 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-8a99ac4f-c859-472c-a67f-6632696ff48f tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] [instance: b6686a99-4b41-4cf6-8ff1-e629873aa237] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:49:12.769528 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-8a99ac4f-c859-472c-a67f-6632696ff48f tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:49:12.770036 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-8a99ac4f-c859-472c-a67f-6632696ff48f tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:49:12.770868 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-8a99ac4f-c859-472c-a67f-6632696ff48f tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:49:12.771386 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-8a99ac4f-c859-472c-a67f-6632696ff48f tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:49:12.987360 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-8a99ac4f-c859-472c-a67f-6632696ff48f tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b5a6c15a7c4228a0f94762b8b7b4a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a3a6cbbd6d14db5bf2f631af62262de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:49:12.996251 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-8a99ac4f-c859-472c-a67f-6632696ff48f tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] 10.222.0.78 "GET /compute/v2.1/servers/b6686a99-4b41-4cf6-8ff1-e629873aa237" status: 200 len: 1273 microversion: 2.1 time: 0.240288 Feb 17 04:49:12.996848 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 878/1665] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:49:12 2021] GET /compute/v2.1/servers/b6686a99-4b41-4cf6-8ff1-e629873aa237 => generated 1273 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:49:14.015812 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-9ecbd68d-29fc-4298-b806-cad4c935c649 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:49:14.016483 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-9ecbd68d-29fc-4298-b806-cad4c935c649 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] [instance: b6686a99-4b41-4cf6-8ff1-e629873aa237] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:49:14.025051 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-9ecbd68d-29fc-4298-b806-cad4c935c649 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:49:14.025563 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-9ecbd68d-29fc-4298-b806-cad4c935c649 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:49:14.026406 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-9ecbd68d-29fc-4298-b806-cad4c935c649 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:49:14.026902 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-9ecbd68d-29fc-4298-b806-cad4c935c649 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:49:14.244706 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-9ecbd68d-29fc-4298-b806-cad4c935c649 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b5a6c15a7c4228a0f94762b8b7b4a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a3a6cbbd6d14db5bf2f631af62262de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:49:14.253802 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-9ecbd68d-29fc-4298-b806-cad4c935c649 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] 10.222.0.78 "GET /compute/v2.1/servers/b6686a99-4b41-4cf6-8ff1-e629873aa237" status: 200 len: 1273 microversion: 2.1 time: 0.242000 Feb 17 04:49:14.254406 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 788/1666] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:49:14 2021] GET /compute/v2.1/servers/b6686a99-4b41-4cf6-8ff1-e629873aa237 => generated 1273 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:49:15.271942 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-3c33f262-23c0-466c-a560-30387f5aa638 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:49:15.272603 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-3c33f262-23c0-466c-a560-30387f5aa638 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] [instance: b6686a99-4b41-4cf6-8ff1-e629873aa237] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:49:15.280507 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-3c33f262-23c0-466c-a560-30387f5aa638 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:49:15.281009 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-3c33f262-23c0-466c-a560-30387f5aa638 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:49:15.281827 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-3c33f262-23c0-466c-a560-30387f5aa638 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:49:15.282312 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-3c33f262-23c0-466c-a560-30387f5aa638 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:49:15.496793 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-3c33f262-23c0-466c-a560-30387f5aa638 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b5a6c15a7c4228a0f94762b8b7b4a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a3a6cbbd6d14db5bf2f631af62262de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:49:15.506005 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-3c33f262-23c0-466c-a560-30387f5aa638 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] 10.222.0.78 "GET /compute/v2.1/servers/b6686a99-4b41-4cf6-8ff1-e629873aa237" status: 200 len: 1273 microversion: 2.1 time: 0.238123 Feb 17 04:49:15.506602 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 879/1667] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:49:15 2021] GET /compute/v2.1/servers/b6686a99-4b41-4cf6-8ff1-e629873aa237 => generated 1273 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:49:16.524958 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-ff640ed2-a2d0-497b-abd6-5825036e2fd4 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:49:16.525633 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-ff640ed2-a2d0-497b-abd6-5825036e2fd4 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] [instance: b6686a99-4b41-4cf6-8ff1-e629873aa237] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:49:16.534591 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-ff640ed2-a2d0-497b-abd6-5825036e2fd4 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:49:16.535125 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-ff640ed2-a2d0-497b-abd6-5825036e2fd4 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:49:16.536034 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-ff640ed2-a2d0-497b-abd6-5825036e2fd4 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:49:16.536582 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-ff640ed2-a2d0-497b-abd6-5825036e2fd4 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:49:16.746132 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-ff640ed2-a2d0-497b-abd6-5825036e2fd4 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b5a6c15a7c4228a0f94762b8b7b4a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a3a6cbbd6d14db5bf2f631af62262de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:49:16.756033 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-ff640ed2-a2d0-497b-abd6-5825036e2fd4 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] 10.222.0.78 "GET /compute/v2.1/servers/b6686a99-4b41-4cf6-8ff1-e629873aa237" status: 200 len: 1273 microversion: 2.1 time: 0.235107 Feb 17 04:49:16.756639 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 789/1668] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:49:16 2021] GET /compute/v2.1/servers/b6686a99-4b41-4cf6-8ff1-e629873aa237 => generated 1273 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:49:17.774220 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-a16be371-1e81-477e-bb51-0ce12f194749 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:49:17.774900 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-a16be371-1e81-477e-bb51-0ce12f194749 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] [instance: b6686a99-4b41-4cf6-8ff1-e629873aa237] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:49:17.782790 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-a16be371-1e81-477e-bb51-0ce12f194749 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:49:17.783373 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-a16be371-1e81-477e-bb51-0ce12f194749 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:49:17.784215 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-a16be371-1e81-477e-bb51-0ce12f194749 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:49:17.784713 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-a16be371-1e81-477e-bb51-0ce12f194749 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:49:17.998789 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-a16be371-1e81-477e-bb51-0ce12f194749 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b5a6c15a7c4228a0f94762b8b7b4a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a3a6cbbd6d14db5bf2f631af62262de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:49:18.008610 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-a16be371-1e81-477e-bb51-0ce12f194749 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] 10.222.0.78 "GET /compute/v2.1/servers/b6686a99-4b41-4cf6-8ff1-e629873aa237" status: 200 len: 1273 microversion: 2.1 time: 0.238385 Feb 17 04:49:18.009217 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 880/1669] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:49:17 2021] GET /compute/v2.1/servers/b6686a99-4b41-4cf6-8ff1-e629873aa237 => generated 1273 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:49:19.027112 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-1c928dba-e10f-4ca2-b691-b354173d68ad tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:49:19.027704 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-1c928dba-e10f-4ca2-b691-b354173d68ad tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] [instance: b6686a99-4b41-4cf6-8ff1-e629873aa237] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:49:19.035627 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-1c928dba-e10f-4ca2-b691-b354173d68ad tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:49:19.036146 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-1c928dba-e10f-4ca2-b691-b354173d68ad tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:49:19.036991 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-1c928dba-e10f-4ca2-b691-b354173d68ad tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:49:19.037534 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-1c928dba-e10f-4ca2-b691-b354173d68ad tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:49:19.255277 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-1c928dba-e10f-4ca2-b691-b354173d68ad tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b5a6c15a7c4228a0f94762b8b7b4a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a3a6cbbd6d14db5bf2f631af62262de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:49:19.264067 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-1c928dba-e10f-4ca2-b691-b354173d68ad tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] 10.222.0.78 "GET /compute/v2.1/servers/b6686a99-4b41-4cf6-8ff1-e629873aa237" status: 200 len: 1273 microversion: 2.1 time: 0.241088 Feb 17 04:49:19.264666 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 790/1670] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:49:19 2021] GET /compute/v2.1/servers/b6686a99-4b41-4cf6-8ff1-e629873aa237 => generated 1273 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:49:20.282192 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-0fbd711c-5590-4f57-81be-9311603fe473 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:49:20.282864 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-0fbd711c-5590-4f57-81be-9311603fe473 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] [instance: b6686a99-4b41-4cf6-8ff1-e629873aa237] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:49:20.291717 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-0fbd711c-5590-4f57-81be-9311603fe473 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:49:20.292349 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-0fbd711c-5590-4f57-81be-9311603fe473 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:49:20.293253 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-0fbd711c-5590-4f57-81be-9311603fe473 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:49:20.293753 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-0fbd711c-5590-4f57-81be-9311603fe473 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:49:20.432260 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [req-19cc09ca-02db-45e9-b321-ccced49448b4 req-f8531ca8-7022-4873-94f3-050b73245488 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b6686a99-4b41-4cf6-8ff1-e629873aa237", "name": "network-vif-plugged", "status": "completed", "tag": "d69d10d7-eabf-4be7-a0bb-db6bcbde9af7"}]} {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:49:20.434140 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:49:20.434140 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: warnings.warn(msg) Feb 17 04:49:20.445277 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [req-19cc09ca-02db-45e9-b321-ccced49448b4 req-f8531ca8-7022-4873-94f3-050b73245488 service nova] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:49:20.445773 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [req-19cc09ca-02db-45e9-b321-ccced49448b4 req-f8531ca8-7022-4873-94f3-050b73245488 service nova] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:49:20.463608 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.compute.server_external_events [req-19cc09ca-02db-45e9-b321-ccced49448b4 req-f8531ca8-7022-4873-94f3-050b73245488 service nova] Creating event network-vif-plugged:d69d10d7-eabf-4be7-a0bb-db6bcbde9af7 for instance b6686a99-4b41-4cf6-8ff1-e629873aa237 on hv-cinder-75998 Feb 17 04:49:20.468844 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [req-19cc09ca-02db-45e9-b321-ccced49448b4 req-f8531ca8-7022-4873-94f3-050b73245488 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041602 Feb 17 04:49:20.469666 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 791/1671] 10.222.0.78 () {64 vars in 1308 bytes} [Wed Feb 17 04:49:20 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 17 04:49:20.517219 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-0fbd711c-5590-4f57-81be-9311603fe473 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b5a6c15a7c4228a0f94762b8b7b4a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a3a6cbbd6d14db5bf2f631af62262de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:49:20.526484 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-0fbd711c-5590-4f57-81be-9311603fe473 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] 10.222.0.78 "GET /compute/v2.1/servers/b6686a99-4b41-4cf6-8ff1-e629873aa237" status: 200 len: 1273 microversion: 2.1 time: 0.248312 Feb 17 04:49:20.537656 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 881/1672] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:49:20 2021] GET /compute/v2.1/servers/b6686a99-4b41-4cf6-8ff1-e629873aa237 => generated 1273 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:49:21.546380 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-3a2d7c71-670d-41fe-854b-d2c88f518843 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:49:21.547178 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-3a2d7c71-670d-41fe-854b-d2c88f518843 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] [instance: b6686a99-4b41-4cf6-8ff1-e629873aa237] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:49:21.556011 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-3a2d7c71-670d-41fe-854b-d2c88f518843 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:49:21.556525 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-3a2d7c71-670d-41fe-854b-d2c88f518843 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:49:21.557369 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-3a2d7c71-670d-41fe-854b-d2c88f518843 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:49:21.557865 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-3a2d7c71-670d-41fe-854b-d2c88f518843 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:49:21.770514 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-3a2d7c71-670d-41fe-854b-d2c88f518843 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b5a6c15a7c4228a0f94762b8b7b4a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a3a6cbbd6d14db5bf2f631af62262de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:49:21.779764 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-3a2d7c71-670d-41fe-854b-d2c88f518843 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] 10.222.0.78 "GET /compute/v2.1/servers/b6686a99-4b41-4cf6-8ff1-e629873aa237" status: 200 len: 1273 microversion: 2.1 time: 0.237825 Feb 17 04:49:21.780386 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 792/1673] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:49:21 2021] GET /compute/v2.1/servers/b6686a99-4b41-4cf6-8ff1-e629873aa237 => generated 1273 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:49:22.798575 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-00166efc-64f3-413e-ad0c-3c95a0968c98 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:49:22.799398 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-00166efc-64f3-413e-ad0c-3c95a0968c98 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] [instance: b6686a99-4b41-4cf6-8ff1-e629873aa237] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:49:22.807290 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-00166efc-64f3-413e-ad0c-3c95a0968c98 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:49:22.807809 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-00166efc-64f3-413e-ad0c-3c95a0968c98 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:49:22.808655 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-00166efc-64f3-413e-ad0c-3c95a0968c98 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:49:22.809153 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-00166efc-64f3-413e-ad0c-3c95a0968c98 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:49:23.029089 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-00166efc-64f3-413e-ad0c-3c95a0968c98 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b5a6c15a7c4228a0f94762b8b7b4a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a3a6cbbd6d14db5bf2f631af62262de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:49:23.038182 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-00166efc-64f3-413e-ad0c-3c95a0968c98 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] 10.222.0.78 "GET /compute/v2.1/servers/b6686a99-4b41-4cf6-8ff1-e629873aa237" status: 200 len: 1461 microversion: 2.1 time: 0.244158 Feb 17 04:49:23.038786 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 882/1674] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:49:22 2021] GET /compute/v2.1/servers/b6686a99-4b41-4cf6-8ff1-e629873aa237 => generated 1461 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:49:23.056523 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-0016f2a4-4703-4a7a-ad59-ab40ba69ae30 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:49:23.057149 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-0016f2a4-4703-4a7a-ad59-ab40ba69ae30 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] [instance: b6686a99-4b41-4cf6-8ff1-e629873aa237] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:49:23.065705 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-0016f2a4-4703-4a7a-ad59-ab40ba69ae30 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:49:23.066218 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-0016f2a4-4703-4a7a-ad59-ab40ba69ae30 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:49:23.067112 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-0016f2a4-4703-4a7a-ad59-ab40ba69ae30 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:49:23.067617 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-0016f2a4-4703-4a7a-ad59-ab40ba69ae30 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:49:23.289295 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-0016f2a4-4703-4a7a-ad59-ab40ba69ae30 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b5a6c15a7c4228a0f94762b8b7b4a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a3a6cbbd6d14db5bf2f631af62262de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:49:23.298076 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-0016f2a4-4703-4a7a-ad59-ab40ba69ae30 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] 10.222.0.78 "GET /compute/v2.1/servers/b6686a99-4b41-4cf6-8ff1-e629873aa237" status: 200 len: 1461 microversion: 2.1 time: 0.245577 Feb 17 04:49:23.298727 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 793/1675] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:49:23 2021] GET /compute/v2.1/servers/b6686a99-4b41-4cf6-8ff1-e629873aa237 => generated 1461 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:49:23.316669 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-fcab9005-4bed-467d-b46b-e97571857887 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Action: 'create', calling method: .version_select at 0x7f57c94296a8>, body: {"pool": null} {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:49:25.614792 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-fcab9005-4bed-467d-b46b-e97571857887 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] 10.222.0.78 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.302706 Feb 17 04:49:25.615509 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 883/1676] 10.222.0.78 () {60 vars in 1160 bytes} [Wed Feb 17 04:49:23 2021] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2304 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:49:25.627876 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-7d724cbe-6c8f-47f0-92b2-2a4243a3d3ab tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.27.1.251"}} {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:49:25.629109 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-7d724cbe-6c8f-47f0-92b2-2a4243a3d3ab tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] [instance: b6686a99-4b41-4cf6-8ff1-e629873aa237] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:49:25.636970 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-7d724cbe-6c8f-47f0-92b2-2a4243a3d3ab tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:49:25.637472 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-7d724cbe-6c8f-47f0-92b2-2a4243a3d3ab tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:49:25.638300 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-7d724cbe-6c8f-47f0-92b2-2a4243a3d3ab tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:49:25.638788 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-7d724cbe-6c8f-47f0-92b2-2a4243a3d3ab tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:49:25.707218 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-7d724cbe-6c8f-47f0-92b2-2a4243a3d3ab tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Acquired lock "refresh_cache-b6686a99-4b41-4cf6-8ff1-e629873aa237" {{(pid=98178) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:266}} Feb 17 04:49:27.444687 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.network.neutron [None req-7d724cbe-6c8f-47f0-92b2-2a4243a3d3ab tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] [instance: b6686a99-4b41-4cf6-8ff1-e629873aa237] Building network info cache for instance {{(pid=98178) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1836}} Feb 17 04:49:27.453639 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [req-3669a3e3-1098-4142-81ba-22166545ad08 req-3f6afd73-cac9-46b0-adb0-563f207c7267 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b6686a99-4b41-4cf6-8ff1-e629873aa237", "tag": "d69d10d7-eabf-4be7-a0bb-db6bcbde9af7"}]} {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:49:27.456001 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:49:27.456001 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: warnings.warn(msg) Feb 17 04:49:27.465625 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [req-3669a3e3-1098-4142-81ba-22166545ad08 req-3f6afd73-cac9-46b0-adb0-563f207c7267 service nova] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:49:27.466459 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [req-3669a3e3-1098-4142-81ba-22166545ad08 req-3f6afd73-cac9-46b0-adb0-563f207c7267 service nova] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:49:27.484415 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.compute.server_external_events [req-3669a3e3-1098-4142-81ba-22166545ad08 req-3f6afd73-cac9-46b0-adb0-563f207c7267 service nova] Creating event network-changed:d69d10d7-eabf-4be7-a0bb-db6bcbde9af7 for instance b6686a99-4b41-4cf6-8ff1-e629873aa237 on hv-cinder-75998 Feb 17 04:49:27.491221 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [req-3669a3e3-1098-4142-81ba-22166545ad08 req-3f6afd73-cac9-46b0-adb0-563f207c7267 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041426 Feb 17 04:49:27.492192 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 884/1677] 10.222.0.78 () {64 vars in 1308 bytes} [Wed Feb 17 04:49:27 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 17 04:49:29.066411 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.network.neutron [None req-7d724cbe-6c8f-47f0-92b2-2a4243a3d3ab tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] [instance: b6686a99-4b41-4cf6-8ff1-e629873aa237] Updating instance_info_cache with network_info: [{"id": "d69d10d7-eabf-4be7-a0bb-db6bcbde9af7", "address": "fa:16:3e:2f:52:7a", "network": {"id": "f6965ef8-6afe-410e-82fc-d80ca8d91ef7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1360287644-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.27.1.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "9a3a6cbbd6d14db5bf2f631af62262de", "mtu": 1450, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, "devname": "tapd69d10d7-ea", "ovs_interfaceid": "d69d10d7-eabf-4be7-a0bb-db6bcbde9af7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "meta": {}}] {{(pid=98178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Feb 17 04:49:29.082011 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-7d724cbe-6c8f-47f0-92b2-2a4243a3d3ab tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Releasing lock "refresh_cache-b6686a99-4b41-4cf6-8ff1-e629873aa237" {{(pid=98178) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:282}} Feb 17 04:49:29.083390 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-7d724cbe-6c8f-47f0-92b2-2a4243a3d3ab tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] 10.222.0.78 "POST /compute/v2.1/servers/b6686a99-4b41-4cf6-8ff1-e629873aa237/action" status: 202 len: 0 microversion: 2.1 time: 3.460344 Feb 17 04:49:29.084334 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 794/1678] 10.222.0.78 () {60 vars in 1268 bytes} [Wed Feb 17 04:49:25 2021] POST /compute/v2.1/servers/b6686a99-4b41-4cf6-8ff1-e629873aa237/action => generated 0 bytes in 3462 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Feb 17 04:49:50.759067 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 17 04:49:50.759655 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: Wed Feb 17 04:49:50 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 17 04:50:16.796645 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 17 04:50:16.797233 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: Wed Feb 17 04:50:16 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 17 04:51:17.101100 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: ERROR oslo.messaging._drivers.impl_rabbit [-] [5a9ab647-45d8-4916-a9a5-b6477356342d] AMQP server on 10.222.0.78:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Feb 17 04:51:17.105735 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-8618565a-0a69-4d98-a9d0-100ff29189ae tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Calling method '.version_select at 0x7f57c88f1e18>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:51:17.614946 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-8618565a-0a69-4d98-a9d0-100ff29189ae tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] [instance: b6686a99-4b41-4cf6-8ff1-e629873aa237] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:51:17.624511 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-8618565a-0a69-4d98-a9d0-100ff29189ae tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:51:17.625019 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-8618565a-0a69-4d98-a9d0-100ff29189ae tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:51:17.625876 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-8618565a-0a69-4d98-a9d0-100ff29189ae tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:51:17.626371 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-8618565a-0a69-4d98-a9d0-100ff29189ae tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:51:17.689678 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-8618565a-0a69-4d98-a9d0-100ff29189ae tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Acquired lock "refresh_cache-b6686a99-4b41-4cf6-8ff1-e629873aa237" {{(pid=98179) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:266}} Feb 17 04:51:18.117575 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO oslo.messaging._drivers.impl_rabbit [-] [5a9ab647-45d8-4916-a9a5-b6477356342d] Reconnected to AMQP server on 10.222.0.78:5672 via [amqp] client with port 34242. Feb 17 04:51:19.691399 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.network.neutron [None req-8618565a-0a69-4d98-a9d0-100ff29189ae tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] [instance: b6686a99-4b41-4cf6-8ff1-e629873aa237] Building network info cache for instance {{(pid=98179) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1836}} Feb 17 04:51:19.701907 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: ERROR oslo.messaging._drivers.impl_rabbit [-] [74073561-5d49-4824-899c-58d1d7a4dfc3] AMQP server on 10.222.0.78:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Feb 17 04:51:19.834734 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [req-6b757209-11f3-4c43-9dfc-de56f8bc1689 req-0343a95b-1934-4cf7-b558-261d9d7dde3c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b6686a99-4b41-4cf6-8ff1-e629873aa237", "tag": "d69d10d7-eabf-4be7-a0bb-db6bcbde9af7"}]} {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:51:19.836896 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:51:19.836896 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: warnings.warn(msg) Feb 17 04:51:19.847476 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [req-6b757209-11f3-4c43-9dfc-de56f8bc1689 req-0343a95b-1934-4cf7-b558-261d9d7dde3c service nova] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:51:19.847977 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [req-6b757209-11f3-4c43-9dfc-de56f8bc1689 req-0343a95b-1934-4cf7-b558-261d9d7dde3c service nova] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:51:19.868238 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.compute.server_external_events [req-6b757209-11f3-4c43-9dfc-de56f8bc1689 req-0343a95b-1934-4cf7-b558-261d9d7dde3c service nova] Creating event network-changed:d69d10d7-eabf-4be7-a0bb-db6bcbde9af7 for instance b6686a99-4b41-4cf6-8ff1-e629873aa237 on hv-cinder-75998 Feb 17 04:51:19.874611 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [req-6b757209-11f3-4c43-9dfc-de56f8bc1689 req-0343a95b-1934-4cf7-b558-261d9d7dde3c service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.177940 Feb 17 04:51:19.875508 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 795/1679] 10.222.0.78 () {64 vars in 1308 bytes} [Wed Feb 17 04:51:19 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 17 04:51:20.537073 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.network.neutron [None req-8618565a-0a69-4d98-a9d0-100ff29189ae tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] [instance: b6686a99-4b41-4cf6-8ff1-e629873aa237] Updating instance_info_cache with network_info: [{"id": "d69d10d7-eabf-4be7-a0bb-db6bcbde9af7", "address": "fa:16:3e:2f:52:7a", "network": {"id": "f6965ef8-6afe-410e-82fc-d80ca8d91ef7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1360287644-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "9a3a6cbbd6d14db5bf2f631af62262de", "mtu": 1450, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, "devname": "tapd69d10d7-ea", "ovs_interfaceid": "d69d10d7-eabf-4be7-a0bb-db6bcbde9af7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "meta": {}}] {{(pid=98179) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Feb 17 04:51:20.548892 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-8618565a-0a69-4d98-a9d0-100ff29189ae tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Releasing lock "refresh_cache-b6686a99-4b41-4cf6-8ff1-e629873aa237" {{(pid=98179) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:282}} Feb 17 04:51:20.549859 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-8618565a-0a69-4d98-a9d0-100ff29189ae tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] 10.222.0.78 "DELETE /compute/v2.1/os-floating-ips/bee9e1a9-7bb7-4cca-90bd-f150474cf867" status: 202 len: 0 microversion: 2.1 time: 3.450829 Feb 17 04:51:20.550981 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 885/1680] 10.222.0.78 () {58 vars in 1253 bytes} [Wed Feb 17 04:51:17 2021] DELETE /compute/v2.1/os-floating-ips/bee9e1a9-7bb7-4cca-90bd-f150474cf867 => generated 0 bytes in 3453 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:51:20.561215 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-39fb7a66-efd8-450d-864e-df27e06be221 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:51:20.561882 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-39fb7a66-efd8-450d-864e-df27e06be221 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] [instance: b6686a99-4b41-4cf6-8ff1-e629873aa237] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:51:20.570273 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-39fb7a66-efd8-450d-864e-df27e06be221 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:51:20.570792 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-39fb7a66-efd8-450d-864e-df27e06be221 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:51:20.571658 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-39fb7a66-efd8-450d-864e-df27e06be221 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:51:20.572159 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-39fb7a66-efd8-450d-864e-df27e06be221 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:51:20.640832 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-39fb7a66-efd8-450d-864e-df27e06be221 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] [instance: b6686a99-4b41-4cf6-8ff1-e629873aa237] Going to try to terminate instance {{(pid=98178) delete /opt/stack/nova/nova/compute/api.py:2540}} Feb 17 04:51:20.756849 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO oslo.messaging._drivers.impl_rabbit [-] [74073561-5d49-4824-899c-58d1d7a4dfc3] Reconnected to AMQP server on 10.222.0.78:5672 via [amqp] client with port 34250. Feb 17 04:51:20.771862 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-39fb7a66-efd8-450d-864e-df27e06be221 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] 10.222.0.78 "DELETE /compute/v2.1/servers/b6686a99-4b41-4cf6-8ff1-e629873aa237" status: 204 len: 0 microversion: 2.1 time: 0.215542 Feb 17 04:51:20.772793 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 796/1681] 10.222.0.78 () {58 vars in 1229 bytes} [Wed Feb 17 04:51:20 2021] DELETE /compute/v2.1/servers/b6686a99-4b41-4cf6-8ff1-e629873aa237 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 17 04:51:20.781521 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-228242ad-2272-461a-af99-996e17aa77d8 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:51:20.782191 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-228242ad-2272-461a-af99-996e17aa77d8 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] [instance: b6686a99-4b41-4cf6-8ff1-e629873aa237] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:51:20.790231 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-228242ad-2272-461a-af99-996e17aa77d8 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:51:20.790652 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-228242ad-2272-461a-af99-996e17aa77d8 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:51:20.792154 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-228242ad-2272-461a-af99-996e17aa77d8 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:51:20.792793 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-228242ad-2272-461a-af99-996e17aa77d8 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:51:21.029232 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-228242ad-2272-461a-af99-996e17aa77d8 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b5a6c15a7c4228a0f94762b8b7b4a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a3a6cbbd6d14db5bf2f631af62262de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:51:21.038247 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-228242ad-2272-461a-af99-996e17aa77d8 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] 10.222.0.78 "GET /compute/v2.1/servers/b6686a99-4b41-4cf6-8ff1-e629873aa237" status: 200 len: 1467 microversion: 2.1 time: 0.260697 Feb 17 04:51:21.038856 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 886/1682] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:51:20 2021] GET /compute/v2.1/servers/b6686a99-4b41-4cf6-8ff1-e629873aa237 => generated 1467 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:51:22.058116 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-be83f005-d04f-4813-b022-b287a12079a2 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:51:22.058895 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-be83f005-d04f-4813-b022-b287a12079a2 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] [instance: b6686a99-4b41-4cf6-8ff1-e629873aa237] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:51:22.066738 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-be83f005-d04f-4813-b022-b287a12079a2 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:51:22.067286 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-be83f005-d04f-4813-b022-b287a12079a2 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:51:22.068137 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-be83f005-d04f-4813-b022-b287a12079a2 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:51:22.068640 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-be83f005-d04f-4813-b022-b287a12079a2 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:51:22.299074 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-be83f005-d04f-4813-b022-b287a12079a2 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b5a6c15a7c4228a0f94762b8b7b4a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a3a6cbbd6d14db5bf2f631af62262de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:51:22.308008 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-be83f005-d04f-4813-b022-b287a12079a2 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] 10.222.0.78 "GET /compute/v2.1/servers/b6686a99-4b41-4cf6-8ff1-e629873aa237" status: 200 len: 1467 microversion: 2.1 time: 0.254435 Feb 17 04:51:22.308661 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 797/1683] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:51:22 2021] GET /compute/v2.1/servers/b6686a99-4b41-4cf6-8ff1-e629873aa237 => generated 1467 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:51:23.326984 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-3f040d3c-0af2-4e5b-8b37-883c93a25aa5 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:51:23.327754 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-3f040d3c-0af2-4e5b-8b37-883c93a25aa5 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] [instance: b6686a99-4b41-4cf6-8ff1-e629873aa237] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:51:23.337233 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-3f040d3c-0af2-4e5b-8b37-883c93a25aa5 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:51:23.337612 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-3f040d3c-0af2-4e5b-8b37-883c93a25aa5 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:51:23.338475 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-3f040d3c-0af2-4e5b-8b37-883c93a25aa5 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:51:23.339961 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-3f040d3c-0af2-4e5b-8b37-883c93a25aa5 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:51:23.478986 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-3f040d3c-0af2-4e5b-8b37-883c93a25aa5 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b5a6c15a7c4228a0f94762b8b7b4a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a3a6cbbd6d14db5bf2f631af62262de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:51:23.489031 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-3f040d3c-0af2-4e5b-8b37-883c93a25aa5 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] 10.222.0.78 "GET /compute/v2.1/servers/b6686a99-4b41-4cf6-8ff1-e629873aa237" status: 200 len: 1392 microversion: 2.1 time: 0.166936 Feb 17 04:51:23.489642 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 887/1684] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:51:23 2021] GET /compute/v2.1/servers/b6686a99-4b41-4cf6-8ff1-e629873aa237 => generated 1392 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:51:23.685999 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [req-cf8fe780-385a-4c81-965a-c8dd284abec4 req-54040e93-b75e-466f-bc33-7862092f6d91 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b6686a99-4b41-4cf6-8ff1-e629873aa237", "name": "network-vif-deleted", "tag": "d69d10d7-eabf-4be7-a0bb-db6bcbde9af7"}]} {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:51:23.687848 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:51:23.687848 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: warnings.warn(msg) Feb 17 04:51:23.697000 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [req-cf8fe780-385a-4c81-965a-c8dd284abec4 req-54040e93-b75e-466f-bc33-7862092f6d91 service nova] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:51:23.697499 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [req-cf8fe780-385a-4c81-965a-c8dd284abec4 req-54040e93-b75e-466f-bc33-7862092f6d91 service nova] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:51:23.716900 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.compute.server_external_events [req-cf8fe780-385a-4c81-965a-c8dd284abec4 req-54040e93-b75e-466f-bc33-7862092f6d91 service nova] Creating event network-vif-deleted:d69d10d7-eabf-4be7-a0bb-db6bcbde9af7 for instance b6686a99-4b41-4cf6-8ff1-e629873aa237 on hv-cinder-75998 Feb 17 04:51:23.721864 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [req-cf8fe780-385a-4c81-965a-c8dd284abec4 req-54040e93-b75e-466f-bc33-7862092f6d91 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039897 Feb 17 04:51:23.722520 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 798/1685] 10.222.0.78 () {64 vars in 1308 bytes} [Wed Feb 17 04:51:23 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:51:24.508447 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-0e67bc86-044a-48f8-a487-ba29438fd228 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:51:24.509171 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-0e67bc86-044a-48f8-a487-ba29438fd228 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] [instance: b6686a99-4b41-4cf6-8ff1-e629873aa237] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:51:24.518355 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-0e67bc86-044a-48f8-a487-ba29438fd228 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:51:24.518917 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-0e67bc86-044a-48f8-a487-ba29438fd228 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:51:24.519912 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-0e67bc86-044a-48f8-a487-ba29438fd228 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:51:24.520415 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-0e67bc86-044a-48f8-a487-ba29438fd228 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:51:24.593873 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-0e67bc86-044a-48f8-a487-ba29438fd228 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:51:24.594303 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-0e67bc86-044a-48f8-a487-ba29438fd228 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:51:24.594816 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.objects.instance [None req-0e67bc86-044a-48f8-a487-ba29438fd228 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lazy-loading 'fault' on Instance uuid b6686a99-4b41-4cf6-8ff1-e629873aa237 {{(pid=98179) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Feb 17 04:51:24.658771 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-0e67bc86-044a-48f8-a487-ba29438fd228 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b5a6c15a7c4228a0f94762b8b7b4a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a3a6cbbd6d14db5bf2f631af62262de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:51:24.668278 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-0e67bc86-044a-48f8-a487-ba29438fd228 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] 10.222.0.78 "GET /compute/v2.1/servers/b6686a99-4b41-4cf6-8ff1-e629873aa237" status: 200 len: 1230 microversion: 2.1 time: 0.163374 Feb 17 04:51:24.668903 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 888/1686] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:51:24 2021] GET /compute/v2.1/servers/b6686a99-4b41-4cf6-8ff1-e629873aa237 => generated 1230 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:51:25.688228 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-8417ceda-7963-4ff9-93ba-a84031035279 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:51:25.689050 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-8417ceda-7963-4ff9-93ba-a84031035279 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] [instance: b6686a99-4b41-4cf6-8ff1-e629873aa237] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:51:25.697187 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-8417ceda-7963-4ff9-93ba-a84031035279 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:51:25.697704 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-8417ceda-7963-4ff9-93ba-a84031035279 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:51:25.698620 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-8417ceda-7963-4ff9-93ba-a84031035279 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:51:25.699263 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-8417ceda-7963-4ff9-93ba-a84031035279 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:51:25.752760 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.wsgi [None req-8417ceda-7963-4ff9-93ba-a84031035279 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] HTTP exception thrown: Instance b6686a99-4b41-4cf6-8ff1-e629873aa237 could not be found. Feb 17 04:51:25.753352 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-8417ceda-7963-4ff9-93ba-a84031035279 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Returning 404 to user: Instance b6686a99-4b41-4cf6-8ff1-e629873aa237 could not be found. {{(pid=98178) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 17 04:51:25.754253 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-8417ceda-7963-4ff9-93ba-a84031035279 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] 10.222.0.78 "GET /compute/v2.1/servers/b6686a99-4b41-4cf6-8ff1-e629873aa237" status: 404 len: 111 microversion: 2.1 time: 0.071355 Feb 17 04:51:25.754862 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 799/1687] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:51:25 2021] GET /compute/v2.1/servers/b6686a99-4b41-4cf6-8ff1-e629873aa237 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 17 04:51:28.184170 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-7fe24b68-991b-4bcc-aff0-5a3ace0afa07 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Calling method '.version_select at 0x7f57c88f1f28>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:51:28.696182 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-7fe24b68-991b-4bcc-aff0-5a3ace0afa07 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] [instance: d7de8213-4471-4db7-85fa-5281594fb263] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:51:28.705581 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-7fe24b68-991b-4bcc-aff0-5a3ace0afa07 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:51:28.706095 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-7fe24b68-991b-4bcc-aff0-5a3ace0afa07 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:51:28.706960 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-7fe24b68-991b-4bcc-aff0-5a3ace0afa07 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:51:28.707487 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-7fe24b68-991b-4bcc-aff0-5a3ace0afa07 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:51:28.773022 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-7fe24b68-991b-4bcc-aff0-5a3ace0afa07 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Acquired lock "refresh_cache-d7de8213-4471-4db7-85fa-5281594fb263" {{(pid=98179) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:266}} Feb 17 04:51:30.745928 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.network.neutron [None req-7fe24b68-991b-4bcc-aff0-5a3ace0afa07 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] [instance: d7de8213-4471-4db7-85fa-5281594fb263] Building network info cache for instance {{(pid=98179) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1836}} Feb 17 04:51:30.755126 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [req-43bb4ae7-c431-4654-a534-9f28c231e96c req-84db828c-1fb7-422a-a64d-083110c338fb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d7de8213-4471-4db7-85fa-5281594fb263", "tag": "2480c767-ef46-4401-82a3-4df91eb9e7d4"}]} {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:51:30.756859 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:51:30.756859 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: warnings.warn(msg) Feb 17 04:51:30.773595 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [req-43bb4ae7-c431-4654-a534-9f28c231e96c req-84db828c-1fb7-422a-a64d-083110c338fb service nova] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:51:30.774182 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [req-43bb4ae7-c431-4654-a534-9f28c231e96c req-84db828c-1fb7-422a-a64d-083110c338fb service nova] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:51:30.792351 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.compute.server_external_events [req-43bb4ae7-c431-4654-a534-9f28c231e96c req-84db828c-1fb7-422a-a64d-083110c338fb service nova] Creating event network-changed:2480c767-ef46-4401-82a3-4df91eb9e7d4 for instance d7de8213-4471-4db7-85fa-5281594fb263 on hv-cinder-75998 Feb 17 04:51:30.798484 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [req-43bb4ae7-c431-4654-a534-9f28c231e96c req-84db828c-1fb7-422a-a64d-083110c338fb service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047307 Feb 17 04:51:30.799445 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 800/1688] 10.222.0.78 () {64 vars in 1308 bytes} [Wed Feb 17 04:51:30 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:51:31.597506 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.network.neutron [None req-7fe24b68-991b-4bcc-aff0-5a3ace0afa07 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] [instance: d7de8213-4471-4db7-85fa-5281594fb263] Updating instance_info_cache with network_info: [{"id": "2480c767-ef46-4401-82a3-4df91eb9e7d4", "address": "fa:16:3e:08:79:a4", "network": {"id": "f6965ef8-6afe-410e-82fc-d80ca8d91ef7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1360287644-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "9a3a6cbbd6d14db5bf2f631af62262de", "mtu": 1450, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, "devname": "tap2480c767-ef", "ovs_interfaceid": "2480c767-ef46-4401-82a3-4df91eb9e7d4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "meta": {}}] {{(pid=98179) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Feb 17 04:51:31.609155 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-7fe24b68-991b-4bcc-aff0-5a3ace0afa07 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Releasing lock "refresh_cache-d7de8213-4471-4db7-85fa-5281594fb263" {{(pid=98179) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:282}} Feb 17 04:51:31.610325 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-7fe24b68-991b-4bcc-aff0-5a3ace0afa07 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] 10.222.0.78 "DELETE /compute/v2.1/os-floating-ips/7655d17b-c344-41d0-9863-fdc1c9cae2d8" status: 202 len: 0 microversion: 2.1 time: 3.430086 Feb 17 04:51:31.614291 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 889/1689] 10.222.0.78 () {58 vars in 1253 bytes} [Wed Feb 17 04:51:28 2021] DELETE /compute/v2.1/os-floating-ips/7655d17b-c344-41d0-9863-fdc1c9cae2d8 => generated 0 bytes in 3432 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:51:31.620778 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-150061d0-8812-496b-9ba0-1c26dbacae2a tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:51:31.621607 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-150061d0-8812-496b-9ba0-1c26dbacae2a tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] [instance: d7de8213-4471-4db7-85fa-5281594fb263] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:51:31.630345 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-150061d0-8812-496b-9ba0-1c26dbacae2a tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:51:31.630860 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-150061d0-8812-496b-9ba0-1c26dbacae2a tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:51:31.632015 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-150061d0-8812-496b-9ba0-1c26dbacae2a tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:51:31.632529 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-150061d0-8812-496b-9ba0-1c26dbacae2a tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:51:31.706185 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-150061d0-8812-496b-9ba0-1c26dbacae2a tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] [instance: d7de8213-4471-4db7-85fa-5281594fb263] Going to try to terminate instance {{(pid=98178) delete /opt/stack/nova/nova/compute/api.py:2540}} Feb 17 04:51:31.827793 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-150061d0-8812-496b-9ba0-1c26dbacae2a tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] 10.222.0.78 "DELETE /compute/v2.1/servers/d7de8213-4471-4db7-85fa-5281594fb263" status: 204 len: 0 microversion: 2.1 time: 0.210939 Feb 17 04:51:31.828512 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 801/1690] 10.222.0.78 () {58 vars in 1229 bytes} [Wed Feb 17 04:51:31 2021] DELETE /compute/v2.1/servers/d7de8213-4471-4db7-85fa-5281594fb263 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 17 04:51:31.837245 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-98a293e5-57ee-46e4-ad88-bdd9a7061d84 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:51:31.837916 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-98a293e5-57ee-46e4-ad88-bdd9a7061d84 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] [instance: d7de8213-4471-4db7-85fa-5281594fb263] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:51:31.846481 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-98a293e5-57ee-46e4-ad88-bdd9a7061d84 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:51:31.846922 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-98a293e5-57ee-46e4-ad88-bdd9a7061d84 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:51:31.847789 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-98a293e5-57ee-46e4-ad88-bdd9a7061d84 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:51:31.848279 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-98a293e5-57ee-46e4-ad88-bdd9a7061d84 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:51:32.085678 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-98a293e5-57ee-46e4-ad88-bdd9a7061d84 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b5a6c15a7c4228a0f94762b8b7b4a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a3a6cbbd6d14db5bf2f631af62262de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:51:32.095241 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-98a293e5-57ee-46e4-ad88-bdd9a7061d84 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] 10.222.0.78 "GET /compute/v2.1/servers/d7de8213-4471-4db7-85fa-5281594fb263" status: 200 len: 1468 microversion: 2.1 time: 0.262130 Feb 17 04:51:32.095843 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 890/1691] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:51:31 2021] GET /compute/v2.1/servers/d7de8213-4471-4db7-85fa-5281594fb263 => generated 1468 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:51:33.116452 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-62e690a0-bf4a-423b-af32-318a1f8eb28f tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:51:33.117239 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-62e690a0-bf4a-423b-af32-318a1f8eb28f tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] [instance: d7de8213-4471-4db7-85fa-5281594fb263] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:51:33.125547 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-62e690a0-bf4a-423b-af32-318a1f8eb28f tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:51:33.126066 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-62e690a0-bf4a-423b-af32-318a1f8eb28f tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:51:33.126910 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-62e690a0-bf4a-423b-af32-318a1f8eb28f tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:51:33.127470 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-62e690a0-bf4a-423b-af32-318a1f8eb28f tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:51:33.366916 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-62e690a0-bf4a-423b-af32-318a1f8eb28f tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b5a6c15a7c4228a0f94762b8b7b4a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a3a6cbbd6d14db5bf2f631af62262de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98178) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:51:33.375741 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-62e690a0-bf4a-423b-af32-318a1f8eb28f tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] 10.222.0.78 "GET /compute/v2.1/servers/d7de8213-4471-4db7-85fa-5281594fb263" status: 200 len: 1468 microversion: 2.1 time: 0.263787 Feb 17 04:51:33.376344 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 802/1692] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:51:33 2021] GET /compute/v2.1/servers/d7de8213-4471-4db7-85fa-5281594fb263 => generated 1468 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:51:34.394999 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-89a9048f-13e5-4aa2-9f83-1e61dafe400f tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:51:34.395696 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-89a9048f-13e5-4aa2-9f83-1e61dafe400f tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] [instance: d7de8213-4471-4db7-85fa-5281594fb263] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:51:34.404046 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-89a9048f-13e5-4aa2-9f83-1e61dafe400f tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:51:34.404557 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-89a9048f-13e5-4aa2-9f83-1e61dafe400f tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:51:34.406058 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-89a9048f-13e5-4aa2-9f83-1e61dafe400f tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:51:34.406545 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-89a9048f-13e5-4aa2-9f83-1e61dafe400f tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:51:34.538995 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-89a9048f-13e5-4aa2-9f83-1e61dafe400f tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b5a6c15a7c4228a0f94762b8b7b4a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a3a6cbbd6d14db5bf2f631af62262de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:51:34.548011 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-89a9048f-13e5-4aa2-9f83-1e61dafe400f tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] 10.222.0.78 "GET /compute/v2.1/servers/d7de8213-4471-4db7-85fa-5281594fb263" status: 200 len: 1393 microversion: 2.1 time: 0.157175 Feb 17 04:51:34.548593 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 891/1693] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:51:34 2021] GET /compute/v2.1/servers/d7de8213-4471-4db7-85fa-5281594fb263 => generated 1393 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:51:34.643245 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [req-07a65a0d-5f66-47b7-968d-bf273a929899 req-21e561e1-3308-4d0a-987b-cb31d1bf3198 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7de8213-4471-4db7-85fa-5281594fb263", "name": "network-vif-deleted", "tag": "2480c767-ef46-4401-82a3-4df91eb9e7d4"}]} {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:51:34.644892 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:51:34.644892 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: warnings.warn(msg) Feb 17 04:51:34.654083 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [req-07a65a0d-5f66-47b7-968d-bf273a929899 req-21e561e1-3308-4d0a-987b-cb31d1bf3198 service nova] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:51:34.654668 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [req-07a65a0d-5f66-47b7-968d-bf273a929899 req-21e561e1-3308-4d0a-987b-cb31d1bf3198 service nova] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:51:34.672208 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.compute.server_external_events [req-07a65a0d-5f66-47b7-968d-bf273a929899 req-21e561e1-3308-4d0a-987b-cb31d1bf3198 service nova] Creating event network-vif-deleted:2480c767-ef46-4401-82a3-4df91eb9e7d4 for instance d7de8213-4471-4db7-85fa-5281594fb263 on hv-cinder-75998 Feb 17 04:51:34.677369 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [req-07a65a0d-5f66-47b7-968d-bf273a929899 req-21e561e1-3308-4d0a-987b-cb31d1bf3198 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039009 Feb 17 04:51:34.678076 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 803/1694] 10.222.0.78 () {64 vars in 1308 bytes} [Wed Feb 17 04:51:34 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:51:35.566638 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-c955bdff-c957-49a7-95c3-ce130da10c81 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:51:35.567388 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-c955bdff-c957-49a7-95c3-ce130da10c81 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] [instance: d7de8213-4471-4db7-85fa-5281594fb263] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:51:35.575278 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-c955bdff-c957-49a7-95c3-ce130da10c81 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:51:35.575790 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-c955bdff-c957-49a7-95c3-ce130da10c81 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:51:35.576628 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-c955bdff-c957-49a7-95c3-ce130da10c81 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:51:35.577116 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-c955bdff-c957-49a7-95c3-ce130da10c81 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:51:35.657110 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-c955bdff-c957-49a7-95c3-ce130da10c81 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:51:35.657622 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-c955bdff-c957-49a7-95c3-ce130da10c81 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:51:35.658135 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.objects.instance [None req-c955bdff-c957-49a7-95c3-ce130da10c81 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lazy-loading 'fault' on Instance uuid d7de8213-4471-4db7-85fa-5281594fb263 {{(pid=98179) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Feb 17 04:51:35.722038 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.policy [None req-c955bdff-c957-49a7-95c3-ce130da10c81 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b5a6c15a7c4228a0f94762b8b7b4a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a3a6cbbd6d14db5bf2f631af62262de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98179) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:51:35.730409 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-c955bdff-c957-49a7-95c3-ce130da10c81 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] 10.222.0.78 "GET /compute/v2.1/servers/d7de8213-4471-4db7-85fa-5281594fb263" status: 200 len: 1185 microversion: 2.1 time: 0.168443 Feb 17 04:51:35.731010 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 892/1695] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:51:35 2021] GET /compute/v2.1/servers/d7de8213-4471-4db7-85fa-5281594fb263 => generated 1185 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:51:36.750766 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-d2a0326b-d93e-48a8-81ce-1599a33a45a5 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:51:36.751572 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-d2a0326b-d93e-48a8-81ce-1599a33a45a5 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] [instance: d7de8213-4471-4db7-85fa-5281594fb263] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:51:36.759781 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-d2a0326b-d93e-48a8-81ce-1599a33a45a5 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:51:36.760297 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-d2a0326b-d93e-48a8-81ce-1599a33a45a5 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:51:36.761133 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-d2a0326b-d93e-48a8-81ce-1599a33a45a5 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:51:36.761629 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-d2a0326b-d93e-48a8-81ce-1599a33a45a5 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:51:36.815511 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.wsgi [None req-d2a0326b-d93e-48a8-81ce-1599a33a45a5 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] HTTP exception thrown: Instance d7de8213-4471-4db7-85fa-5281594fb263 could not be found. Feb 17 04:51:36.816170 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-d2a0326b-d93e-48a8-81ce-1599a33a45a5 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Returning 404 to user: Instance d7de8213-4471-4db7-85fa-5281594fb263 could not be found. {{(pid=98178) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 17 04:51:36.817059 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-d2a0326b-d93e-48a8-81ce-1599a33a45a5 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] 10.222.0.78 "GET /compute/v2.1/servers/d7de8213-4471-4db7-85fa-5281594fb263" status: 404 len: 111 microversion: 2.1 time: 0.070893 Feb 17 04:51:36.817665 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 804/1696] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:51:36 2021] GET /compute/v2.1/servers/d7de8213-4471-4db7-85fa-5281594fb263 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 17 04:51:36.826417 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-61a583a6-402d-4fd0-bb4c-c37570db3a86 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Calling method '.version_select at 0x7f57c93d3730>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:51:38.445172 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-61a583a6-402d-4fd0-bb4c-c37570db3a86 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] 10.222.0.78 "DELETE /compute/v2.1/os-floating-ips/0859b380-2a07-4097-80ff-ca7c3604de07" status: 202 len: 0 microversion: 2.1 time: 1.622627 Feb 17 04:51:38.445816 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 893/1697] 10.222.0.78 () {58 vars in 1253 bytes} [Wed Feb 17 04:51:36 2021] DELETE /compute/v2.1/os-floating-ips/0859b380-2a07-4097-80ff-ca7c3604de07 => generated 0 bytes in 1624 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:51:38.455220 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-f80e7b84-d88a-488e-8fe5-021e7d5edbcb tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Calling method '>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:51:38.455771 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-f80e7b84-d88a-488e-8fe5-021e7d5edbcb tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] [instance: 6cfbe354-bb33-4741-93e8-f09b3610df7a] Fetching instance by UUID {{(pid=98178) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:51:38.463597 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-f80e7b84-d88a-488e-8fe5-021e7d5edbcb tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:51:38.464099 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-f80e7b84-d88a-488e-8fe5-021e7d5edbcb tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:51:38.464931 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-f80e7b84-d88a-488e-8fe5-021e7d5edbcb tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:51:38.465423 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-f80e7b84-d88a-488e-8fe5-021e7d5edbcb tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98178) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:51:38.521576 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.wsgi [None req-f80e7b84-d88a-488e-8fe5-021e7d5edbcb tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] HTTP exception thrown: Instance 6cfbe354-bb33-4741-93e8-f09b3610df7a could not be found. Feb 17 04:51:38.522224 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-f80e7b84-d88a-488e-8fe5-021e7d5edbcb tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Returning 404 to user: Instance 6cfbe354-bb33-4741-93e8-f09b3610df7a could not be found. {{(pid=98178) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 17 04:51:38.523127 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-f80e7b84-d88a-488e-8fe5-021e7d5edbcb tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] 10.222.0.78 "DELETE /compute/v2.1/servers/6cfbe354-bb33-4741-93e8-f09b3610df7a" status: 404 len: 111 microversion: 2.1 time: 0.072726 Feb 17 04:51:38.523715 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 805/1698] 10.222.0.78 () {58 vars in 1229 bytes} [Wed Feb 17 04:51:38 2021] DELETE /compute/v2.1/servers/6cfbe354-bb33-4741-93e8-f09b3610df7a => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 17 04:51:38.532791 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-cfeeb948-9b86-4d36-b8c2-334576cd9743 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Calling method '>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:51:38.533478 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.compute.api [None req-cfeeb948-9b86-4d36-b8c2-334576cd9743 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] [instance: 6cfbe354-bb33-4741-93e8-f09b3610df7a] Fetching instance by UUID {{(pid=98179) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:51:38.542051 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-cfeeb948-9b86-4d36-b8c2-334576cd9743 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:51:38.542568 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-cfeeb948-9b86-4d36-b8c2-334576cd9743 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:51:38.543443 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-cfeeb948-9b86-4d36-b8c2-334576cd9743 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:51:38.543941 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG oslo_concurrency.lockutils [None req-cfeeb948-9b86-4d36-b8c2-334576cd9743 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Lock "2ad0e24a-b803-4b80-a765-57fb829d8448" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98179) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:51:38.596611 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.wsgi [None req-cfeeb948-9b86-4d36-b8c2-334576cd9743 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] HTTP exception thrown: Instance 6cfbe354-bb33-4741-93e8-f09b3610df7a could not be found. Feb 17 04:51:38.597277 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-cfeeb948-9b86-4d36-b8c2-334576cd9743 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Returning 404 to user: Instance 6cfbe354-bb33-4741-93e8-f09b3610df7a could not be found. {{(pid=98179) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 17 04:51:38.598173 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-cfeeb948-9b86-4d36-b8c2-334576cd9743 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] 10.222.0.78 "GET /compute/v2.1/servers/6cfbe354-bb33-4741-93e8-f09b3610df7a" status: 404 len: 111 microversion: 2.1 time: 0.069766 Feb 17 04:51:38.598783 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 894/1699] 10.222.0.78 () {58 vars in 1226 bytes} [Wed Feb 17 04:51:38 2021] GET /compute/v2.1/servers/6cfbe354-bb33-4741-93e8-f09b3610df7a => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 17 04:51:39.849566 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-61098001-0cb1-4662-a6df-9efc623c7bca tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Calling method '.version_select at 0x7f57cd3b9d90>' {{(pid=98178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:51:40.106484 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-61098001-0cb1-4662-a6df-9efc623c7bca tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] 10.222.0.78 "DELETE /compute/v2.1/os-security-groups/10b648c5-8db3-4c58-befb-5d716c01da5c" status: 202 len: 0 microversion: 2.1 time: 0.260680 Feb 17 04:51:40.107151 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98178|app: 0|req: 806/1700] 10.222.0.78 () {58 vars in 1262 bytes} [Wed Feb 17 04:51:39 2021] DELETE /compute/v2.1/os-security-groups/10b648c5-8db3-4c58-befb-5d716c01da5c => generated 0 bytes in 262 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:51:40.116822 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: DEBUG nova.api.openstack.wsgi [None req-b3b69093-3a9c-4a51-a3a6-9e2aefd2b385 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] Calling method '.version_select at 0x7f57c8773488>' {{(pid=98179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:51:40.136585 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO nova.api.openstack.requestlog [None req-b3b69093-3a9c-4a51-a3a6-9e2aefd2b385 tempest-TestVolumeBootPattern-2145671770 tempest-TestVolumeBootPattern-2145671770-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1695173271" status: 202 len: 0 microversion: 2.1 time: 0.023689 Feb 17 04:51:40.137433 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: [pid: 98179|app: 0|req: 895/1701] 10.222.0.78 () {58 vars in 1253 bytes} [Wed Feb 17 04:51:40 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1695173271 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:51:46.943353 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 17 04:51:46.943952 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: Wed Feb 17 04:51:46 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 17 04:51:49.177863 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 17 04:51:49.178388 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: Wed Feb 17 04:51:49 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 17 04:52:06.800889 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 17 04:52:06.801502 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: Wed Feb 17 04:52:06 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 17 04:53:36.814907 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 17 04:53:36.815546 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: Wed Feb 17 04:53:36 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 17 04:54:30.679830 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 17 04:54:30.680446 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: Wed Feb 17 04:54:30 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 17 04:54:50.778417 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 17 04:54:50.778965 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: Wed Feb 17 04:54:50 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 17 04:55:06.960475 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 17 04:55:06.961116 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: Wed Feb 17 04:55:06 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 17 04:55:09.196001 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 17 04:55:09.196413 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: Wed Feb 17 04:55:09 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 17 04:55:26.818224 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 17 04:55:26.818864 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: Wed Feb 17 04:55:26 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 17 04:56:56.831853 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 17 04:56:56.832477 dv-cinder-759987-4-iscsi devstack@n-api.service[98176]: Wed Feb 17 04:56:56 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!